-- Logs begin at Thu 2022-10-13 10:30:00 UTC, end at Thu 2022-10-13 11:26:42 UTC. -- Oct 13 10:56:39.428367 dv-cinder-861001-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Oct 13 10:56:39.448519 dv-cinder-861001-1-smb devstack@keystone.service[81541]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 13 10:56:39.449593 dv-cinder-861001-1-smb devstack@keystone.service[81541]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Oct 13 10:56:39 2022] *** Oct 13 10:56:39.449593 dv-cinder-861001-1-smb devstack@keystone.service[81541]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 13 10:56:39.449593 dv-cinder-861001-1-smb devstack@keystone.service[81541]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 13 10:56:39.449593 dv-cinder-861001-1-smb devstack@keystone.service[81541]: nodename: dv-cinder-861001-1-smb Oct 13 10:56:39.449593 dv-cinder-861001-1-smb devstack@keystone.service[81541]: machine: x86_64 Oct 13 10:56:39.449593 dv-cinder-861001-1-smb devstack@keystone.service[81541]: clock source: unix Oct 13 10:56:39.449593 dv-cinder-861001-1-smb devstack@keystone.service[81541]: pcre jit disabled Oct 13 10:56:39.449593 dv-cinder-861001-1-smb devstack@keystone.service[81541]: detected number of CPU cores: 4 Oct 13 10:56:39.449593 dv-cinder-861001-1-smb devstack@keystone.service[81541]: current working directory: / Oct 13 10:56:39.449593 dv-cinder-861001-1-smb devstack@keystone.service[81541]: detected binary path: /usr/bin/uwsgi-core Oct 13 10:56:39.450154 dv-cinder-861001-1-smb devstack@keystone.service[81541]: your processes number limit is 47680 Oct 13 10:56:39.450154 dv-cinder-861001-1-smb devstack@keystone.service[81541]: your memory page size is 4096 bytes Oct 13 10:56:39.450154 dv-cinder-861001-1-smb devstack@keystone.service[81541]: detected max file descriptor number: 2048 Oct 13 10:56:39.450154 dv-cinder-861001-1-smb devstack@keystone.service[81541]: lock engine: pthread robust mutexes Oct 13 10:56:39.450154 dv-cinder-861001-1-smb devstack@keystone.service[81541]: thunder lock: enabled Oct 13 10:56:39.450154 dv-cinder-861001-1-smb devstack@keystone.service[81541]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 13 10:56:39.450154 dv-cinder-861001-1-smb devstack@keystone.service[81541]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 13 10:56:39.493246 dv-cinder-861001-1-smb devstack@keystone.service[81541]: Python main interpreter initialized at 0x55bc7dc369c0 Oct 13 10:56:39.493246 dv-cinder-861001-1-smb devstack@keystone.service[81541]: python threads support enabled Oct 13 10:56:39.493246 dv-cinder-861001-1-smb devstack@keystone.service[81541]: your server socket listen backlog is limited to 100 connections Oct 13 10:56:39.493246 dv-cinder-861001-1-smb devstack@keystone.service[81541]: your mercy for graceful operations on workers is 90 seconds Oct 13 10:56:39.493614 dv-cinder-861001-1-smb devstack@keystone.service[81541]: mapped 403077 bytes (393 KB) for 2 cores Oct 13 10:56:39.493693 dv-cinder-861001-1-smb devstack@keystone.service[81541]: *** Operational MODE: preforking *** Oct 13 10:56:39.493934 dv-cinder-861001-1-smb devstack@keystone.service[81541]: *** uWSGI is running in multiple interpreter mode *** Oct 13 10:56:39.493934 dv-cinder-861001-1-smb devstack@keystone.service[81541]: spawned uWSGI master process (pid: 81541) Oct 13 10:56:39.494158 dv-cinder-861001-1-smb systemd[1]: Started Devstack devstack@keystone.service. Oct 13 10:56:39.494980 dv-cinder-861001-1-smb devstack@keystone.service[81541]: spawned uWSGI worker 1 (pid: 81550, cores: 1) Oct 13 10:56:39.495222 dv-cinder-861001-1-smb devstack@keystone.service[81541]: spawned uWSGI worker 2 (pid: 81551, cores: 1) Oct 13 10:56:39.495450 dv-cinder-861001-1-smb devstack@keystone.service[81541]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 13 10:56:43.817394 dv-cinder-861001-1-smb devstack@keystone.service[81551]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 13 10:56:43.817394 dv-cinder-861001-1-smb devstack@keystone.service[81551]: from cryptography.utils import int_from_bytes Oct 13 10:56:43.818214 dv-cinder-861001-1-smb devstack@keystone.service[81551]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 13 10:56:43.818214 dv-cinder-861001-1-smb devstack@keystone.service[81551]: from cryptography.utils import int_from_bytes Oct 13 10:56:43.868152 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 13 10:56:43.868345 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 13 10:56:43.868537 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] command line args: [] {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 13 10:56:43.868805 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 13 10:56:43.868985 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] ================================================================================ {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 13 10:56:43.869239 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] admin_token = **** {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:43.869485 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] config_dir = [] {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:43.869673 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:43.869853 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] config_source = [] {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:43.870055 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] debug = True {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:43.870253 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:43.871613 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:43.871613 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:43.871613 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:43.871613 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:43.871613 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] list_limit = None {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:43.871935 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] log_config_append = None {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:43.871935 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:43.872043 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] log_dir = None {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:43.872153 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] log_file = None {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:43.872393 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:43.872624 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:43.872872 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:43.873120 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:43.873294 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:43.873469 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:43.873709 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:43.873973 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:43.874207 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:43.874441 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:43.874659 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:43.874889 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:43.875133 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:43.875374 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:43.875647 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:43.876140 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.25/identity {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:43.876321 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] publish_errors = False {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:43.876551 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:43.876779 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:43.876954 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:43.877199 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:43.877431 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:43.877663 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] standard_threads = False {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:43.877893 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:43.878162 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:43.878337 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:43.878511 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] use_journal = False {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:43.878684 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] use_json = False {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:43.878856 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] use_stderr = False {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:43.879028 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] use_syslog = False {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:43.879254 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:43.879506 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.879742 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.879999 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.880236 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.880504 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.880709 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.880951 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.881230 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.882015 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.882266 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.882517 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.882751 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.882996 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.883230 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.883476 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.883721 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.883955 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.884206 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.884458 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.884700 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.884933 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.885182 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.885441 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.885691 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.885976 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.886189 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.886474 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.886649 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.886881 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.887126 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.887374 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.887601 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.887828 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.888072 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.888317 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.888551 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.888801 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.889033 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.889267 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.889500 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.889728 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.889971 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.890203 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.890431 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.890666 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.890912 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.891139 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.891371 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.891599 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.891837 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.892070 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.892315 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.892548 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.892780 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.893013 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.893246 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.893479 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.893711 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.893954 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.894209 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.894443 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.894678 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.894909 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.895166 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.895400 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.895630 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.895863 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.896095 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.896360 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.896593 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.896861 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.897104 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.897336 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.897569 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.897801 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.898067 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.898302 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.898537 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.898780 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.899016 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.899264 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.899499 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.899732 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.899966 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.900199 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.900431 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.900688 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.900929 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.901175 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.901411 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.901647 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.901894 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.902155 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.902391 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.902625 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.902854 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.903084 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.903315 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.903549 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.903777 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.904016 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.904249 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.904495 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.904729 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.904981 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.905237 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.905475 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.905702 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] auth.external = None {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.905930 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.906243 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.906473 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.906701 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] auth.password = None {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.906929 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] auth.token = None {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.907164 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.907396 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.907641 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.907870 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.908114 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.908357 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.908584 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.908816 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] credential.caching = True {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.909059 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.909305 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.909549 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.909788 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.910052 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.910284 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.910528 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.910778 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.911013 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.911262 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.911544 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.911789 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.912049 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.912289 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.912566 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.912799 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] federation.caching = True {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.913032 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.913276 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.913520 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.913747 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.914014 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.914250 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.914501 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.914734 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.914986 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.915220 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.915466 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.915698 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] identity.caching = True {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.915945 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.916190 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.916424 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.916655 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.916900 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.917128 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.917361 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.917608 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.917856 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.918112 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.918349 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.918572 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.918815 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.919059 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.919301 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.919553 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.919797 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.920068 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.920304 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.920542 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.920771 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.921007 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.921238 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.921476 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.921706 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.921982 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.922219 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.922449 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.922695 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.922942 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.923174 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.923417 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.923660 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.923998 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.924240 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.924469 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.924703 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.924937 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.925176 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.925409 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.925775 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.926050 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.926304 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.926536 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.926765 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.927013 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.927261 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.927495 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.927731 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.927985 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.928707 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] ldap.user = None {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.928948 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.929206 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.929439 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.929686 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.929931 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.930261 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.930497 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.930725 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.930958 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.931190 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.931424 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.931652 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.931897 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.932141 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.932389 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.932634 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.932878 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.933105 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.933350 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.933586 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.933821 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.934080 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.934313 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.934556 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.934803 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.935037 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.935288 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.935515 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.935759 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.935992 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.936226 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.936460 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.936705 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.936945 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.937176 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.937413 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.937652 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] resource.caching = True {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.937901 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.938172 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.938407 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.938656 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.938904 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.939139 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.939383 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.939617 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.939854 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.940088 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] role.caching = True {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.940334 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] role.driver = sql {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.940563 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.940810 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.941057 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.941302 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.941549 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.941793 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.942059 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.942309 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.942554 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.942787 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.943034 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.943279 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.943521 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.943829 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.944247 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.944480 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.944727 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.944976 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.945224 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.945471 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.945702 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.945973 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.946227 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.946463 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.946693 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.946920 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.947150 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.947396 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.947647 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.947890 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.948123 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.948356 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.948583 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.948816 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] token.caching = True {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.949048 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.949292 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.949526 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.949779 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.950053 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.950289 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.950530 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.950770 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.951014 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.951246 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.951481 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.951712 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.951954 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.952228 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.952459 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.952699 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.952962 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.953219 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] database.connection = **** {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.953457 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.953700 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.953933 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.954190 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.954423 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.954656 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.954888 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.955121 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.955361 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.955593 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.955833 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.956066 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.956311 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.956542 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.956782 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.957008 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.957244 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.957474 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:43.957640 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 13 10:56:43.987795 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:43.988020 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:43.988244 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:43.996532 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:44.024563 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:44.024871 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:44.078074 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:44.123317 dv-cinder-861001-1-smb devstack@keystone.service[81550]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 13 10:56:44.123317 dv-cinder-861001-1-smb devstack@keystone.service[81550]: from cryptography.utils import int_from_bytes Oct 13 10:56:44.123873 dv-cinder-861001-1-smb devstack@keystone.service[81550]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 13 10:56:44.123873 dv-cinder-861001-1-smb devstack@keystone.service[81550]: from cryptography.utils import int_from_bytes Oct 13 10:56:44.126390 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:44.126626 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:44.172194 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 13 10:56:44.172375 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 13 10:56:44.172571 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] command line args: [] {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 13 10:56:44.172841 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 13 10:56:44.173017 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ================================================================================ {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 13 10:56:44.173271 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] admin_token = **** {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:44.173516 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] config_dir = [] {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:44.173700 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:44.173878 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] config_source = [] {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:44.174078 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] debug = True {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:44.174284 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:44.174524 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:44.174691 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:44.174950 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:44.175196 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:44.175424 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] list_limit = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:44.175601 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] log_config_append = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:44.175775 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:44.175948 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] log_dir = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:44.176121 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] log_file = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:44.176353 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:44.176598 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:44.176840 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:44.177085 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:44.177260 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:44.177434 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:44.177674 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:44.177916 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:44.178342 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:44.178576 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:44.178808 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:44.179039 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:44.179286 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:44.179530 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:44.179808 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:44.180321 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.25/identity {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:44.180501 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] publish_errors = False {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:44.180730 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:44.180958 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:44.181134 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:44.181377 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:44.181610 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:44.181844 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] standard_threads = False {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:44.182102 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:44.182347 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:44.182522 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:44.182696 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] use_journal = False {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:44.182870 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] use_json = False {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:44.183042 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] use_stderr = False {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:44.183216 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] use_syslog = False {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:44.183445 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:44.183701 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.183939 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.184198 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.184436 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.184687 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.184924 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.185169 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.185404 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.185647 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.185892 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.186169 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.186404 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.186651 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.186885 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.187132 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.187379 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.187613 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.187865 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.188116 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.188361 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.188594 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.188846 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.189109 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.189359 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.189606 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.189836 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.190093 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.190322 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.190555 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.190803 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.191048 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.191276 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.191502 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.191748 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.191991 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.192226 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.192471 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.192701 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.192934 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.193180 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.193407 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.193637 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.194426 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.194655 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.194892 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.195146 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.195374 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.195608 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.195837 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.196073 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.196305 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.196552 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.196780 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.197013 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.197245 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.197478 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.197709 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.197969 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.198200 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.198449 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.198682 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.198919 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.199147 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.199408 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.199639 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.199867 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.200100 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.200334 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.200608 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.200855 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.201106 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.201358 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.201606 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.201843 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.202118 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.202368 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.202606 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.202842 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.203086 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.203322 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.203569 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.203806 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.204039 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.204274 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.204508 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.204740 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.205013 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.205254 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.205500 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.205740 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.206002 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.206245 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.206481 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.206715 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.206948 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.207175 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.207405 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.207633 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.207866 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.208094 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.208335 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.208567 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.208814 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.209050 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.209997 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.210271 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.210512 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.210744 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] auth.external = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.210973 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.211270 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.211503 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.211732 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] auth.password = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.211961 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] auth.token = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.212197 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.212431 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.212676 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.212904 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.213163 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.213411 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.213642 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.213876 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] credential.caching = True {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.214146 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.214396 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.214644 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.214898 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.215146 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.215379 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.215624 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.215877 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.216113 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.216365 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.216653 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.216898 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.217158 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.217399 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.217653 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.217887 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] federation.caching = True {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.218145 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.218390 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.218636 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.218866 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.219111 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.219348 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.219601 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.219847 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.220099 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.220336 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.220584 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.220818 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] identity.caching = True {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.221064 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.221309 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.221544 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.221778 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.222046 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.222278 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.222512 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.222761 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.223012 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.223242 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.223470 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.223699 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.223942 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.224187 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.224431 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.224683 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.224983 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.225274 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.225507 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.225741 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.226001 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.226226 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.226455 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.226688 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.226927 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.227163 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.227407 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.227634 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.227879 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.228124 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.228354 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.228597 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.228851 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.229079 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.229314 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.229541 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.229776 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.230037 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.230286 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.230520 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.230753 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.231003 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.231248 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.231477 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.231704 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.232076 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.232325 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.232562 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.232797 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.233031 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.233260 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.user = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.233501 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.233763 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.234019 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.234268 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.234517 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.234763 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.234998 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.235232 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.235467 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.235699 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.236189 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.236418 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.236666 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.236911 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.237155 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.237398 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.237642 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.237870 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.238141 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.238378 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.238613 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.238848 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.239081 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.239325 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.239571 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.239806 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.240057 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.240286 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.240564 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.240801 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.241035 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.241269 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.241514 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.241754 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.242004 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.242242 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.242481 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] resource.caching = True {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.242730 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.242980 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.243214 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.243461 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.243708 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.243940 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.244185 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.244419 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.244656 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.244895 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] role.caching = True {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.245141 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] role.driver = sql {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.245370 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.245617 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.245878 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.246150 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.246398 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.246642 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.246887 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.247132 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.247377 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.247610 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.247855 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.248102 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.248347 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.248591 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.249024 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.249259 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.249505 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.249753 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.250021 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.250273 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.250506 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.250761 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.251009 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.251246 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.251476 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.251704 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.251934 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.252182 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.252435 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.252679 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.252915 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.253149 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.253378 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.253611 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] token.caching = True {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.253845 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.254114 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.254351 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.254612 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.254858 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.255092 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.255332 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.255572 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.255817 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.256050 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.256824 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.257057 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.257301 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.257581 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.257809 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.258075 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.258341 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.258607 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] database.connection = **** {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.258850 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.259097 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.259329 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.259578 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.259814 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.260049 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.260284 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.260518 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.260762 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.260996 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.261239 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.261473 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.261719 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.261981 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.262219 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.262448 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.262686 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.262919 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:44.263086 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 13 10:56:44.276761 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:44.276992 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:44.277212 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:44.277428 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:44.277643 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:44.277855 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:44.289470 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:44.289700 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:44.289924 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:44.298138 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:44.300926 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:44.301160 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:44.301387 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:44.301610 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:44.301827 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:44.302070 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:44.302283 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:44.313815 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:44.316303 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:44.316534 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:44.326691 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:44.326922 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:44.327154 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:44.327375 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:44.327593 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:44.327914 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:44.328179 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:44.344833 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.345039 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 13 10:56:44.345379 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.345578 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 13 10:56:44.345851 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.346170 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.346428 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.346685 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.353661 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:44.357120 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.357397 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.357669 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.357960 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.365165 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81551) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 10:56:44.368255 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81551) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 10:56:44.368542 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.368825 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.369107 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.369390 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.369651 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.369923 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.370217 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.370485 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.370755 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.371022 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.388396 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:44.388635 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:44.394096 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.395564 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81551) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 10:56:44.395847 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.400566 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81551) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 10:56:44.400851 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.401133 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.407483 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81551) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 10:56:44.407769 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.413862 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81551) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 10:56:44.414185 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.414475 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.414763 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.415042 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.415321 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.415594 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.415866 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.429129 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:44.429353 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:44.429573 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:44.429790 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:44.430032 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:44.430246 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:44.431406 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.431684 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.435537 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81551) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 10:56:44.438779 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.439075 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.443281 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81551) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 10:56:44.444169 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:44.444397 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:44.444619 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:44.444837 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:44.445057 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:44.445277 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:44.445488 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:44.446434 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81551) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 10:56:44.449713 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.450048 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.450337 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.450624 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.450902 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.451193 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.467702 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81551) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 10:56:44.468014 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.468286 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.468550 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.475720 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.477298 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.478871 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.479156 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.481933 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81551) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 10:56:44.482247 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.482605 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.482889 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.483301 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.495456 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81551) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 10:56:44.495759 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.496041 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.496318 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.496708 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.496998 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.497277 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.512940 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81551) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 10:56:44.515930 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81551) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 10:56:44.518931 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.520432 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.522446 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81551) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 10:56:44.522733 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.523148 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.529541 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.531159 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81551) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 10:56:44.534071 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.534473 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.534759 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.535037 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.540453 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:44.542875 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81551) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 10:56:44.543168 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.543450 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.543637 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:44.543864 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:44.544080 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:44.544293 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:44.544502 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:44.544710 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:44.544917 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:44.550318 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81551) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 10:56:44.550603 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.550882 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.551159 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.551431 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.551703 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.551991 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.552268 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.552537 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.552813 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.553606 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.553870 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.554166 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.554454 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.555400 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.555607 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 13 10:56:44.555940 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.556139 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 13 10:56:44.556411 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.556671 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.556932 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.557188 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.566829 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.567109 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.567387 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.567670 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.574696 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 10:56:44.577592 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 10:56:44.577873 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.578175 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.578497 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.578730 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.578994 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.579261 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.579539 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.579802 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.580068 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.580340 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.588944 dv-cinder-861001-1-smb devstack@keystone.service[81551]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55bc7dc369c0 pid: 81551 (default app) Oct 13 10:56:44.592229 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b44b7-e91e-4432-b8fb-c3dc2c15d34e None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:56:44.592516 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b44b7-e91e-4432-b8fb-c3dc2c15d34e None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:56:44.592786 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b44b7-e91e-4432-b8fb-c3dc2c15d34e None None] PATH_INFO: `/v3` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:56:44.596908 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1/1] 10.222.0.25 () {50 vars in 791 bytes} [Thu Oct 13 10:56:44 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:56:44.603376 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.604847 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 10:56:44.605138 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.609662 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 10:56:44.609976 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.610245 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.617489 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 10:56:44.617770 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.621716 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 10:56:44.622025 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.622306 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.622604 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.622876 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.623261 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.623531 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.623819 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.639676 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.639951 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.643739 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 10:56:44.646868 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.647160 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.651431 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 10:56:44.654526 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 10:56:44.657591 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.657885 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.658191 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.658589 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.658876 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.659169 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.676289 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 10:56:44.676580 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.677304 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.677304 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.684986 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.686104 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.687638 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.687886 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.690546 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 10:56:44.690838 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.691114 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.691398 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.691675 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.704981 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 10:56:44.705321 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.705581 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.706817 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.706817 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.706817 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.707033 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.724571 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 10:56:44.727814 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 10:56:44.730671 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.732088 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.733546 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 10:56:44.733827 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.734134 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.741726 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.743779 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 10:56:44.746689 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.749141 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.749141 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.749141 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.755357 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 10:56:44.755650 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.755930 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.763293 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 10:56:44.763576 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.763854 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.764126 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.764395 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.764680 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.764953 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.765218 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.765483 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.765763 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.766052 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.766320 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.766592 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.766857 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:44.800131 dv-cinder-861001-1-smb devstack@keystone.service[81550]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55bc7dc369c0 pid: 81550 (default app) Oct 13 10:56:51.293927 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3221f8-20ff-48e3-b34e-abb253816140 None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:56:51.294467 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3221f8-20ff-48e3-b34e-abb253816140 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:56:51.294572 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3221f8-20ff-48e3-b34e-abb253816140 None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:56:51.295800 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 2/2] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:56:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 10:56:51.303922 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae594f-c34d-41df-afe5-7a2d8390c5aa None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:56:51.304377 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae594f-c34d-41df-afe5-7a2d8390c5aa None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:56:51.304470 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae594f-c34d-41df-afe5-7a2d8390c5aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:56:51.375461 dv-cinder-861001-1-smb devstack@keystone.service[81550]: INFO dbcounter [None req-30ae594f-c34d-41df-afe5-7a2d8390c5aa None None] Registered counter for database keystone Oct 13 10:56:51.395223 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG oslo_db.sqlalchemy.engines [None req-30ae594f-c34d-41df-afe5-7a2d8390c5aa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81550) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 13 10:56:51.401246 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writer thread running {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 13 10:56:51.577745 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG passlib.handlers.bcrypt [None req-30ae594f-c34d-41df-afe5-7a2d8390c5aa None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81550) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 13 10:56:51.578281 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG passlib.handlers.bcrypt [None req-30ae594f-c34d-41df-afe5-7a2d8390c5aa None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81550) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 13 10:56:51.637700 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-30ae594f-c34d-41df-afe5-7a2d8390c5aa None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:56:51.639327 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-30ae594f-c34d-41df-afe5-7a2d8390c5aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:56:51.765287 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1/3] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:56:51 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 465 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 13 10:56:52.247800 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3221f8-20ff-48e3-b34e-abb253816140 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:56:52.316955 dv-cinder-861001-1-smb devstack@keystone.service[81551]: INFO dbcounter [None req-bc3221f8-20ff-48e3-b34e-abb253816140 None None] Registered counter for database keystone Oct 13 10:56:52.338950 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG oslo_db.sqlalchemy.engines [None req-bc3221f8-20ff-48e3-b34e-abb253816140 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 13 10:56:52.345162 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writer thread running {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 13 10:56:52.462453 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3221f8-20ff-48e3-b34e-abb253816140 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:56:52.466691 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e13282-1559-4026-8da2-d2e96caa2c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:56:52.467301 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e13282-1559-4026-8da2-d2e96caa2c7b admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:56:52.467579 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e13282-1559-4026-8da2-d2e96caa2c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:56:52.467849 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e13282-1559-4026-8da2-d2e96caa2c7b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:56:52.475894 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e13282-1559-4026-8da2-d2e96caa2c7b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:56:52.527786 dv-cinder-861001-1-smb devstack@keystone.service[81551]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c9e13282-1559-4026-8da2-d2e96caa2c7b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 13 10:56:52.528073 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e13282-1559-4026-8da2-d2e96caa2c7b admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:56:52.537387 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 3/4] 10.222.0.25 () {58 vars in 1324 bytes} [Thu Oct 13 10:56:52 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 13 10:56:52.543355 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ae594f-c34d-41df-afe5-7a2d8390c5aa None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:56:52.557780 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ae594f-c34d-41df-afe5-7a2d8390c5aa None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:56:52.562136 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd597b48-22c3-4f81-a63c-3dd3c7a3d369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:56:52.563271 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd597b48-22c3-4f81-a63c-3dd3c7a3d369 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:56:52.563553 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd597b48-22c3-4f81-a63c-3dd3c7a3d369 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:56:52.563824 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd597b48-22c3-4f81-a63c-3dd3c7a3d369 admin admin] PATH_INFO: `/v3/projects/cbde15a03afe4c128d89633ab934d9a0` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:56:52.565268 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd597b48-22c3-4f81-a63c-3dd3c7a3d369 admin admin] RBAC: Authorizing `identity:get_project(project_id=cbde15a03afe4c128d89633ab934d9a0)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:56:52.617855 dv-cinder-861001-1-smb devstack@keystone.service[81550]: WARNING keystone.common.rbac_enforcer.enforcer [None req-cd597b48-22c3-4f81-a63c-3dd3c7a3d369 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 13 10:56:52.618216 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd597b48-22c3-4f81-a63c-3dd3c7a3d369 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:56:52.622670 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 2/5] 10.222.0.25 () {56 vars in 1207 bytes} [Thu Oct 13 10:56:52 2022] GET /identity/v3/projects/cbde15a03afe4c128d89633ab934d9a0 => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:56:54.710191 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969c2ce-4afe-4ff4-b29c-c5312766f42c None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:56:54.710774 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969c2ce-4afe-4ff4-b29c-c5312766f42c None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:56:54.710774 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969c2ce-4afe-4ff4-b29c-c5312766f42c None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:56:54.714839 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 4/6] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:56:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 10:56:54.720308 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b50ac-36d4-4bf2-946e-61913b96b75d None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:56:54.720722 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b50ac-36d4-4bf2-946e-61913b96b75d None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:56:54.720857 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b50ac-36d4-4bf2-946e-61913b96b75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:56:54.741831 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-9f0b50ac-36d4-4bf2-946e-61913b96b75d None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:56:54.743380 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-9f0b50ac-36d4-4bf2-946e-61913b96b75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:56:54.751080 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 3/7] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:56:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 13 10:56:55.016882 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c969c2ce-4afe-4ff4-b29c-c5312766f42c None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:56:55.029417 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c969c2ce-4afe-4ff4-b29c-c5312766f42c None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:56:55.033553 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c21248-f3ef-4c34-a58e-20636566af23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:56:55.034438 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c21248-f3ef-4c34-a58e-20636566af23 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:56:55.034722 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c21248-f3ef-4c34-a58e-20636566af23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:56:55.034998 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c21248-f3ef-4c34-a58e-20636566af23 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:56:55.043417 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c21248-f3ef-4c34-a58e-20636566af23 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:56:55.045175 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c21248-f3ef-4c34-a58e-20636566af23 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:56:55.053837 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 5/8] 10.222.0.25 () {58 vars in 1324 bytes} [Thu Oct 13 10:56:55 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 13 10:56:55.058979 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b50ac-36d4-4bf2-946e-61913b96b75d None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:56:55.067928 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b50ac-36d4-4bf2-946e-61913b96b75d None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:56:55.072250 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5abf1c0-9a44-4475-9630-178c7c9ada0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:56:55.072871 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5abf1c0-9a44-4475-9630-178c7c9ada0b admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:56:55.073152 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5abf1c0-9a44-4475-9630-178c7c9ada0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:56:55.073428 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5abf1c0-9a44-4475-9630-178c7c9ada0b admin admin] PATH_INFO: `/v3/users/f4dbe08e33ae4779a5bb51d82d216642` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:56:55.074753 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5abf1c0-9a44-4475-9630-178c7c9ada0b admin admin] RBAC: Authorizing `identity:get_user(user_id=f4dbe08e33ae4779a5bb51d82d216642)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:56:55.076558 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5abf1c0-9a44-4475-9630-178c7c9ada0b admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:56:55.078098 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 4/9] 10.222.0.25 () {56 vars in 1198 bytes} [Thu Oct 13 10:56:55 2022] GET /identity/v3/users/f4dbe08e33ae4779a5bb51d82d216642 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:56:57.239568 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07fec7f-b8a7-471e-a442-11e7299d766a None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:56:57.240124 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07fec7f-b8a7-471e-a442-11e7299d766a None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:56:57.240124 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07fec7f-b8a7-471e-a442-11e7299d766a None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:56:57.241995 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 6/10] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:56:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:56:57.247009 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c1dd7-9789-4049-9aed-2b4ffe13c7fd None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:56:57.247426 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c1dd7-9789-4049-9aed-2b4ffe13c7fd None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:56:57.247569 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c1dd7-9789-4049-9aed-2b4ffe13c7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:56:57.265800 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-2a9c1dd7-9789-4049-9aed-2b4ffe13c7fd None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:56:57.267017 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-2a9c1dd7-9789-4049-9aed-2b4ffe13c7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:56:57.287072 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5341dd0b-c656-4a92-b49e-d507cdbfe5ad None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:56:57.287358 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5341dd0b-c656-4a92-b49e-d507cdbfe5ad None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:56:57.287668 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5341dd0b-c656-4a92-b49e-d507cdbfe5ad None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:56:57.288967 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 7/11] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:56:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 10:56:57.293933 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a23928-acb8-41a2-8775-00aa6384a151 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:56:57.294246 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a23928-acb8-41a2-8775-00aa6384a151 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:56:57.294525 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a23928-acb8-41a2-8775-00aa6384a151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:56:57.336474 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG passlib.handlers.bcrypt [None req-b9a23928-acb8-41a2-8775-00aa6384a151 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81551) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 13 10:56:57.336856 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG passlib.handlers.bcrypt [None req-b9a23928-acb8-41a2-8775-00aa6384a151 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81551) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 13 10:56:57.344344 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 5/12] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:56:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:56:57.385876 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-b9a23928-acb8-41a2-8775-00aa6384a151 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:56:57.387503 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-b9a23928-acb8-41a2-8775-00aa6384a151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:56:57.484626 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 8/13] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:56:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 13 10:56:57.610460 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9c1dd7-9789-4049-9aed-2b4ffe13c7fd None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:56:57.633804 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:56:57.710549 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9c1dd7-9789-4049-9aed-2b4ffe13c7fd None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:56:57.742390 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb4318-4c5d-4ddd-93fc-a021b61ff4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:56:57.743021 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb4318-4c5d-4ddd-93fc-a021b61ff4e3 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:56:57.743301 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb4318-4c5d-4ddd-93fc-a021b61ff4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:56:57.743575 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb4318-4c5d-4ddd-93fc-a021b61ff4e3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:56:57.747826 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a23928-acb8-41a2-8775-00aa6384a151 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:56:57.755743 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efb4318-4c5d-4ddd-93fc-a021b61ff4e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:56:57.765079 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-4efb4318-4c5d-4ddd-93fc-a021b61ff4e3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 10:56:57.765079 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:56:57.765079 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:56:57.765079 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:56:57.765079 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:56:57.765079 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:56:57.765079 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:56:57.765079 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:56:57.765079 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:56:57.765079 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:56:57.765079 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:56:57.765079 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:56:57.765079 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:56:57.765079 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:56:57.765079 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:56:57.765079 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:56:57.766103 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:56:57.766103 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:56:57.766103 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:56:57.766103 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:56:57.766103 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:56:57.766103 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:56:57.766103 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:56:57.766103 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:56:57.766103 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:56:57.766103 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:56:57.766103 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:56:57.766103 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 10:56:57.766103 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:56:57.766103 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:56:57.766103 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:56:57.766103 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:56:57.766921 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:56:57.766921 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:56:57.766921 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:56:57.766921 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:56:57.766921 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:56:57.766921 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:56:57.766921 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:56:57.766921 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:56:57.766921 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:56:57.766921 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:56:57.766921 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 10:56:57.766921 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:56:57.766921 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 6/14] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Oct 13 10:56:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:56:57.773935 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb4318-4c5d-4ddd-93fc-a021b61ff4e3 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:56:57.845589 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a23928-acb8-41a2-8775-00aa6384a151 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:56:57.847841 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:56:57.853492 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:56:57.872706 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb4318-4c5d-4ddd-93fc-a021b61ff4e3 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:56:57.883720 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67dd8b-a084-444a-9a34-e2b9ae05dd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:56:57.884337 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67dd8b-a084-444a-9a34-e2b9ae05dd85 None admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:56:57.884631 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67dd8b-a084-444a-9a34-e2b9ae05dd85 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:56:57.884880 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67dd8b-a084-444a-9a34-e2b9ae05dd85 None admin] PATH_INFO: `/v3/domains` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:56:57.885849 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf67dd8b-a084-444a-9a34-e2b9ae05dd85 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:56:57.887318 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf67dd8b-a084-444a-9a34-e2b9ae05dd85 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:56:57.898823 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.sql.core [None req-cf67dd8b-a084-444a-9a34-e2b9ae05dd85 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 13 10:56:57.898823 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 13 10:56:57.898823 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [parameters: {'id': 'bb2ae95e0f9647bd96319245ece686a9', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 13 10:56:57.898823 dv-cinder-861001-1-smb devstack@keystone.service[81551]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81551) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 13 10:56:57.909259 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d076e4-34fb-47d8-a1aa-76176eca32cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:56:57.909864 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d076e4-34fb-47d8-a1aa-76176eca32cc None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:56:57.910173 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d076e4-34fb-47d8-a1aa-76176eca32cc None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:56:57.910450 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d076e4-34fb-47d8-a1aa-76176eca32cc None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:56:57.911116 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d076e4-34fb-47d8-a1aa-76176eca32cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:56:57.911421 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d076e4-34fb-47d8-a1aa-76176eca32cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:56:57.912798 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d076e4-34fb-47d8-a1aa-76176eca32cc None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:56:57.917019 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-cf67dd8b-a084-444a-9a34-e2b9ae05dd85 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 13 10:56:57.917019 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:56:57.917019 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 13 10:56:57.917019 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 13 10:56:57.917019 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 13 10:56:57.917019 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 13 10:56:57.917019 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 13 10:56:57.917019 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application result = self._query(query) Oct 13 10:56:57.917019 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 13 10:56:57.917019 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application conn.query(q) Oct 13 10:56:57.917019 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 13 10:56:57.917019 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 13 10:56:57.917019 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 13 10:56:57.917019 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application result.read() Oct 13 10:56:57.917835 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 13 10:56:57.917835 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 13 10:56:57.917835 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 13 10:56:57.917835 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 13 10:56:57.917835 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 13 10:56:57.917835 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 13 10:56:57.917835 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 13 10:56:57.917835 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 13 10:56:57.917835 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 13 10:56:57.917835 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:56:57.917835 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 13 10:56:57.917835 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:56:57.917835 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:56:57.917835 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 13 10:56:57.917835 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 13 10:56:57.917835 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 13 10:56:57.917835 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 13 10:56:57.917835 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 13 10:56:57.918781 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application next(self.gen) Oct 13 10:56:57.918781 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 13 10:56:57.918781 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application yield resource Oct 13 10:56:57.918781 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 13 10:56:57.918781 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application next(self.gen) Oct 13 10:56:57.918781 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 13 10:56:57.918781 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application self.session.rollback() Oct 13 10:56:57.918781 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 13 10:56:57.918781 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application self.force_reraise() Oct 13 10:56:57.918781 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 13 10:56:57.918781 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise self.value Oct 13 10:56:57.918781 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 13 10:56:57.918781 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 13 10:56:57.918781 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 13 10:56:57.918781 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application session.commit() Oct 13 10:56:57.918781 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 13 10:56:57.918781 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 13 10:56:57.919605 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 13 10:56:57.919605 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application self._prepare_impl() Oct 13 10:56:57.919605 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 13 10:56:57.919605 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application self.session.flush() Oct 13 10:56:57.919605 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 13 10:56:57.919605 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application self._flush(objects) Oct 13 10:56:57.919605 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 13 10:56:57.919605 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 13 10:56:57.919605 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 13 10:56:57.919605 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application compat.raise_( Oct 13 10:56:57.919605 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 13 10:56:57.919605 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception Oct 13 10:56:57.919605 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 13 10:56:57.919605 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application flush_context.execute() Oct 13 10:56:57.919605 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 13 10:56:57.919605 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rec.execute(self) Oct 13 10:56:57.919605 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 13 10:56:57.920482 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 13 10:56:57.920482 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 13 10:56:57.920482 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 13 10:56:57.920482 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 13 10:56:57.920482 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 13 10:56:57.920482 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 13 10:56:57.920482 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 13 10:56:57.920482 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 13 10:56:57.920482 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 13 10:56:57.920482 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 13 10:56:57.920482 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 13 10:56:57.920482 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 13 10:56:57.920482 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 13 10:56:57.920482 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 13 10:56:57.920482 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 13 10:56:57.921246 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 13 10:56:57.921246 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception Oct 13 10:56:57.921246 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 13 10:56:57.921246 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 13 10:56:57.921246 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 13 10:56:57.921246 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 13 10:56:57.921246 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 13 10:56:57.921246 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application result = self._query(query) Oct 13 10:56:57.921246 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 13 10:56:57.921246 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application conn.query(q) Oct 13 10:56:57.921246 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 13 10:56:57.921246 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 13 10:56:57.921246 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 13 10:56:57.921246 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application result.read() Oct 13 10:56:57.921246 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 13 10:56:57.921246 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 13 10:56:57.921246 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 13 10:56:57.922065 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 13 10:56:57.922065 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 13 10:56:57.922065 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 13 10:56:57.922065 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 13 10:56:57.922065 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 13 10:56:57.922065 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 13 10:56:57.922065 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 13 10:56:57.922065 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [parameters: {'id': 'bb2ae95e0f9647bd96319245ece686a9', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 13 10:56:57.922065 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 13 10:56:57.922065 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:56:57.922065 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 10:56:57.922065 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:56:57.922065 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:56:57.922065 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 13 10:56:57.922065 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 13 10:56:57.924490 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 13 10:56:57.924490 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 13 10:56:57.924490 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 13 10:56:57.924490 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:56:57.924490 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 10:56:57.924490 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:56:57.924490 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:56:57.924490 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:56:57.924490 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:56:57.924490 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:56:57.924490 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:56:57.924490 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:56:57.924490 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:56:57.924490 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:56:57.924490 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:56:57.924490 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:56:57.924490 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:56:57.925489 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 13 10:56:57.925489 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 13 10:56:57.925489 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:56:57.925489 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:56:57.925489 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 13 10:56:57.925489 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 13 10:56:57.925489 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:56:57.925489 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:56:57.925489 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 13 10:56:57.925489 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 13 10:56:57.925489 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 13 10:56:57.925489 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:56:57.925489 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 9/15] 10.222.0.25 () {60 vars in 1137 bytes} [Thu Oct 13 10:56:57 2022] POST /identity/v3/domains => generated 190 bytes in 171 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:56:57.925489 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67dd8b-a084-444a-9a34-e2b9ae05dd85 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:56:57.929767 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 7/16] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 10:56:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:56:57.930657 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d076e4-34fb-47d8-a1aa-76176eca32cc None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:56:58.022122 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67dd8b-a084-444a-9a34-e2b9ae05dd85 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:56:58.026999 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d076e4-34fb-47d8-a1aa-76176eca32cc None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:56:58.056188 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6836fbcf-f104-45b1-b0b0-461b3af0e721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:56:58.057063 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6836fbcf-f104-45b1-b0b0-461b3af0e721 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:56:58.057346 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6836fbcf-f104-45b1-b0b0-461b3af0e721 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:56:58.057620 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6836fbcf-f104-45b1-b0b0-461b3af0e721 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:56:58.059559 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f4472a-3c95-4ea0-8255-f44e646290d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:56:58.060178 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f4472a-3c95-4ea0-8255-f44e646290d0 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:56:58.060454 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f4472a-3c95-4ea0-8255-f44e646290d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:56:58.060728 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f4472a-3c95-4ea0-8255-f44e646290d0 None admin] PATH_INFO: `/v3/users/f4dbe08e33ae4779a5bb51d82d216642` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:56:58.061859 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f4472a-3c95-4ea0-8255-f44e646290d0 None admin] RBAC: Authorizing `identity:get_user(user_id=f4dbe08e33ae4779a5bb51d82d216642)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:56:58.063340 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f4472a-3c95-4ea0-8255-f44e646290d0 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:56:58.064916 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 8/17] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Oct 13 10:56:57 2022] GET /identity/v3/users/f4dbe08e33ae4779a5bb51d82d216642 => generated 247 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:56:58.070486 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f4472a-3c95-4ea0-8255-f44e646290d0 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:56:58.075333 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6836fbcf-f104-45b1-b0b0-461b3af0e721 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:56:58.076804 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6836fbcf-f104-45b1-b0b0-461b3af0e721 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:56:58.085368 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:56:58.093390 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-6836fbcf-f104-45b1-b0b0-461b3af0e721 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:56:58.093390 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:56:58.093390 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:56:58.093390 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:56:58.093390 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:56:58.093390 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:56:58.093390 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:56:58.093390 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:56:58.093390 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:56:58.093390 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:56:58.093390 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:56:58.093390 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:56:58.093390 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:56:58.093390 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:56:58.093390 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:56:58.093390 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:56:58.094462 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:56:58.094462 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:56:58.094462 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:56:58.094462 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:56:58.094462 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:56:58.094462 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:56:58.094462 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:56:58.094462 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:56:58.094462 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:56:58.094462 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:56:58.094462 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:56:58.094462 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:56:58.094462 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:56:58.094462 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:56:58.094462 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:56:58.094462 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:56:58.094462 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:56:58.095616 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:56:58.095616 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:56:58.095616 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:56:58.095616 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 10/18] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 10:56:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 10:56:58.100666 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6836fbcf-f104-45b1-b0b0-461b3af0e721 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:56:58.121823 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:56:58.171261 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f4472a-3c95-4ea0-8255-f44e646290d0 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:56:58.200018 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6836fbcf-f104-45b1-b0b0-461b3af0e721 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:56:58.203309 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07bd570-a35d-4b9b-8384-e6f44c782bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:56:58.203936 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07bd570-a35d-4b9b-8384-e6f44c782bbe None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:56:58.204213 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07bd570-a35d-4b9b-8384-e6f44c782bbe None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:56:58.204485 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07bd570-a35d-4b9b-8384-e6f44c782bbe None admin] PATH_INFO: `/v3/domains/default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:56:58.205586 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07bd570-a35d-4b9b-8384-e6f44c782bbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:56:58.207068 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07bd570-a35d-4b9b-8384-e6f44c782bbe None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:56:58.208598 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 9/19] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 10:56:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:56:58.214784 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07bd570-a35d-4b9b-8384-e6f44c782bbe None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:56:58.233426 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c17cd14-24f7-4c43-b234-27ad027ea29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:56:58.234065 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17cd14-24f7-4c43-b234-27ad027ea29b None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:56:58.234348 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17cd14-24f7-4c43-b234-27ad027ea29b None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:56:58.234622 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17cd14-24f7-4c43-b234-27ad027ea29b None admin] PATH_INFO: `/v3/domains` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:56:58.235270 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c17cd14-24f7-4c43-b234-27ad027ea29b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:56:58.235574 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c17cd14-24f7-4c43-b234-27ad027ea29b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:56:58.237236 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c17cd14-24f7-4c43-b234-27ad027ea29b None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:56:58.254444 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 11/20] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 10:56:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:56:58.296355 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:56:58.316133 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07bd570-a35d-4b9b-8384-e6f44c782bbe None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:56:58.352603 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d7eb92-3f6d-462c-a091-e873725c6b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:56:58.353282 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d7eb92-3f6d-462c-a091-e873725c6b42 None admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:56:58.353566 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d7eb92-3f6d-462c-a091-e873725c6b42 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:56:58.353848 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d7eb92-3f6d-462c-a091-e873725c6b42 None admin] PATH_INFO: `/v3/domains/default/users/f4dbe08e33ae4779a5bb51d82d216642/roles/ea564961b1db4eb4a1d4d880964611b2` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:56:58.355889 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d7eb92-3f6d-462c-a091-e873725c6b42 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=f4dbe08e33ae4779a5bb51d82d216642, role_id=ea564961b1db4eb4a1d4d880964611b2)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:56:58.357361 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d7eb92-3f6d-462c-a091-e873725c6b42 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:56:58.473350 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 10/21] 10.222.0.25 () {58 vars in 1361 bytes} [Thu Oct 13 10:56:58 2022] PUT /identity/v3/domains/default/users/f4dbe08e33ae4779a5bb51d82d216642/roles/ea564961b1db4eb4a1d4d880964611b2 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 10:57:00.834488 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e177c8-255d-4c89-af3b-639a3049eba7 None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:00.835014 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e177c8-255d-4c89-af3b-639a3049eba7 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:00.835014 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e177c8-255d-4c89-af3b-639a3049eba7 None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:00.836756 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 12/22] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:57:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:00.842704 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c896660-8574-4f4c-83c6-45427787eab0 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:00.843217 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c896660-8574-4f4c-83c6-45427787eab0 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:00.843296 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c896660-8574-4f4c-83c6-45427787eab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:00.867816 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-8c896660-8574-4f4c-83c6-45427787eab0 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:00.869397 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-8c896660-8574-4f4c-83c6-45427787eab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:00.972566 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 11/23] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:57:00.995547 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c031151-c244-4339-a575-417bcd87af7b None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:00.995852 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c031151-c244-4339-a575-417bcd87af7b None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:00.996091 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c031151-c244-4339-a575-417bcd87af7b None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:00.997419 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 13/24] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:57:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:01.010072 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8a0b3-fb12-4e95-a7a4-a97af6be1cd6 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:01.010360 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8a0b3-fb12-4e95-a7a4-a97af6be1cd6 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:01.010642 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8a0b3-fb12-4e95-a7a4-a97af6be1cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:01.025416 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6bf817-7011-423a-91a3-970655685114 None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:01.025682 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6bf817-7011-423a-91a3-970655685114 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:01.025972 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6bf817-7011-423a-91a3-970655685114 None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:01.027431 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 14/25] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:57:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:01.032604 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256421f-be1b-49fc-8ef3-dd867957f026 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:01.032885 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256421f-be1b-49fc-8ef3-dd867957f026 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:01.033158 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256421f-be1b-49fc-8ef3-dd867957f026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:01.050788 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-87f8a0b3-fb12-4e95-a7a4-a97af6be1cd6 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:01.051992 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-87f8a0b3-fb12-4e95-a7a4-a97af6be1cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:01.060456 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-2256421f-be1b-49fc-8ef3-dd867957f026 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:01.061615 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-2256421f-be1b-49fc-8ef3-dd867957f026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:01.177089 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 15/26] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 13 10:57:01.197409 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:01.207127 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 12/27] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:57:01.367889 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2256421f-be1b-49fc-8ef3-dd867957f026 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:01.382110 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:01.487460 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2256421f-be1b-49fc-8ef3-dd867957f026 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:01.528972 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e50ec7-6dfd-4355-b1b1-3c855270a17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:01.529969 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e50ec7-6dfd-4355-b1b1-3c855270a17d None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:01.530444 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e50ec7-6dfd-4355-b1b1-3c855270a17d None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:01.530907 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e50ec7-6dfd-4355-b1b1-3c855270a17d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:01.542322 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e50ec7-6dfd-4355-b1b1-3c855270a17d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:01.544028 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e50ec7-6dfd-4355-b1b1-3c855270a17d None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:01.561506 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1c406-8f30-4107-90a3-34c0c73e8fa8 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:01.561805 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1c406-8f30-4107-90a3-34c0c73e8fa8 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:01.562118 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1c406-8f30-4107-90a3-34c0c73e8fa8 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:01.565400 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-d3e50ec7-6dfd-4355-b1b1-3c855270a17d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:57:01.565400 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:01.565400 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:57:01.565400 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:57:01.565400 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:57:01.565400 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:57:01.565400 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:57:01.565400 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:57:01.565400 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:57:01.565400 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:57:01.565400 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:57:01.565400 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:57:01.565400 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:57:01.565400 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:57:01.565400 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:57:01.565400 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:57:01.566255 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:57:01.566255 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:57:01.566255 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:57:01.566255 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:57:01.566255 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:57:01.566255 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:57:01.566255 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:57:01.566255 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:57:01.566255 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:57:01.566255 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:57:01.566255 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:57:01.566255 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:57:01.566255 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:57:01.566255 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:57:01.566255 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:57:01.566255 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:57:01.566255 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:57:01.567381 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:57:01.567381 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:57:01.567381 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:57:01.567533 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 13/28] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:57:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:01.570450 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d1c406-8f30-4107-90a3-34c0c73e8fa8 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:01.572970 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 16/29] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 10:57:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:57:01.574678 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f8993-47ee-4918-a746-13edc2b0c83a None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:01.574967 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f8993-47ee-4918-a746-13edc2b0c83a None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:01.575249 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f8993-47ee-4918-a746-13edc2b0c83a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:01.595599 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-3d3f8993-47ee-4918-a746-13edc2b0c83a None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:01.596805 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-3d3f8993-47ee-4918-a746-13edc2b0c83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:01.700391 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:01.712676 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 17/30] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 13 10:57:01.713898 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3f8993-47ee-4918-a746-13edc2b0c83a None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:01.739657 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d1c406-8f30-4107-90a3-34c0c73e8fa8 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:01.814640 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3cc9ae-e6e9-48b9-bd4b-7599f568b157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:01.815427 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3cc9ae-e6e9-48b9-bd4b-7599f568b157 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:01.815600 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3cc9ae-e6e9-48b9-bd4b-7599f568b157 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:01.815833 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3cc9ae-e6e9-48b9-bd4b-7599f568b157 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:01.831415 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3f8993-47ee-4918-a746-13edc2b0c83a None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:01.831652 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3cc9ae-e6e9-48b9-bd4b-7599f568b157 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:57:01.838378 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-2f3cc9ae-e6e9-48b9-bd4b-7599f568b157 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 10:57:01.838378 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:01.838378 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:57:01.838378 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:57:01.838378 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:57:01.838378 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:57:01.838378 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:57:01.838378 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:57:01.838378 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:57:01.838378 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:57:01.838378 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:57:01.838378 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:57:01.838378 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:57:01.838378 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:57:01.838378 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:57:01.838378 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:57:01.839206 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:57:01.839206 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:57:01.839206 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:57:01.839206 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:57:01.839206 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:57:01.839206 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:57:01.839206 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:57:01.839206 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:57:01.839206 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:57:01.839206 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:57:01.839206 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:57:01.839206 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 10:57:01.839206 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:57:01.839206 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:57:01.839206 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:57:01.839206 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:57:01.839962 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:57:01.839962 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:57:01.839962 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:57:01.839962 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:57:01.839962 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:57:01.839962 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:57:01.839962 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:57:01.839962 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:57:01.839962 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:57:01.839962 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:57:01.839962 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 10:57:01.839962 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:57:01.844152 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 14/31] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Oct 13 10:57:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:57:01.845718 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3cc9ae-e6e9-48b9-bd4b-7599f568b157 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:01.903511 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d7c6d5-f124-4067-933d-3ddd6488750d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:01.904133 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d7c6d5-f124-4067-933d-3ddd6488750d None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:01.904399 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d7c6d5-f124-4067-933d-3ddd6488750d None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:01.904878 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d7c6d5-f124-4067-933d-3ddd6488750d None admin] PATH_INFO: `/v3/domains` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:01.907545 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d7c6d5-f124-4067-933d-3ddd6488750d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:01.907854 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d7c6d5-f124-4067-933d-3ddd6488750d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:01.909230 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d7c6d5-f124-4067-933d-3ddd6488750d None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:01.933132 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 18/32] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 10:57:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:01.934849 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d7c6d5-f124-4067-933d-3ddd6488750d None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:01.956409 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:02.018071 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3cc9ae-e6e9-48b9-bd4b-7599f568b157 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:02.029135 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:02.059915 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0edb5a-898b-4af1-99d0-2fca60c75e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:02.060925 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0edb5a-898b-4af1-99d0-2fca60c75e2f None admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:02.061403 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0edb5a-898b-4af1-99d0-2fca60c75e2f None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:02.061906 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0edb5a-898b-4af1-99d0-2fca60c75e2f None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:02.062796 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0edb5a-898b-4af1-99d0-2fca60c75e2f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:02.064541 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0edb5a-898b-4af1-99d0-2fca60c75e2f None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:02.087101 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 15/33] 10.222.0.25 () {60 vars in 1131 bytes} [Thu Oct 13 10:57:01 2022] POST /identity/v3/roles => generated 219 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 10:57:02.087722 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d7c6d5-f124-4067-933d-3ddd6488750d None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:02.088540 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0edb5a-898b-4af1-99d0-2fca60c75e2f None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:02.129353 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9661d550-c2db-4ed5-bbce-ab95473d9694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:02.130019 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9661d550-c2db-4ed5-bbce-ab95473d9694 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:02.130313 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9661d550-c2db-4ed5-bbce-ab95473d9694 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:02.130592 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9661d550-c2db-4ed5-bbce-ab95473d9694 None admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:02.132079 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9661d550-c2db-4ed5-bbce-ab95473d9694 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:02.132394 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9661d550-c2db-4ed5-bbce-ab95473d9694 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:02.133852 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9661d550-c2db-4ed5-bbce-ab95473d9694 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:02.148320 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 19/34] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 10:57:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:02.149490 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9661d550-c2db-4ed5-bbce-ab95473d9694 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:02.253487 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0edb5a-898b-4af1-99d0-2fca60c75e2f None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:02.297114 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:02.325229 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ee79fb-7997-4a3a-ad39-ca29fe58068a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:02.325872 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ee79fb-7997-4a3a-ad39-ca29fe58068a None admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:02.326446 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ee79fb-7997-4a3a-ad39-ca29fe58068a None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:02.326738 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ee79fb-7997-4a3a-ad39-ca29fe58068a None admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:02.328118 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ee79fb-7997-4a3a-ad39-ca29fe58068a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:02.330017 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ee79fb-7997-4a3a-ad39-ca29fe58068a None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:02.334514 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9661d550-c2db-4ed5-bbce-ab95473d9694 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:02.353374 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:02.370882 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 16/35] 10.222.0.25 () {60 vars in 1141 bytes} [Thu Oct 13 10:57:02 2022] POST /identity/v3/projects => generated 301 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 10:57:02.372034 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ee79fb-7997-4a3a-ad39-ca29fe58068a None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:02.398930 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2bcfb2-d95a-40de-834b-32ed524a7a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:02.400330 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2bcfb2-d95a-40de-834b-32ed524a7a00 None admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:02.401703 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2bcfb2-d95a-40de-834b-32ed524a7a00 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:02.402351 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2bcfb2-d95a-40de-834b-32ed524a7a00 None admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:02.403712 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2bcfb2-d95a-40de-834b-32ed524a7a00 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:02.407497 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2bcfb2-d95a-40de-834b-32ed524a7a00 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:02.526141 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ee79fb-7997-4a3a-ad39-ca29fe58068a None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:02.552082 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 20/36] 10.222.0.25 () {60 vars in 1131 bytes} [Thu Oct 13 10:57:02 2022] POST /identity/v3/roles => generated 225 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 10:57:02.554555 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6578d7-86e7-48e8-a086-9ccd0a355ad5 None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:02.555011 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6578d7-86e7-48e8-a086-9ccd0a355ad5 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:02.555430 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6578d7-86e7-48e8-a086-9ccd0a355ad5 None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:02.556963 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 21/37] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:57:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:02.564140 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b318d046-bc52-4b6b-9bbe-4550d127ecd9 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:02.564542 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b318d046-bc52-4b6b-9bbe-4550d127ecd9 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:02.567188 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b318d046-bc52-4b6b-9bbe-4550d127ecd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:02.579171 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58cce51-c68a-4ab8-aea9-e0cad209a7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:02.580293 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58cce51-c68a-4ab8-aea9-e0cad209a7fe None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:02.580729 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58cce51-c68a-4ab8-aea9-e0cad209a7fe None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:02.581054 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58cce51-c68a-4ab8-aea9-e0cad209a7fe None admin] PATH_INFO: `/v3/users/f4dbe08e33ae4779a5bb51d82d216642` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:02.582623 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58cce51-c68a-4ab8-aea9-e0cad209a7fe None admin] RBAC: Authorizing `identity:get_user(user_id=f4dbe08e33ae4779a5bb51d82d216642)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:02.585253 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58cce51-c68a-4ab8-aea9-e0cad209a7fe None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:02.586746 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 17/38] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Oct 13 10:57:02 2022] GET /identity/v3/users/f4dbe08e33ae4779a5bb51d82d216642 => generated 247 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:02.599136 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58cce51-c68a-4ab8-aea9-e0cad209a7fe None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:02.607209 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-b318d046-bc52-4b6b-9bbe-4550d127ecd9 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:02.608832 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-b318d046-bc52-4b6b-9bbe-4550d127ecd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:02.655358 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:02.730750 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 22/39] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 13 10:57:02.742594 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58cce51-c68a-4ab8-aea9-e0cad209a7fe None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:02.762356 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515fd48-897f-4944-82af-eed1d172f7f1 None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:02.762655 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515fd48-897f-4944-82af-eed1d172f7f1 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:02.762925 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515fd48-897f-4944-82af-eed1d172f7f1 None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:02.764579 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 23/40] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:57:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:02.770242 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a524f09-bb9d-489f-af31-147115a8893f None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:02.770534 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a524f09-bb9d-489f-af31-147115a8893f None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:02.770841 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a524f09-bb9d-489f-af31-147115a8893f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:02.781883 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb78654-b69a-4d8e-80e5-d2a0f1867529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:02.782563 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb78654-b69a-4d8e-80e5-d2a0f1867529 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:02.782847 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb78654-b69a-4d8e-80e5-d2a0f1867529 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:02.783125 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb78654-b69a-4d8e-80e5-d2a0f1867529 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:02.784265 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb78654-b69a-4d8e-80e5-d2a0f1867529 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:02.785745 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb78654-b69a-4d8e-80e5-d2a0f1867529 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:02.788155 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 18/41] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 10:57:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:02.793982 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb78654-b69a-4d8e-80e5-d2a0f1867529 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:02.811363 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-1a524f09-bb9d-489f-af31-147115a8893f None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:02.812520 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-1a524f09-bb9d-489f-af31-147115a8893f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:02.897358 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 24/42] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:57:02.915076 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb78654-b69a-4d8e-80e5-d2a0f1867529 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:02.924773 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:02.952431 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50f2c6c-50c0-4079-a119-f22a331c0ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:02.953038 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50f2c6c-50c0-4079-a119-f22a331c0ae6 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:02.953318 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50f2c6c-50c0-4079-a119-f22a331c0ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:02.953592 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50f2c6c-50c0-4079-a119-f22a331c0ae6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:02.954344 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50f2c6c-50c0-4079-a119-f22a331c0ae6 None admin] RBAC: Adding query filter params (role.id=ea564961b1db4eb4a1d4d880964611b2, scope.domain.id=default, user.id=f4dbe08e33ae4779a5bb51d82d216642) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:02.954653 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50f2c6c-50c0-4079-a119-f22a331c0ae6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:02.956078 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50f2c6c-50c0-4079-a119-f22a331c0ae6 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:02.963864 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 19/43] 10.222.0.25 () {56 vars in 1322 bytes} [Thu Oct 13 10:57:02 2022] GET /identity/v3/role_assignments?user.id=f4dbe08e33ae4779a5bb51d82d216642&scope.domain.id=default&role.id=ea564961b1db4eb4a1d4d880964611b2 => generated 530 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:03.045417 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a524f09-bb9d-489f-af31-147115a8893f None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:03.082205 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:03.158991 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a524f09-bb9d-489f-af31-147115a8893f None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:03.170038 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50f2c6c-50c0-4079-a119-f22a331c0ae6 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:03.194646 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236e63cb-ef3b-4737-b58d-c05ed42e0deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:03.195269 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e63cb-ef3b-4737-b58d-c05ed42e0deb None admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:03.195546 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e63cb-ef3b-4737-b58d-c05ed42e0deb None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:03.195822 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e63cb-ef3b-4737-b58d-c05ed42e0deb None admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:03.196493 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236e63cb-ef3b-4737-b58d-c05ed42e0deb None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:03.198030 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236e63cb-ef3b-4737-b58d-c05ed42e0deb None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:03.213721 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 25/44] 10.222.0.25 () {60 vars in 1131 bytes} [Thu Oct 13 10:57:03 2022] POST /identity/v3/roles => generated 223 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 10:57:03.276916 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50f2c6c-50c0-4079-a119-f22a331c0ae6 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:03.311291 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2973f0a3-6faf-418b-8434-8f2c234bd390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:03.311933 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2973f0a3-6faf-418b-8434-8f2c234bd390 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:03.312214 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2973f0a3-6faf-418b-8434-8f2c234bd390 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:03.312491 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2973f0a3-6faf-418b-8434-8f2c234bd390 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:03.313614 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2973f0a3-6faf-418b-8434-8f2c234bd390 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:03.315131 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2973f0a3-6faf-418b-8434-8f2c234bd390 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:03.316734 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 20/45] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 10:57:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:57:03.322787 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236e63cb-ef3b-4737-b58d-c05ed42e0deb None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:03.421979 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:03.428527 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236e63cb-ef3b-4737-b58d-c05ed42e0deb None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:03.462593 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6f259e-87d4-4d0c-9bba-4f62b4e60929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:03.463211 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f259e-87d4-4d0c-9bba-4f62b4e60929 None admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:03.463490 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f259e-87d4-4d0c-9bba-4f62b4e60929 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:03.463761 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f259e-87d4-4d0c-9bba-4f62b4e60929 None admin] PATH_INFO: `/v3/projects` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:03.464414 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6f259e-87d4-4d0c-9bba-4f62b4e60929 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:03.465846 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6f259e-87d4-4d0c-9bba-4f62b4e60929 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:03.491324 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 26/46] 10.222.0.25 () {60 vars in 1141 bytes} [Thu Oct 13 10:57:03 2022] POST /identity/v3/projects => generated 312 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 10:57:05.597698 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b8db3-b72c-4058-b060-0cbc8f12661b None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:05.598291 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b8db3-b72c-4058-b060-0cbc8f12661b None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:05.598291 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b8db3-b72c-4058-b060-0cbc8f12661b None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:05.599705 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 21/47] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:57:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:05.604899 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a81f3-6a9d-4862-b34f-a2fcdcbc5b98 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:05.605264 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a81f3-6a9d-4862-b34f-a2fcdcbc5b98 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:05.605457 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a81f3-6a9d-4862-b34f-a2fcdcbc5b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:05.623740 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-4d8a81f3-6a9d-4862-b34f-a2fcdcbc5b98 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:05.624930 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-4d8a81f3-6a9d-4862-b34f-a2fcdcbc5b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:05.687701 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 27/48] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:57:05.957557 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b8db3-b72c-4058-b060-0cbc8f12661b None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:05.999552 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:06.057361 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b8db3-b72c-4058-b060-0cbc8f12661b None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:06.088010 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fc097a-f803-4434-9b5d-e31df950960e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:06.088626 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc097a-f803-4434-9b5d-e31df950960e None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:06.088905 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc097a-f803-4434-9b5d-e31df950960e None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:06.089180 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc097a-f803-4434-9b5d-e31df950960e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:06.090297 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fc097a-f803-4434-9b5d-e31df950960e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:06.091740 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fc097a-f803-4434-9b5d-e31df950960e None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:06.093288 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 22/49] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 10:57:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:06.098858 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8a81f3-6a9d-4862-b34f-a2fcdcbc5b98 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:06.170842 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:06.194484 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8a81f3-6a9d-4862-b34f-a2fcdcbc5b98 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:06.227596 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c69c133-cbf3-4258-8414-42641ed1df5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:06.228225 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69c133-cbf3-4258-8414-42641ed1df5f None admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:06.228507 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69c133-cbf3-4258-8414-42641ed1df5f None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:06.228780 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69c133-cbf3-4258-8414-42641ed1df5f None admin] PATH_INFO: `/v3/projects` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:06.229433 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c69c133-cbf3-4258-8414-42641ed1df5f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:06.230890 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c69c133-cbf3-4258-8414-42641ed1df5f None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:06.255008 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 28/50] 10.222.0.25 () {60 vars in 1140 bytes} [Thu Oct 13 10:57:06 2022] POST /identity/v3/projects => generated 298 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 10:57:08.385108 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c462a-41e8-4124-a67b-5d181333235f None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:08.385620 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c462a-41e8-4124-a67b-5d181333235f None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:08.385804 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c462a-41e8-4124-a67b-5d181333235f None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:08.387040 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 23/51] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:57:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:08.392102 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910791ac-a3ea-4876-9423-6e6bd75dd18f None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:08.392473 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910791ac-a3ea-4876-9423-6e6bd75dd18f None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:08.392670 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910791ac-a3ea-4876-9423-6e6bd75dd18f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:08.513448 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-910791ac-a3ea-4876-9423-6e6bd75dd18f None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:08.514695 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-910791ac-a3ea-4876-9423-6e6bd75dd18f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:08.578210 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 29/52] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:57:08.845735 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0c462a-41e8-4124-a67b-5d181333235f None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:08.945281 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0c462a-41e8-4124-a67b-5d181333235f None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:08.953513 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:08.977331 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112fc57c-12d5-47d6-a48f-4786f78e273d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:08.977966 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fc57c-12d5-47d6-a48f-4786f78e273d None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:08.978258 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fc57c-12d5-47d6-a48f-4786f78e273d None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:08.978533 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fc57c-12d5-47d6-a48f-4786f78e273d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:08.979621 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112fc57c-12d5-47d6-a48f-4786f78e273d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:08.981056 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112fc57c-12d5-47d6-a48f-4786f78e273d None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:08.982636 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 24/53] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 10:57:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:08.988349 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910791ac-a3ea-4876-9423-6e6bd75dd18f None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:09.043973 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:09.086499 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910791ac-a3ea-4876-9423-6e6bd75dd18f None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:09.118788 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d1585-bb21-453e-ac2c-bd0a8ef8f297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:09.119340 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d1585-bb21-453e-ac2c-bd0a8ef8f297 None admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:09.119629 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d1585-bb21-453e-ac2c-bd0a8ef8f297 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:09.119904 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d1585-bb21-453e-ac2c-bd0a8ef8f297 None admin] PATH_INFO: `/v3/users` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:09.120561 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0d1585-bb21-453e-ac2c-bd0a8ef8f297 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:09.122035 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0d1585-bb21-453e-ac2c-bd0a8ef8f297 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:09.148356 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 30/54] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Oct 13 10:57:08 2022] POST /identity/v3/users => generated 275 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 10:57:12.167671 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ee787-91c7-4a45-b11e-93f084711f1e None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:12.168154 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ee787-91c7-4a45-b11e-93f084711f1e None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:12.168226 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ee787-91c7-4a45-b11e-93f084711f1e None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:12.169579 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 25/55] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:57:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:12.183504 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b790243d-645c-4acf-9c19-7f2e6ba2a8dc None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:12.184433 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b790243d-645c-4acf-9c19-7f2e6ba2a8dc None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:12.184926 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b790243d-645c-4acf-9c19-7f2e6ba2a8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:12.210957 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-b790243d-645c-4acf-9c19-7f2e6ba2a8dc None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:12.212153 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-b790243d-645c-4acf-9c19-7f2e6ba2a8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:12.307430 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 31/56] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:57:12.506960 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c6154-edee-42f8-a6cc-ab973aa07b06 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:12.507204 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c6154-edee-42f8-a6cc-ab973aa07b06 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:12.507586 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c6154-edee-42f8-a6cc-ab973aa07b06 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:12.509054 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 26/57] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:57:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:12.524412 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42924934-a74b-425c-ae80-11516adc89f3 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:12.524914 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42924934-a74b-425c-ae80-11516adc89f3 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:12.525411 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42924934-a74b-425c-ae80-11516adc89f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:12.561242 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-42924934-a74b-425c-ae80-11516adc89f3 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:12.563268 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-42924934-a74b-425c-ae80-11516adc89f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:12.623825 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:12.627374 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787d2f2-943b-4cc8-a9b8-5ada22bed6b7 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:12.628064 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787d2f2-943b-4cc8-a9b8-5ada22bed6b7 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:12.628064 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787d2f2-943b-4cc8-a9b8-5ada22bed6b7 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:12.629813 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 27/58] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:57:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:12.635643 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f4c65b-7166-44f5-b774-22927e18493c None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:12.635934 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f4c65b-7166-44f5-b774-22927e18493c None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:12.636238 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f4c65b-7166-44f5-b774-22927e18493c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:12.664316 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-37f4c65b-7166-44f5-b774-22927e18493c None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:12.666271 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-37f4c65b-7166-44f5-b774-22927e18493c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:12.683628 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 32/59] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:57:12.685244 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42924934-a74b-425c-ae80-11516adc89f3 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:12.792690 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 28/60] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 13 10:57:12.813406 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42924934-a74b-425c-ae80-11516adc89f3 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:12.847951 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df5f6eb-d2ca-4584-8339-62716c41dffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:12.848596 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5f6eb-d2ca-4584-8339-62716c41dffb None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:12.848878 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5f6eb-d2ca-4584-8339-62716c41dffb None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:12.849810 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5f6eb-d2ca-4584-8339-62716c41dffb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:12.861005 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df5f6eb-d2ca-4584-8339-62716c41dffb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:57:12.867769 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-5df5f6eb-d2ca-4584-8339-62716c41dffb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 13 10:57:12.867769 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:12.867769 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:57:12.867769 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:57:12.867769 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:57:12.867769 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:57:12.867769 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:57:12.867769 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:57:12.867769 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:57:12.867769 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:57:12.867769 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:57:12.867769 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:57:12.867769 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:57:12.867769 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:57:12.867769 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:57:12.867769 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:57:12.869760 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:57:12.869760 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:57:12.869760 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:57:12.869760 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:57:12.869760 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:57:12.869760 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:57:12.869760 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:57:12.869760 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:57:12.869760 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:57:12.869760 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:57:12.869760 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:57:12.869760 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:57:12.869760 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:57:12.869760 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:57:12.869760 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:57:12.869760 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:57:12.871691 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:57:12.871691 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:57:12.871691 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:57:12.871691 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:57:12.871691 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:57:12.871691 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:57:12.871691 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:57:12.871691 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:57:12.871691 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:57:12.871691 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:57:12.871691 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 13 10:57:12.871691 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:57:12.871691 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 33/61] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 10:57:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:57:12.879042 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f4c65b-7166-44f5-b774-22927e18493c None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:12.979861 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f4c65b-7166-44f5-b774-22927e18493c None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:12.987865 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:12.988790 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df5f6eb-d2ca-4584-8339-62716c41dffb None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:13.016891 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde1c7ab-8ed1-4d79-a471-1cd3a4f93075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:13.017564 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde1c7ab-8ed1-4d79-a471-1cd3a4f93075 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:13.017849 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde1c7ab-8ed1-4d79-a471-1cd3a4f93075 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:13.018153 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde1c7ab-8ed1-4d79-a471-1cd3a4f93075 None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:13.018822 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde1c7ab-8ed1-4d79-a471-1cd3a4f93075 None admin] RBAC: Adding query filter params (name=member) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:13.019131 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde1c7ab-8ed1-4d79-a471-1cd3a4f93075 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:13.020506 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde1c7ab-8ed1-4d79-a471-1cd3a4f93075 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:13.034092 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 29/62] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Oct 13 10:57:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:13.035331 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde1c7ab-8ed1-4d79-a471-1cd3a4f93075 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:13.061229 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:13.142316 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde1c7ab-8ed1-4d79-a471-1cd3a4f93075 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:13.185389 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb2ad86-8aae-48dc-b7bb-59b2e777218a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:13.187463 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb2ad86-8aae-48dc-b7bb-59b2e777218a None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:13.188910 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb2ad86-8aae-48dc-b7bb-59b2e777218a None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:13.189332 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb2ad86-8aae-48dc-b7bb-59b2e777218a None admin] PATH_INFO: `/v3/users/88156daaeeb84adf93ec5b93ed8bb55e` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:13.202350 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df5f6eb-d2ca-4584-8339-62716c41dffb None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:13.218568 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb2ad86-8aae-48dc-b7bb-59b2e777218a None admin] RBAC: Authorizing `identity:get_user(user_id=88156daaeeb84adf93ec5b93ed8bb55e)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:13.220059 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb2ad86-8aae-48dc-b7bb-59b2e777218a None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:13.221790 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 30/63] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Oct 13 10:57:13 2022] GET /identity/v3/users/88156daaeeb84adf93ec5b93ed8bb55e => generated 275 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:57:13.222667 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb2ad86-8aae-48dc-b7bb-59b2e777218a None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:13.255077 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:13.257662 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1b1251-dcb9-463d-b60b-d53ae7d2e016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:13.258427 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b1251-dcb9-463d-b60b-d53ae7d2e016 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:13.258709 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b1251-dcb9-463d-b60b-d53ae7d2e016 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:13.258981 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b1251-dcb9-463d-b60b-d53ae7d2e016 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:13.269797 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1b1251-dcb9-463d-b60b-d53ae7d2e016 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:57:13.275309 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-1d1b1251-dcb9-463d-b60b-d53ae7d2e016 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 10:57:13.275309 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:13.275309 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:57:13.275309 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:57:13.275309 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:57:13.275309 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:57:13.275309 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:57:13.275309 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:57:13.275309 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:57:13.275309 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:57:13.275309 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:57:13.275309 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:57:13.275309 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:57:13.275309 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:57:13.275309 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:57:13.275309 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:57:13.276356 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:57:13.276356 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:57:13.276356 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:57:13.276356 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:57:13.276356 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:57:13.276356 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:57:13.276356 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:57:13.276356 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:57:13.276356 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:57:13.276356 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:57:13.276356 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:57:13.276356 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:57:13.276356 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:57:13.276356 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:57:13.276356 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:57:13.276356 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:57:13.277319 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:57:13.277319 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:57:13.277319 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:57:13.277319 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:57:13.277319 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:57:13.277319 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:57:13.277319 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:57:13.277319 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:57:13.277319 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:57:13.277319 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:57:13.277319 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 10:57:13.277319 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:57:13.277319 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 34/64] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Oct 13 10:57:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 10:57:13.278232 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1b1251-dcb9-463d-b60b-d53ae7d2e016 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:13.339421 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb2ad86-8aae-48dc-b7bb-59b2e777218a None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:13.373592 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821ae932-0688-4c2d-b53e-56fbcfdc278c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:13.374265 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ae932-0688-4c2d-b53e-56fbcfdc278c None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:13.374549 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ae932-0688-4c2d-b53e-56fbcfdc278c None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:13.374824 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ae932-0688-4c2d-b53e-56fbcfdc278c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:13.376308 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:13.383426 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1b1251-dcb9-463d-b60b-d53ae7d2e016 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:13.386123 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821ae932-0688-4c2d-b53e-56fbcfdc278c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:57:13.391011 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-821ae932-0688-4c2d-b53e-56fbcfdc278c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 13 10:57:13.391011 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:13.391011 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:57:13.391011 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:57:13.391011 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:57:13.391011 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:57:13.391011 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:57:13.391011 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:57:13.391011 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:57:13.391011 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:57:13.391011 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:57:13.391011 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:57:13.391011 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:57:13.391011 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:57:13.391011 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:57:13.391011 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:57:13.391814 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:57:13.391814 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:57:13.391814 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:57:13.391814 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:57:13.391814 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:57:13.391814 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:57:13.391814 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:57:13.391814 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:57:13.391814 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:57:13.391814 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:57:13.391814 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:57:13.391814 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 10:57:13.391814 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:57:13.391814 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:57:13.391814 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:57:13.391814 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:57:13.392589 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:57:13.392589 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:57:13.392589 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:57:13.392589 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:57:13.392589 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:57:13.392589 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:57:13.392589 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:57:13.392589 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:57:13.392589 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:57:13.392589 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:57:13.392589 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 13 10:57:13.392589 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:57:13.392589 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 31/65] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Oct 13 10:57:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:57:13.393835 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b600ba2-f1ed-4f5e-be59-e4e93d069295 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:13.394149 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b600ba2-f1ed-4f5e-be59-e4e93d069295 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:13.394433 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b600ba2-f1ed-4f5e-be59-e4e93d069295 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:13.395877 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 32/66] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:57:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:13.396581 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b600ba2-f1ed-4f5e-be59-e4e93d069295 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:13.422084 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3714446-0065-4a4e-a788-138d18b0e3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:13.422822 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3714446-0065-4a4e-a788-138d18b0e3b4 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:13.423106 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3714446-0065-4a4e-a788-138d18b0e3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:13.423382 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3714446-0065-4a4e-a788-138d18b0e3b4 None admin] PATH_INFO: `/v3/projects/c72ae97522d241759a7f02e813ff1aab` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:13.424528 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3714446-0065-4a4e-a788-138d18b0e3b4 None admin] RBAC: Authorizing `identity:get_project(project_id=c72ae97522d241759a7f02e813ff1aab)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:13.426017 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3714446-0065-4a4e-a788-138d18b0e3b4 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:13.428336 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 35/67] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Oct 13 10:57:13 2022] GET /identity/v3/projects/c72ae97522d241759a7f02e813ff1aab => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:13.429614 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6639fa43-9318-4c99-9618-a30233949655 None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:13.429904 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6639fa43-9318-4c99-9618-a30233949655 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:13.430386 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6639fa43-9318-4c99-9618-a30233949655 None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:13.432467 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 36/68] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:57:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:13.433644 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6639fa43-9318-4c99-9618-a30233949655 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:13.484550 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:13.500428 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b600ba2-f1ed-4f5e-be59-e4e93d069295 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:13.538213 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6639fa43-9318-4c99-9618-a30233949655 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:13.575018 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9a4132-e9fa-4a3b-a480-3e123c9eda16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:13.575639 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a4132-e9fa-4a3b-a480-3e123c9eda16 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:13.575920 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a4132-e9fa-4a3b-a480-3e123c9eda16 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:13.576191 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a4132-e9fa-4a3b-a480-3e123c9eda16 None admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:13.576875 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9a4132-e9fa-4a3b-a480-3e123c9eda16 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:13.577179 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9a4132-e9fa-4a3b-a480-3e123c9eda16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:13.578620 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9a4132-e9fa-4a3b-a480-3e123c9eda16 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:13.587614 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 37/69] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Oct 13 10:57:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:13.592600 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d58305-731e-4e2b-ac07-d29e2ccde3cb None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:13.592600 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d58305-731e-4e2b-ac07-d29e2ccde3cb None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:13.592600 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d58305-731e-4e2b-ac07-d29e2ccde3cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:13.608625 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-88d58305-731e-4e2b-ac07-d29e2ccde3cb None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:13.609858 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-88d58305-731e-4e2b-ac07-d29e2ccde3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:13.629373 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:13.647095 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7f51b6-e706-4d33-8eab-ed32a860f1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:13.647706 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f51b6-e706-4d33-8eab-ed32a860f1e9 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:13.647984 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f51b6-e706-4d33-8eab-ed32a860f1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:13.648263 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f51b6-e706-4d33-8eab-ed32a860f1e9 None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:13.648924 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7f51b6-e706-4d33-8eab-ed32a860f1e9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:13.649232 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7f51b6-e706-4d33-8eab-ed32a860f1e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:13.650628 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7f51b6-e706-4d33-8eab-ed32a860f1e9 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:13.658828 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 33/70] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 10:57:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:13.659453 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7f51b6-e706-4d33-8eab-ed32a860f1e9 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:13.683751 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 38/71] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:57:13.685207 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb94c3ab-8ae8-4837-aa24-737b7189745a None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:13.685501 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb94c3ab-8ae8-4837-aa24-737b7189745a None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:13.685777 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb94c3ab-8ae8-4837-aa24-737b7189745a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:13.702917 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-eb94c3ab-8ae8-4837-aa24-737b7189745a None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:13.704091 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-eb94c3ab-8ae8-4837-aa24-737b7189745a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:13.759353 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7f51b6-e706-4d33-8eab-ed32a860f1e9 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:13.777987 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 39/72] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:57:13.777987 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb94c3ab-8ae8-4837-aa24-737b7189745a None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:13.799595 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc8fd10-6df6-4a82-9838-dfac8b04f2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:13.800261 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc8fd10-6df6-4a82-9838-dfac8b04f2b2 None admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:13.800546 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc8fd10-6df6-4a82-9838-dfac8b04f2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:13.800829 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc8fd10-6df6-4a82-9838-dfac8b04f2b2 None admin] PATH_INFO: `/v3/projects/c72ae97522d241759a7f02e813ff1aab/users/88156daaeeb84adf93ec5b93ed8bb55e/roles/7c3871c0ab68438b9014489d50b53a22` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:13.803614 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc8fd10-6df6-4a82-9838-dfac8b04f2b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=c72ae97522d241759a7f02e813ff1aab, user_id=88156daaeeb84adf93ec5b93ed8bb55e, role_id=7c3871c0ab68438b9014489d50b53a22)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:13.805065 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc8fd10-6df6-4a82-9838-dfac8b04f2b2 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:13.820998 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 34/73] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Oct 13 10:57:13 2022] PUT /identity/v3/projects/c72ae97522d241759a7f02e813ff1aab/users/88156daaeeb84adf93ec5b93ed8bb55e/roles/7c3871c0ab68438b9014489d50b53a22 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 10:57:13.821810 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc8fd10-6df6-4a82-9838-dfac8b04f2b2 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:13.838522 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:13.943611 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:13.982440 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb94c3ab-8ae8-4837-aa24-737b7189745a None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:13.991862 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc8fd10-6df6-4a82-9838-dfac8b04f2b2 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:14.021783 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac7a4fd-deb6-4cbd-b193-87227dabc4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:14.022556 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac7a4fd-deb6-4cbd-b193-87227dabc4a3 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:14.022841 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac7a4fd-deb6-4cbd-b193-87227dabc4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:14.023120 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac7a4fd-deb6-4cbd-b193-87227dabc4a3 None admin] PATH_INFO: `/v3/users/88156daaeeb84adf93ec5b93ed8bb55e` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:14.024493 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac7a4fd-deb6-4cbd-b193-87227dabc4a3 None admin] RBAC: Authorizing `identity:get_user(user_id=88156daaeeb84adf93ec5b93ed8bb55e)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:14.025927 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac7a4fd-deb6-4cbd-b193-87227dabc4a3 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:14.027548 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 40/74] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Oct 13 10:57:13 2022] GET /identity/v3/users/88156daaeeb84adf93ec5b93ed8bb55e => generated 275 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:14.028299 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac7a4fd-deb6-4cbd-b193-87227dabc4a3 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:14.038898 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71259cb7-4583-4f9a-b1a5-4e2ceffd1f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:14.039656 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71259cb7-4583-4f9a-b1a5-4e2ceffd1f28 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:14.039941 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71259cb7-4583-4f9a-b1a5-4e2ceffd1f28 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:14.040223 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71259cb7-4583-4f9a-b1a5-4e2ceffd1f28 None admin] PATH_INFO: `/v3/users/f4dbe08e33ae4779a5bb51d82d216642` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:14.042122 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71259cb7-4583-4f9a-b1a5-4e2ceffd1f28 None admin] RBAC: Authorizing `identity:get_user(user_id=f4dbe08e33ae4779a5bb51d82d216642)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:14.043569 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71259cb7-4583-4f9a-b1a5-4e2ceffd1f28 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:14.045322 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 35/75] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Oct 13 10:57:13 2022] GET /identity/v3/users/f4dbe08e33ae4779a5bb51d82d216642 => generated 247 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:14.045974 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71259cb7-4583-4f9a-b1a5-4e2ceffd1f28 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:14.129192 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac7a4fd-deb6-4cbd-b193-87227dabc4a3 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:14.132478 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:14.158225 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71259cb7-4583-4f9a-b1a5-4e2ceffd1f28 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:14.163940 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f635330d-f6cb-497d-a059-6c83be47af74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:14.164581 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f635330d-f6cb-497d-a059-6c83be47af74 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:14.164865 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f635330d-f6cb-497d-a059-6c83be47af74 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:14.165142 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f635330d-f6cb-497d-a059-6c83be47af74 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:14.175446 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f635330d-f6cb-497d-a059-6c83be47af74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:57:14.180836 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-f635330d-f6cb-497d-a059-6c83be47af74 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 13 10:57:14.180836 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:14.180836 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:57:14.180836 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:57:14.180836 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:57:14.180836 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:57:14.180836 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:57:14.180836 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:57:14.180836 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:57:14.180836 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:57:14.180836 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:57:14.180836 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:57:14.180836 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:57:14.180836 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:57:14.180836 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:57:14.180836 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:57:14.181671 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:57:14.181671 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:57:14.181671 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:57:14.181671 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:57:14.181671 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:57:14.181671 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:57:14.181671 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:57:14.181671 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:57:14.181671 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:57:14.181671 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:57:14.181671 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:57:14.181671 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:57:14.181671 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:57:14.181671 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:57:14.181671 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:57:14.181671 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:57:14.182547 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:57:14.182547 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:57:14.182547 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:57:14.182547 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:57:14.182547 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:57:14.182547 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:57:14.182547 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:57:14.182547 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:57:14.182547 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:57:14.182547 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:57:14.182547 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 13 10:57:14.182547 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:57:14.182547 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 41/76] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 10:57:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:57:14.183172 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f635330d-f6cb-497d-a059-6c83be47af74 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:14.195289 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a29ae74-5784-4b2c-82ad-9190df99eff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:14.195935 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a29ae74-5784-4b2c-82ad-9190df99eff2 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:14.196210 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a29ae74-5784-4b2c-82ad-9190df99eff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:14.196484 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a29ae74-5784-4b2c-82ad-9190df99eff2 None admin] PATH_INFO: `/v3/projects/c72ae97522d241759a7f02e813ff1aab` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:14.197613 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a29ae74-5784-4b2c-82ad-9190df99eff2 None admin] RBAC: Authorizing `identity:get_project(project_id=c72ae97522d241759a7f02e813ff1aab)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:14.199079 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a29ae74-5784-4b2c-82ad-9190df99eff2 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:14.201998 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 36/77] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Oct 13 10:57:14 2022] GET /identity/v3/projects/c72ae97522d241759a7f02e813ff1aab => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:14.201998 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a29ae74-5784-4b2c-82ad-9190df99eff2 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:14.202555 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:14.299699 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f635330d-f6cb-497d-a059-6c83be47af74 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:14.315286 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a29ae74-5784-4b2c-82ad-9190df99eff2 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:14.333462 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9c0b30-3eea-41cd-8bcc-734b64da2a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:14.334157 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c0b30-3eea-41cd-8bcc-734b64da2a9b None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:14.334466 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c0b30-3eea-41cd-8bcc-734b64da2a9b None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:14.334726 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c0b30-3eea-41cd-8bcc-734b64da2a9b None admin] PATH_INFO: `/v3/projects/c72ae97522d241759a7f02e813ff1aab` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:14.335889 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9c0b30-3eea-41cd-8bcc-734b64da2a9b None admin] RBAC: Authorizing `identity:get_project(project_id=c72ae97522d241759a7f02e813ff1aab)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:14.337348 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9c0b30-3eea-41cd-8bcc-734b64da2a9b None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:14.339010 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 42/78] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Oct 13 10:57:14 2022] GET /identity/v3/projects/c72ae97522d241759a7f02e813ff1aab => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:14.339775 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9c0b30-3eea-41cd-8bcc-734b64da2a9b None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:14.362993 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba50dd5-d2c9-4736-8908-97015be07ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:14.364254 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba50dd5-d2c9-4736-8908-97015be07ec7 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:14.364853 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba50dd5-d2c9-4736-8908-97015be07ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:14.365328 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba50dd5-d2c9-4736-8908-97015be07ec7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:14.367247 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba50dd5-d2c9-4736-8908-97015be07ec7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:14.369343 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba50dd5-d2c9-4736-8908-97015be07ec7 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:14.371892 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 37/79] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 10:57:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:14.372871 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba50dd5-d2c9-4736-8908-97015be07ec7 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:14.390811 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:14.432821 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:14.454743 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9c0b30-3eea-41cd-8bcc-734b64da2a9b None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:14.484529 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba50dd5-d2c9-4736-8908-97015be07ec7 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:14.490395 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb60f3d-c988-4281-b70a-251735699a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:14.491044 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb60f3d-c988-4281-b70a-251735699a7d None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:14.491328 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb60f3d-c988-4281-b70a-251735699a7d None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:14.491605 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb60f3d-c988-4281-b70a-251735699a7d None admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:14.492426 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb60f3d-c988-4281-b70a-251735699a7d None admin] RBAC: Adding query filter params (name=member) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:14.492731 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb60f3d-c988-4281-b70a-251735699a7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:14.494269 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb60f3d-c988-4281-b70a-251735699a7d None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:14.507879 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 43/80] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Oct 13 10:57:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:14.508456 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb60f3d-c988-4281-b70a-251735699a7d None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:14.518672 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac8e29d-9e5b-4682-a2b8-1c077c3940e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:14.519332 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac8e29d-9e5b-4682-a2b8-1c077c3940e3 None admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:14.519624 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac8e29d-9e5b-4682-a2b8-1c077c3940e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:14.519890 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac8e29d-9e5b-4682-a2b8-1c077c3940e3 None admin] PATH_INFO: `/v3/projects/c72ae97522d241759a7f02e813ff1aab/users/88156daaeeb84adf93ec5b93ed8bb55e/roles/84a5ec3770b4453bb7c3ff5b9af0bd17` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:14.523896 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac8e29d-9e5b-4682-a2b8-1c077c3940e3 None admin] RBAC: Authorizing `identity:create_grant(project_id=c72ae97522d241759a7f02e813ff1aab, user_id=88156daaeeb84adf93ec5b93ed8bb55e, role_id=84a5ec3770b4453bb7c3ff5b9af0bd17)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:14.525398 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac8e29d-9e5b-4682-a2b8-1c077c3940e3 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:14.539580 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 38/81] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Oct 13 10:57:14 2022] PUT /identity/v3/projects/c72ae97522d241759a7f02e813ff1aab/users/88156daaeeb84adf93ec5b93ed8bb55e/roles/84a5ec3770b4453bb7c3ff5b9af0bd17 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 10:57:14.540211 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac8e29d-9e5b-4682-a2b8-1c077c3940e3 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:14.625195 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:14.641426 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb60f3d-c988-4281-b70a-251735699a7d None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:14.663625 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac8e29d-9e5b-4682-a2b8-1c077c3940e3 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:14.682746 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547600d-3767-46fd-b4d7-931c950f3eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:14.683884 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547600d-3767-46fd-b4d7-931c950f3eba None admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:14.684374 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547600d-3767-46fd-b4d7-931c950f3eba None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:14.684861 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547600d-3767-46fd-b4d7-931c950f3eba None admin] PATH_INFO: `/v3/projects/c72ae97522d241759a7f02e813ff1aab/users/f4dbe08e33ae4779a5bb51d82d216642/roles/ea564961b1db4eb4a1d4d880964611b2` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:14.687427 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d547600d-3767-46fd-b4d7-931c950f3eba None admin] RBAC: Authorizing `identity:create_grant(project_id=c72ae97522d241759a7f02e813ff1aab, user_id=f4dbe08e33ae4779a5bb51d82d216642, role_id=ea564961b1db4eb4a1d4d880964611b2)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:14.689215 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d547600d-3767-46fd-b4d7-931c950f3eba None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:14.703833 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac011543-89bc-46b4-9883-9ab92bf18b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:14.704796 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac011543-89bc-46b4-9883-9ab92bf18b57 None admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:14.705082 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac011543-89bc-46b4-9883-9ab92bf18b57 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:14.705406 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac011543-89bc-46b4-9883-9ab92bf18b57 None admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:14.706168 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac011543-89bc-46b4-9883-9ab92bf18b57 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:14.707790 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac011543-89bc-46b4-9883-9ab92bf18b57 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:14.709558 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 44/82] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Oct 13 10:57:14 2022] PUT /identity/v3/projects/c72ae97522d241759a7f02e813ff1aab/users/f4dbe08e33ae4779a5bb51d82d216642/roles/ea564961b1db4eb4a1d4d880964611b2 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 10:57:14.710731 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547600d-3767-46fd-b4d7-931c950f3eba None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:14.714558 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:14.745721 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 39/83] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Oct 13 10:57:14 2022] POST /identity/v3/users => generated 289 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 10:57:14.861555 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547600d-3767-46fd-b4d7-931c950f3eba None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:14.902580 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bee927-646f-42fd-a12f-69ab1d611447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:14.903217 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bee927-646f-42fd-a12f-69ab1d611447 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:14.903511 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bee927-646f-42fd-a12f-69ab1d611447 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:14.903798 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bee927-646f-42fd-a12f-69ab1d611447 None admin] PATH_INFO: `/v3/users/88156daaeeb84adf93ec5b93ed8bb55e` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:14.904999 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bee927-646f-42fd-a12f-69ab1d611447 None admin] RBAC: Authorizing `identity:get_user(user_id=88156daaeeb84adf93ec5b93ed8bb55e)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:14.906503 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bee927-646f-42fd-a12f-69ab1d611447 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:14.908408 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 45/84] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Oct 13 10:57:14 2022] GET /identity/v3/users/88156daaeeb84adf93ec5b93ed8bb55e => generated 275 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:14.915108 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac011543-89bc-46b4-9883-9ab92bf18b57 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:15.036069 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac011543-89bc-46b4-9883-9ab92bf18b57 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:15.068669 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:15.081474 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc334157-d274-4d8e-b2f0-52e558717932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:15.082157 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc334157-d274-4d8e-b2f0-52e558717932 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:15.082447 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc334157-d274-4d8e-b2f0-52e558717932 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:15.082732 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc334157-d274-4d8e-b2f0-52e558717932 None admin] PATH_INFO: `/v3/projects/d448380eda784fbca180941263df0245` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:15.083942 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc334157-d274-4d8e-b2f0-52e558717932 None admin] RBAC: Authorizing `identity:get_project(project_id=d448380eda784fbca180941263df0245)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:15.085407 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc334157-d274-4d8e-b2f0-52e558717932 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:15.087463 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 40/85] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Oct 13 10:57:14 2022] GET /identity/v3/projects/d448380eda784fbca180941263df0245 => generated 312 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:15.092814 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bee927-646f-42fd-a12f-69ab1d611447 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:15.184979 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:15.224468 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bee927-646f-42fd-a12f-69ab1d611447 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:15.262083 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f987a945-9a9c-4060-b92b-61ec429ee5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:15.262758 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987a945-9a9c-4060-b92b-61ec429ee5c4 None admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:15.263044 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987a945-9a9c-4060-b92b-61ec429ee5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:15.263322 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987a945-9a9c-4060-b92b-61ec429ee5c4 None admin] PATH_INFO: `/v3/projects/d448380eda784fbca180941263df0245/users/88156daaeeb84adf93ec5b93ed8bb55e/roles/7c3871c0ab68438b9014489d50b53a22` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:15.265272 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f987a945-9a9c-4060-b92b-61ec429ee5c4 None admin] RBAC: Authorizing `identity:create_grant(project_id=d448380eda784fbca180941263df0245, user_id=88156daaeeb84adf93ec5b93ed8bb55e, role_id=7c3871c0ab68438b9014489d50b53a22)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:15.266799 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f987a945-9a9c-4060-b92b-61ec429ee5c4 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:15.283499 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 46/86] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Oct 13 10:57:15 2022] PUT /identity/v3/projects/d448380eda784fbca180941263df0245/users/88156daaeeb84adf93ec5b93ed8bb55e/roles/7c3871c0ab68438b9014489d50b53a22 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 10:57:16.297304 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd6b8c-aca9-4e55-b650-84da4e3c05aa None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:16.297815 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd6b8c-aca9-4e55-b650-84da4e3c05aa None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:16.297886 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd6b8c-aca9-4e55-b650-84da4e3c05aa None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:16.299228 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 41/87] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:57:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:16.304595 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890f385-564f-4483-a516-ef5e4d5478f0 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:16.304996 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890f385-564f-4483-a516-ef5e4d5478f0 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:16.305175 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890f385-564f-4483-a516-ef5e4d5478f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:16.330930 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-6890f385-564f-4483-a516-ef5e4d5478f0 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:16.332133 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-6890f385-564f-4483-a516-ef5e4d5478f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:16.420274 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 47/88] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 13 10:57:16.975845 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd6b8c-aca9-4e55-b650-84da4e3c05aa None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:17.127153 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd6b8c-aca9-4e55-b650-84da4e3c05aa None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:17.227287 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aace151-c29c-45cf-9c64-b6f66ffdf998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:17.227944 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aace151-c29c-45cf-9c64-b6f66ffdf998 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:17.228224 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aace151-c29c-45cf-9c64-b6f66ffdf998 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:17.228498 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aace151-c29c-45cf-9c64-b6f66ffdf998 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:17.251217 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aace151-c29c-45cf-9c64-b6f66ffdf998 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:57:17.256695 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-9aace151-c29c-45cf-9c64-b6f66ffdf998 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 13 10:57:17.256695 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:17.256695 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:57:17.256695 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:57:17.256695 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:57:17.256695 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:57:17.256695 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:57:17.256695 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:57:17.256695 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:57:17.256695 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:57:17.256695 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:57:17.256695 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:57:17.256695 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:57:17.256695 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:57:17.256695 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:57:17.256695 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:57:17.257521 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:57:17.257521 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:57:17.257521 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:57:17.257521 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:57:17.257521 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:57:17.257521 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:57:17.257521 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:57:17.257521 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:57:17.257521 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:57:17.257521 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:57:17.257521 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:57:17.257521 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 10:57:17.257521 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:57:17.257521 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:57:17.257521 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:57:17.257521 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:57:17.258341 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:57:17.258341 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:57:17.258341 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:57:17.258341 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:57:17.258341 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:57:17.258341 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:57:17.258341 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:57:17.258341 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:57:17.258341 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:57:17.258341 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:57:17.258341 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 13 10:57:17.258341 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:57:17.258341 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 42/89] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 10:57:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:57:17.263919 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6890f385-564f-4483-a516-ef5e4d5478f0 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:17.397103 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:17.453690 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6890f385-564f-4483-a516-ef5e4d5478f0 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:17.500608 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958839d8-0cba-4f50-8a3a-4addc6f6b3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:17.501567 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958839d8-0cba-4f50-8a3a-4addc6f6b3f9 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:17.502136 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958839d8-0cba-4f50-8a3a-4addc6f6b3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:17.502606 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958839d8-0cba-4f50-8a3a-4addc6f6b3f9 None admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:17.503462 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958839d8-0cba-4f50-8a3a-4addc6f6b3f9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:17.503960 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958839d8-0cba-4f50-8a3a-4addc6f6b3f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:17.505601 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958839d8-0cba-4f50-8a3a-4addc6f6b3f9 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:17.517549 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 48/90] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Oct 13 10:57:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:17.523391 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aace151-c29c-45cf-9c64-b6f66ffdf998 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:17.613402 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:17.651441 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aace151-c29c-45cf-9c64-b6f66ffdf998 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:17.697408 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2385678-3bf7-4a83-9158-35a3f2fed8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:17.698111 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2385678-3bf7-4a83-9158-35a3f2fed8c6 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:17.698398 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2385678-3bf7-4a83-9158-35a3f2fed8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:17.698672 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2385678-3bf7-4a83-9158-35a3f2fed8c6 None admin] PATH_INFO: `/v3/users/88156daaeeb84adf93ec5b93ed8bb55e` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:17.699953 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2385678-3bf7-4a83-9158-35a3f2fed8c6 None admin] RBAC: Authorizing `identity:get_user(user_id=88156daaeeb84adf93ec5b93ed8bb55e)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:17.701471 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2385678-3bf7-4a83-9158-35a3f2fed8c6 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:17.703212 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 43/91] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Oct 13 10:57:17 2022] GET /identity/v3/users/88156daaeeb84adf93ec5b93ed8bb55e => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:17.711116 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958839d8-0cba-4f50-8a3a-4addc6f6b3f9 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:17.858696 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958839d8-0cba-4f50-8a3a-4addc6f6b3f9 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:17.870634 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed599c7-c0c4-469a-ba02-d464fd41c766 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:17.871264 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed599c7-c0c4-469a-ba02-d464fd41c766 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:17.871738 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed599c7-c0c4-469a-ba02-d464fd41c766 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:17.873291 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 44/92] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:57:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 10:57:17.881156 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fa95fb-e79d-46bf-af3d-6bb3c824c6d3 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:17.881801 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fa95fb-e79d-46bf-af3d-6bb3c824c6d3 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:17.882377 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fa95fb-e79d-46bf-af3d-6bb3c824c6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:17.894323 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:17.920156 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-89fa95fb-e79d-46bf-af3d-6bb3c824c6d3 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:17.921811 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-89fa95fb-e79d-46bf-af3d-6bb3c824c6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:17.924346 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4394f73-edf1-4a26-b9d9-9809074d521e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:17.925238 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4394f73-edf1-4a26-b9d9-9809074d521e None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:17.925673 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4394f73-edf1-4a26-b9d9-9809074d521e None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:17.926123 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4394f73-edf1-4a26-b9d9-9809074d521e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:18.022111 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4394f73-edf1-4a26-b9d9-9809074d521e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:18.023848 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4394f73-edf1-4a26-b9d9-9809074d521e None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:18.054409 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 45/93] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:57:18.056302 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c6244e-d129-4e10-8122-301c941974df None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:18.056593 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c6244e-d129-4e10-8122-301c941974df None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:18.056893 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c6244e-d129-4e10-8122-301c941974df None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:18.059570 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 46/94] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:57:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:18.060815 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b01aa-9454-4e0d-a6d2-ca590abdf5bf None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:18.061256 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b01aa-9454-4e0d-a6d2-ca590abdf5bf None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:18.061688 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b01aa-9454-4e0d-a6d2-ca590abdf5bf None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:18.066277 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 47/95] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:57:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:18.071520 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1253e68a-4b95-44aa-9f13-56f21aab3a91 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:18.071966 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1253e68a-4b95-44aa-9f13-56f21aab3a91 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:18.072391 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1253e68a-4b95-44aa-9f13-56f21aab3a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:18.102639 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-1253e68a-4b95-44aa-9f13-56f21aab3a91 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:18.105282 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-1253e68a-4b95-44aa-9f13-56f21aab3a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:18.183969 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 48/96] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:57:18.185653 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10cacf6-3ca7-4c44-94ef-8c51bc006136 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:18.194929 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:18.195433 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10cacf6-3ca7-4c44-94ef-8c51bc006136 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:18.195930 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10cacf6-3ca7-4c44-94ef-8c51bc006136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:18.218099 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-f10cacf6-3ca7-4c44-94ef-8c51bc006136 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:18.219691 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-f10cacf6-3ca7-4c44-94ef-8c51bc006136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:18.220902 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 49/97] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Oct 13 10:57:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 13 10:57:18.226549 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4394f73-edf1-4a26-b9d9-9809074d521e None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:18.290202 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:18.291742 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 49/98] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:57:18.414558 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4394f73-edf1-4a26-b9d9-9809074d521e None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:18.430255 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10cacf6-3ca7-4c44-94ef-8c51bc006136 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:18.496109 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effbce35-fb26-48cc-945f-0c004cb4e67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:18.496953 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effbce35-fb26-48cc-945f-0c004cb4e67c None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:18.497391 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effbce35-fb26-48cc-945f-0c004cb4e67c None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:18.497889 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effbce35-fb26-48cc-945f-0c004cb4e67c None admin] PATH_INFO: `/v3/projects/c72ae97522d241759a7f02e813ff1aab` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:18.501701 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effbce35-fb26-48cc-945f-0c004cb4e67c None admin] RBAC: Authorizing `identity:get_project(project_id=c72ae97522d241759a7f02e813ff1aab)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:18.503828 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effbce35-fb26-48cc-945f-0c004cb4e67c None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:18.508265 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 50/99] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Oct 13 10:57:18 2022] GET /identity/v3/projects/c72ae97522d241759a7f02e813ff1aab => generated 298 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:57:18.516521 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effbce35-fb26-48cc-945f-0c004cb4e67c None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:18.596238 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10cacf6-3ca7-4c44-94ef-8c51bc006136 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:18.613897 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:18.648112 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e34d5c6-6dd5-44cf-976f-f70568de180b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:18.649169 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e34d5c6-6dd5-44cf-976f-f70568de180b None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:18.649588 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e34d5c6-6dd5-44cf-976f-f70568de180b None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:18.650080 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e34d5c6-6dd5-44cf-976f-f70568de180b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:18.663814 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e34d5c6-6dd5-44cf-976f-f70568de180b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:57:18.670092 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-1e34d5c6-6dd5-44cf-976f-f70568de180b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 13 10:57:18.670092 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:18.670092 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:57:18.670092 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:57:18.670092 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:57:18.670092 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:57:18.670092 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:57:18.670092 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:57:18.670092 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:57:18.670092 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:57:18.670092 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:57:18.670092 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:57:18.670092 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:57:18.670092 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:57:18.670092 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:57:18.670092 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:57:18.670945 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:57:18.670945 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:57:18.670945 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:57:18.670945 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:57:18.670945 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:57:18.670945 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:57:18.670945 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:57:18.670945 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:57:18.670945 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:57:18.670945 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:57:18.670945 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:57:18.670945 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 10:57:18.670945 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:57:18.670945 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:57:18.670945 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:57:18.670945 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:57:18.671672 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:57:18.671672 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:57:18.671672 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:57:18.671672 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:57:18.671672 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:57:18.671672 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:57:18.671672 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:57:18.671672 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:57:18.671672 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:57:18.671672 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:57:18.671672 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 13 10:57:18.671672 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:57:18.671672 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 50/100] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 10:57:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 10:57:18.675429 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40562a60-5fa0-4a38-ba5f-99adefc4240e None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:18.675713 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40562a60-5fa0-4a38-ba5f-99adefc4240e None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:18.676011 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40562a60-5fa0-4a38-ba5f-99adefc4240e None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:18.677460 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 51/101] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:57:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:18.678196 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40562a60-5fa0-4a38-ba5f-99adefc4240e None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:18.696191 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:18.706412 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effbce35-fb26-48cc-945f-0c004cb4e67c None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:18.741130 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9742f64-24c8-4ff5-a9d3-8238b7180a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:18.741792 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9742f64-24c8-4ff5-a9d3-8238b7180a56 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:18.742101 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9742f64-24c8-4ff5-a9d3-8238b7180a56 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:18.742314 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9742f64-24c8-4ff5-a9d3-8238b7180a56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:18.743024 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9742f64-24c8-4ff5-a9d3-8238b7180a56 None admin] RBAC: Adding query filter params (role.id=7c3871c0ab68438b9014489d50b53a22, scope.project.id=c72ae97522d241759a7f02e813ff1aab, user.id=88156daaeeb84adf93ec5b93ed8bb55e) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:18.743332 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9742f64-24c8-4ff5-a9d3-8238b7180a56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:18.744762 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9742f64-24c8-4ff5-a9d3-8238b7180a56 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:18.762067 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 51/102] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Oct 13 10:57:18 2022] GET /identity/v3/role_assignments?user.id=88156daaeeb84adf93ec5b93ed8bb55e&scope.project.id=c72ae97522d241759a7f02e813ff1aab&role.id=7c3871c0ab68438b9014489d50b53a22 => generated 608 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:57:18.762067 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9742f64-24c8-4ff5-a9d3-8238b7180a56 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:18.812080 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40562a60-5fa0-4a38-ba5f-99adefc4240e None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:18.862798 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ea0265-ba9e-49ed-9d1b-68cbf4149d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:18.863602 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea0265-ba9e-49ed-9d1b-68cbf4149d08 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:18.864226 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea0265-ba9e-49ed-9d1b-68cbf4149d08 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:18.864617 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea0265-ba9e-49ed-9d1b-68cbf4149d08 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:18.874855 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9742f64-24c8-4ff5-a9d3-8238b7180a56 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:18.889967 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ea0265-ba9e-49ed-9d1b-68cbf4149d08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:57:18.890587 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-91ea0265-ba9e-49ed-9d1b-68cbf4149d08 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 13 10:57:18.890587 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:18.890587 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:57:18.890587 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:57:18.890587 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:57:18.890587 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:57:18.890587 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:57:18.890587 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:57:18.890587 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:57:18.890587 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:57:18.890587 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:57:18.890587 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:57:18.890587 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:57:18.890587 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:57:18.890587 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:57:18.890587 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:57:18.891573 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:57:18.891573 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:57:18.891573 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:57:18.891573 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:57:18.891573 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:57:18.891573 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:57:18.891573 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:57:18.891573 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:57:18.891573 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:57:18.891573 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:57:18.891573 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:57:18.891573 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 10:57:18.891573 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:57:18.891573 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:57:18.891573 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:57:18.891573 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:57:18.892309 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:57:18.892309 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:57:18.892309 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:57:18.892309 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:57:18.892309 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:57:18.892309 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:57:18.892309 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:57:18.892309 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:57:18.892309 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:57:18.892309 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:57:18.892309 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 13 10:57:18.892309 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:57:18.892309 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 52/103] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Oct 13 10:57:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:57:18.898980 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ea0265-ba9e-49ed-9d1b-68cbf4149d08 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:18.921677 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64617188-0be8-4883-b3b0-0377efe70703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:18.922310 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64617188-0be8-4883-b3b0-0377efe70703 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:18.922584 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64617188-0be8-4883-b3b0-0377efe70703 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:18.922853 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64617188-0be8-4883-b3b0-0377efe70703 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:18.936708 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64617188-0be8-4883-b3b0-0377efe70703 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:57:18.942599 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-64617188-0be8-4883-b3b0-0377efe70703 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 10:57:18.942599 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:18.942599 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:57:18.942599 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:57:18.942599 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:57:18.942599 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:57:18.942599 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:57:18.942599 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:57:18.942599 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:57:18.942599 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:57:18.942599 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:57:18.942599 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:57:18.942599 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:57:18.942599 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:57:18.942599 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:57:18.942599 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:57:18.943562 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:57:18.943562 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:57:18.943562 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:57:18.943562 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:57:18.943562 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:57:18.943562 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:57:18.943562 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:57:18.943562 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:57:18.943562 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:57:18.943562 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:57:18.943562 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:57:18.943562 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:57:18.943562 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:57:18.943562 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:57:18.943562 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:57:18.943562 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:57:18.944309 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:57:18.944309 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:57:18.944309 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:57:18.944309 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:57:18.944309 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:57:18.944309 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:57:18.944309 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:57:18.944309 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:57:18.944309 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:57:18.944309 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:57:18.944309 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 10:57:18.944309 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:57:18.944309 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 52/104] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Oct 13 10:57:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:57:18.945430 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419fdeca-01c0-4a99-ac3e-5ec269278b4a None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:18.945595 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419fdeca-01c0-4a99-ac3e-5ec269278b4a None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:18.945736 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419fdeca-01c0-4a99-ac3e-5ec269278b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:18.955011 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:18.968495 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-419fdeca-01c0-4a99-ac3e-5ec269278b4a None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:18.969714 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-419fdeca-01c0-4a99-ac3e-5ec269278b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:18.980548 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:19.052645 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 53/105] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:57:19.053354 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419fdeca-01c0-4a99-ac3e-5ec269278b4a None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:19.056571 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ea0265-ba9e-49ed-9d1b-68cbf4149d08 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:19.100675 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11af102-8b0b-40a2-abb5-9416732e54bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:19.101295 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11af102-8b0b-40a2-abb5-9416732e54bc None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:19.101635 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11af102-8b0b-40a2-abb5-9416732e54bc None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:19.101926 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11af102-8b0b-40a2-abb5-9416732e54bc None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:19.102720 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11af102-8b0b-40a2-abb5-9416732e54bc None admin] RBAC: Adding query filter params (name=reader) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:19.103040 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11af102-8b0b-40a2-abb5-9416732e54bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:19.104438 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11af102-8b0b-40a2-abb5-9416732e54bc None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:19.113999 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 53/106] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Oct 13 10:57:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:19.115272 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11af102-8b0b-40a2-abb5-9416732e54bc None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:19.165568 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419fdeca-01c0-4a99-ac3e-5ec269278b4a None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:19.200888 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767702dc-6e52-4346-8268-e49b96ac89d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:19.201500 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767702dc-6e52-4346-8268-e49b96ac89d4 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:19.201782 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767702dc-6e52-4346-8268-e49b96ac89d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:19.202091 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767702dc-6e52-4346-8268-e49b96ac89d4 None admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:19.202768 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767702dc-6e52-4346-8268-e49b96ac89d4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:19.203074 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767702dc-6e52-4346-8268-e49b96ac89d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:19.204440 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767702dc-6e52-4346-8268-e49b96ac89d4 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:19.213093 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 54/107] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Oct 13 10:57:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:19.214338 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd4e4b-d8dd-4bc8-b6bb-67a40df844ef None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:19.214635 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd4e4b-d8dd-4bc8-b6bb-67a40df844ef None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:19.214914 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd4e4b-d8dd-4bc8-b6bb-67a40df844ef None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:19.216301 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 55/108] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:57:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:19.218732 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd4e4b-d8dd-4bc8-b6bb-67a40df844ef None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:19.223546 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:19.230208 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:19.231090 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11af102-8b0b-40a2-abb5-9416732e54bc None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:19.272680 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f01a8c-57ff-4545-8c23-456f04ca4b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:19.274002 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f01a8c-57ff-4545-8c23-456f04ca4b2a None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:19.274517 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f01a8c-57ff-4545-8c23-456f04ca4b2a None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:19.275000 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f01a8c-57ff-4545-8c23-456f04ca4b2a None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:19.275865 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f01a8c-57ff-4545-8c23-456f04ca4b2a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:19.276818 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f01a8c-57ff-4545-8c23-456f04ca4b2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:19.278295 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f01a8c-57ff-4545-8c23-456f04ca4b2a None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:19.287401 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 54/109] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 10:57:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:19.292723 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f01a8c-57ff-4545-8c23-456f04ca4b2a None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:19.328525 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd4e4b-d8dd-4bc8-b6bb-67a40df844ef None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:19.361705 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb65eeb-3796-4d37-a154-c3766704a8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:19.362386 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb65eeb-3796-4d37-a154-c3766704a8e4 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:19.362672 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb65eeb-3796-4d37-a154-c3766704a8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:19.362950 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb65eeb-3796-4d37-a154-c3766704a8e4 None admin] PATH_INFO: `/v3/users/968f85615605409fa32682eb49d42d66` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:19.378603 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb65eeb-3796-4d37-a154-c3766704a8e4 None admin] RBAC: Authorizing `identity:get_user(user_id=968f85615605409fa32682eb49d42d66)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:19.380067 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb65eeb-3796-4d37-a154-c3766704a8e4 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:19.382265 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 56/110] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Oct 13 10:57:19 2022] GET /identity/v3/users/968f85615605409fa32682eb49d42d66 => generated 289 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:19.383472 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2075e0-7ac6-48a8-933f-89ae97e8d65e None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:19.383763 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2075e0-7ac6-48a8-933f-89ae97e8d65e None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:19.384045 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2075e0-7ac6-48a8-933f-89ae97e8d65e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:19.396630 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f01a8c-57ff-4545-8c23-456f04ca4b2a None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:19.401409 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-2e2075e0-7ac6-48a8-933f-89ae97e8d65e None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:19.402615 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-2e2075e0-7ac6-48a8-933f-89ae97e8d65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:19.429399 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990a1aa-894e-459e-9946-3e8714f0d7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:19.430068 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990a1aa-894e-459e-9946-3e8714f0d7fb None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:19.430352 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990a1aa-894e-459e-9946-3e8714f0d7fb None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:19.430628 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990a1aa-894e-459e-9946-3e8714f0d7fb None admin] PATH_INFO: `/v3/users/88156daaeeb84adf93ec5b93ed8bb55e` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:19.431766 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1990a1aa-894e-459e-9946-3e8714f0d7fb None admin] RBAC: Authorizing `identity:get_user(user_id=88156daaeeb84adf93ec5b93ed8bb55e)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:19.433196 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1990a1aa-894e-459e-9946-3e8714f0d7fb None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:19.434806 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 55/111] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Oct 13 10:57:19 2022] GET /identity/v3/users/88156daaeeb84adf93ec5b93ed8bb55e => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:19.435642 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990a1aa-894e-459e-9946-3e8714f0d7fb None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:19.459345 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:19.465883 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:19.468645 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 57/112] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:57:19.469452 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2075e0-7ac6-48a8-933f-89ae97e8d65e None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:19.544663 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990a1aa-894e-459e-9946-3e8714f0d7fb None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:19.570989 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2075e0-7ac6-48a8-933f-89ae97e8d65e None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:19.577857 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95019ee2-4651-4d0b-a136-7c3a87fa2248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:19.578499 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95019ee2-4651-4d0b-a136-7c3a87fa2248 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:19.578841 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95019ee2-4651-4d0b-a136-7c3a87fa2248 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:19.579065 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95019ee2-4651-4d0b-a136-7c3a87fa2248 None admin] PATH_INFO: `/v3/users/f4dbe08e33ae4779a5bb51d82d216642` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:19.580189 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95019ee2-4651-4d0b-a136-7c3a87fa2248 None admin] RBAC: Authorizing `identity:get_user(user_id=f4dbe08e33ae4779a5bb51d82d216642)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:19.581625 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95019ee2-4651-4d0b-a136-7c3a87fa2248 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:19.583242 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 56/113] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Oct 13 10:57:19 2022] GET /identity/v3/users/f4dbe08e33ae4779a5bb51d82d216642 => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:19.583242 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95019ee2-4651-4d0b-a136-7c3a87fa2248 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:19.611867 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6106cdb6-370b-494a-9173-445fc5d4b49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:19.612730 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6106cdb6-370b-494a-9173-445fc5d4b49d None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:19.613302 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6106cdb6-370b-494a-9173-445fc5d4b49d None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:19.613649 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6106cdb6-370b-494a-9173-445fc5d4b49d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:19.615000 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6106cdb6-370b-494a-9173-445fc5d4b49d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:19.616441 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6106cdb6-370b-494a-9173-445fc5d4b49d None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:19.618275 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 58/114] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 10:57:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:19.619093 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6106cdb6-370b-494a-9173-445fc5d4b49d None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:19.682680 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:19.687415 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:19.689973 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95019ee2-4651-4d0b-a136-7c3a87fa2248 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:19.724802 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a351c38d-fdc9-4e8f-b524-5f3422b8a16d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:19.725437 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a351c38d-fdc9-4e8f-b524-5f3422b8a16d None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:19.725719 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a351c38d-fdc9-4e8f-b524-5f3422b8a16d None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:19.726034 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a351c38d-fdc9-4e8f-b524-5f3422b8a16d None admin] PATH_INFO: `/v3/projects/c72ae97522d241759a7f02e813ff1aab` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:19.727317 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a351c38d-fdc9-4e8f-b524-5f3422b8a16d None admin] RBAC: Authorizing `identity:get_project(project_id=c72ae97522d241759a7f02e813ff1aab)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:19.728923 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a351c38d-fdc9-4e8f-b524-5f3422b8a16d None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:19.730081 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6106cdb6-370b-494a-9173-445fc5d4b49d None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:19.730810 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 57/115] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Oct 13 10:57:19 2022] GET /identity/v3/projects/c72ae97522d241759a7f02e813ff1aab => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:19.736429 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a351c38d-fdc9-4e8f-b524-5f3422b8a16d None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:19.764648 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1148f493-91d9-483e-bfc1-d584c20c5330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:19.765263 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148f493-91d9-483e-bfc1-d584c20c5330 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:19.765544 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148f493-91d9-483e-bfc1-d584c20c5330 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:19.765816 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148f493-91d9-483e-bfc1-d584c20c5330 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:19.829824 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1148f493-91d9-483e-bfc1-d584c20c5330 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:19.831203 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1148f493-91d9-483e-bfc1-d584c20c5330 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:19.831712 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a351c38d-fdc9-4e8f-b524-5f3422b8a16d None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:19.865395 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba86e3-3762-4f5f-b876-875b999b8848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:19.866100 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba86e3-3762-4f5f-b876-875b999b8848 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:19.866384 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba86e3-3762-4f5f-b876-875b999b8848 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:19.866659 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba86e3-3762-4f5f-b876-875b999b8848 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:19.890864 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:19.897722 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:19.931484 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 59/116] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Oct 13 10:57:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 13 10:57:19.932299 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1148f493-91d9-483e-bfc1-d584c20c5330 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:19.939276 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ba86e3-3762-4f5f-b876-875b999b8848 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:19.940766 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ba86e3-3762-4f5f-b876-875b999b8848 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:20.027201 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1148f493-91d9-483e-bfc1-d584c20c5330 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:20.038300 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 58/117] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Oct 13 10:57:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 13 10:57:20.038300 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba86e3-3762-4f5f-b876-875b999b8848 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:20.060332 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c241ab-ebec-4876-b1c4-830303434998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:20.060945 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c241ab-ebec-4876-b1c4-830303434998 None admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:20.061228 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c241ab-ebec-4876-b1c4-830303434998 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:20.061503 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c241ab-ebec-4876-b1c4-830303434998 None admin] PATH_INFO: `/v3/projects` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:20.062188 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c241ab-ebec-4876-b1c4-830303434998 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:20.063643 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c241ab-ebec-4876-b1c4-830303434998 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:20.089214 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 60/118] 10.222.0.25 () {60 vars in 1141 bytes} [Thu Oct 13 10:57:19 2022] POST /identity/v3/projects => generated 302 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 10:57:20.090081 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c241ab-ebec-4876-b1c4-830303434998 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:20.107283 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:20.115459 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:20.163410 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba86e3-3762-4f5f-b876-875b999b8848 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:20.200571 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfec233-2234-4534-b181-2718339e7cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:20.201262 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfec233-2234-4534-b181-2718339e7cda None admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:20.201547 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfec233-2234-4534-b181-2718339e7cda None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:20.201830 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfec233-2234-4534-b181-2718339e7cda None admin] PATH_INFO: `/v3/projects/c72ae97522d241759a7f02e813ff1aab/users/968f85615605409fa32682eb49d42d66/roles/97c7067aa1ca411c9b8d3596c4d6abf6` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:20.203379 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c241ab-ebec-4876-b1c4-830303434998 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:20.203826 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfec233-2234-4534-b181-2718339e7cda None admin] RBAC: Authorizing `identity:create_grant(project_id=c72ae97522d241759a7f02e813ff1aab, user_id=968f85615605409fa32682eb49d42d66, role_id=97c7067aa1ca411c9b8d3596c4d6abf6)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:20.205309 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfec233-2234-4534-b181-2718339e7cda None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:20.220393 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 59/119] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Oct 13 10:57:20 2022] PUT /identity/v3/projects/c72ae97522d241759a7f02e813ff1aab/users/968f85615605409fa32682eb49d42d66/roles/97c7067aa1ca411c9b8d3596c4d6abf6 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 10:57:20.221257 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfec233-2234-4534-b181-2718339e7cda None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:20.260367 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4483d96-bf32-4362-a131-dc96cdd3e2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:20.261092 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4483d96-bf32-4362-a131-dc96cdd3e2ab None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:20.261388 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4483d96-bf32-4362-a131-dc96cdd3e2ab None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:20.261671 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4483d96-bf32-4362-a131-dc96cdd3e2ab None admin] PATH_INFO: `/v3/roles/member` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:20.279843 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4483d96-bf32-4362-a131-dc96cdd3e2ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:57:20.286536 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-c4483d96-bf32-4362-a131-dc96cdd3e2ab None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 13 10:57:20.286536 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:20.286536 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:57:20.286536 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:57:20.286536 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:57:20.286536 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:57:20.286536 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:57:20.286536 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:57:20.286536 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:57:20.286536 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:57:20.286536 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:57:20.286536 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:57:20.286536 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:57:20.286536 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:57:20.286536 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:57:20.286536 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:57:20.287514 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:57:20.287514 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:57:20.287514 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:57:20.287514 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:57:20.287514 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:57:20.287514 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:57:20.287514 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:57:20.287514 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:57:20.287514 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:57:20.287514 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:57:20.287514 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:57:20.287514 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:57:20.287514 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:57:20.287514 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:57:20.287514 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:57:20.287514 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:57:20.288303 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:57:20.288303 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:57:20.288303 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:57:20.288303 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:57:20.288303 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:57:20.288303 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:57:20.288303 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:57:20.288303 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:57:20.288303 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:57:20.288303 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:57:20.288303 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 13 10:57:20.288303 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:57:20.288303 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 61/120] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 10:57:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:57:20.288923 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4483d96-bf32-4362-a131-dc96cdd3e2ab None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:20.367195 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfec233-2234-4534-b181-2718339e7cda None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:20.391657 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:20.395754 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:20.414966 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c28008-1c70-4707-8a08-7a06036d8849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:20.415543 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c28008-1c70-4707-8a08-7a06036d8849 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:20.415827 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c28008-1c70-4707-8a08-7a06036d8849 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:20.416105 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c28008-1c70-4707-8a08-7a06036d8849 None admin] PATH_INFO: `/v3/projects/c72ae97522d241759a7f02e813ff1aab` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:20.417239 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c28008-1c70-4707-8a08-7a06036d8849 None admin] RBAC: Authorizing `identity:get_project(project_id=c72ae97522d241759a7f02e813ff1aab)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:20.418729 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c28008-1c70-4707-8a08-7a06036d8849 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:20.420527 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 60/121] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Oct 13 10:57:20 2022] GET /identity/v3/projects/c72ae97522d241759a7f02e813ff1aab => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:20.421142 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c28008-1c70-4707-8a08-7a06036d8849 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:20.423364 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4483d96-bf32-4362-a131-dc96cdd3e2ab None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:20.474942 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2367694f-8b35-4755-9f8c-df58c2ebc348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:20.475635 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2367694f-8b35-4755-9f8c-df58c2ebc348 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:20.476052 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2367694f-8b35-4755-9f8c-df58c2ebc348 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:20.476406 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2367694f-8b35-4755-9f8c-df58c2ebc348 None admin] PATH_INFO: `/v3/projects/c72ae97522d241759a7f02e813ff1aab` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:20.478139 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2367694f-8b35-4755-9f8c-df58c2ebc348 None admin] RBAC: Authorizing `identity:get_project(project_id=c72ae97522d241759a7f02e813ff1aab)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:20.480212 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2367694f-8b35-4755-9f8c-df58c2ebc348 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:20.482901 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 62/122] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Oct 13 10:57:20 2022] GET /identity/v3/projects/c72ae97522d241759a7f02e813ff1aab => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:20.483765 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2367694f-8b35-4755-9f8c-df58c2ebc348 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:20.540011 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c28008-1c70-4707-8a08-7a06036d8849 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:20.586246 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b01737-7f25-4e7f-af95-73415008eed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:20.586997 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b01737-7f25-4e7f-af95-73415008eed0 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:20.587347 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b01737-7f25-4e7f-af95-73415008eed0 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:20.587695 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b01737-7f25-4e7f-af95-73415008eed0 None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:20.588698 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b01737-7f25-4e7f-af95-73415008eed0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:20.589074 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b01737-7f25-4e7f-af95-73415008eed0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:20.591503 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b01737-7f25-4e7f-af95-73415008eed0 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:20.603293 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 61/123] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Oct 13 10:57:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:20.604665 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b01737-7f25-4e7f-af95-73415008eed0 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:20.609242 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2367694f-8b35-4755-9f8c-df58c2ebc348 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:20.650005 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d6c87a-8783-40c1-a025-c8832a60565e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:20.650942 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d6c87a-8783-40c1-a025-c8832a60565e None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:20.651420 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d6c87a-8783-40c1-a025-c8832a60565e None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:20.651955 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d6c87a-8783-40c1-a025-c8832a60565e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:20.652880 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d6c87a-8783-40c1-a025-c8832a60565e None admin] RBAC: Adding query filter params (role.id=84a5ec3770b4453bb7c3ff5b9af0bd17, scope.project.id=c72ae97522d241759a7f02e813ff1aab, user.id=88156daaeeb84adf93ec5b93ed8bb55e) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:20.653406 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d6c87a-8783-40c1-a025-c8832a60565e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:20.655081 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d6c87a-8783-40c1-a025-c8832a60565e None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:20.661572 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 63/124] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Oct 13 10:57:20 2022] GET /identity/v3/role_assignments?user.id=88156daaeeb84adf93ec5b93ed8bb55e&scope.project.id=c72ae97522d241759a7f02e813ff1aab&role.id=84a5ec3770b4453bb7c3ff5b9af0bd17 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:20.662679 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d6c87a-8783-40c1-a025-c8832a60565e None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:20.673103 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:20.714332 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:20.769833 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b01737-7f25-4e7f-af95-73415008eed0 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:20.840717 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a47c7b4-6dd1-4a58-b57b-ac224a5892e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:20.841803 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d6c87a-8783-40c1-a025-c8832a60565e None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:20.842713 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a47c7b4-6dd1-4a58-b57b-ac224a5892e5 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:20.844655 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a47c7b4-6dd1-4a58-b57b-ac224a5892e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:20.845134 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a47c7b4-6dd1-4a58-b57b-ac224a5892e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:20.846164 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a47c7b4-6dd1-4a58-b57b-ac224a5892e5 None admin] RBAC: Adding query filter params (role.id=ea564961b1db4eb4a1d4d880964611b2, scope.project.id=c72ae97522d241759a7f02e813ff1aab, user.id=f4dbe08e33ae4779a5bb51d82d216642) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:20.846901 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a47c7b4-6dd1-4a58-b57b-ac224a5892e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:20.849985 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a47c7b4-6dd1-4a58-b57b-ac224a5892e5 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:20.859010 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 62/125] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Oct 13 10:57:20 2022] GET /identity/v3/role_assignments?user.id=f4dbe08e33ae4779a5bb51d82d216642&scope.project.id=c72ae97522d241759a7f02e813ff1aab&role.id=ea564961b1db4eb4a1d4d880964611b2 => generated 608 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:20.899160 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157cd904-701b-40dc-ae02-d6114f553bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:20.899829 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157cd904-701b-40dc-ae02-d6114f553bb7 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:20.900172 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157cd904-701b-40dc-ae02-d6114f553bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:20.900398 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157cd904-701b-40dc-ae02-d6114f553bb7 None admin] PATH_INFO: `/v3/users/88156daaeeb84adf93ec5b93ed8bb55e` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:20.902919 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157cd904-701b-40dc-ae02-d6114f553bb7 None admin] RBAC: Authorizing `identity:get_user(user_id=88156daaeeb84adf93ec5b93ed8bb55e)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:20.904412 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157cd904-701b-40dc-ae02-d6114f553bb7 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:20.906316 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 64/126] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Oct 13 10:57:20 2022] GET /identity/v3/users/88156daaeeb84adf93ec5b93ed8bb55e => generated 275 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:20.912579 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a47c7b4-6dd1-4a58-b57b-ac224a5892e5 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:21.040231 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a47c7b4-6dd1-4a58-b57b-ac224a5892e5 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:21.062625 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:21.083966 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e587b096-38a7-47c3-b912-fe3289f69f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:21.084591 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587b096-38a7-47c3-b912-fe3289f69f50 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:21.084880 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587b096-38a7-47c3-b912-fe3289f69f50 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:21.085163 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587b096-38a7-47c3-b912-fe3289f69f50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:21.162071 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e587b096-38a7-47c3-b912-fe3289f69f50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:21.163467 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e587b096-38a7-47c3-b912-fe3289f69f50 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:21.265356 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 63/127] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Oct 13 10:57:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 13 10:57:21.271463 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157cd904-701b-40dc-ae02-d6114f553bb7 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:21.344704 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:21.371275 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157cd904-701b-40dc-ae02-d6114f553bb7 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:21.404264 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b527c6da-f708-4274-be3b-74e522ac4b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:21.404902 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527c6da-f708-4274-be3b-74e522ac4b35 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:21.405185 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527c6da-f708-4274-be3b-74e522ac4b35 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:21.405460 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527c6da-f708-4274-be3b-74e522ac4b35 None admin] PATH_INFO: `/v3/projects/d448380eda784fbca180941263df0245` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:21.406596 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b527c6da-f708-4274-be3b-74e522ac4b35 None admin] RBAC: Authorizing `identity:get_project(project_id=d448380eda784fbca180941263df0245)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:21.408040 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b527c6da-f708-4274-be3b-74e522ac4b35 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:21.409802 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 65/128] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Oct 13 10:57:21 2022] GET /identity/v3/projects/d448380eda784fbca180941263df0245 => generated 312 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:21.416086 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e587b096-38a7-47c3-b912-fe3289f69f50 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:21.433924 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:21.520632 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e587b096-38a7-47c3-b912-fe3289f69f50 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:21.554910 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11446b9d-70be-4312-a3f5-b02a4a6f69dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:21.555525 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11446b9d-70be-4312-a3f5-b02a4a6f69dc None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:21.555809 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11446b9d-70be-4312-a3f5-b02a4a6f69dc None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:21.556089 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11446b9d-70be-4312-a3f5-b02a4a6f69dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:21.556824 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11446b9d-70be-4312-a3f5-b02a4a6f69dc None admin] RBAC: Adding query filter params (role.id=7c3871c0ab68438b9014489d50b53a22, scope.project.id=d448380eda784fbca180941263df0245, user.id=88156daaeeb84adf93ec5b93ed8bb55e) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:21.557143 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11446b9d-70be-4312-a3f5-b02a4a6f69dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:21.558625 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11446b9d-70be-4312-a3f5-b02a4a6f69dc None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:21.564451 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 64/129] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Oct 13 10:57:21 2022] GET /identity/v3/role_assignments?user.id=88156daaeeb84adf93ec5b93ed8bb55e&scope.project.id=d448380eda784fbca180941263df0245&role.id=7c3871c0ab68438b9014489d50b53a22 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:22.395138 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a32f37-548c-4c64-a098-32b0e2d3a637 None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:22.395677 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a32f37-548c-4c64-a098-32b0e2d3a637 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:22.395760 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a32f37-548c-4c64-a098-32b0e2d3a637 None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:22.397360 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 66/130] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:57:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:22.403516 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ad16f-0476-439b-b43d-818bfaf3447b None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:22.404012 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ad16f-0476-439b-b43d-818bfaf3447b None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:22.404199 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ad16f-0476-439b-b43d-818bfaf3447b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:22.422755 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-406ad16f-0476-439b-b43d-818bfaf3447b None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:22.423940 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-406ad16f-0476-439b-b43d-818bfaf3447b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:22.490278 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 65/131] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:57:22.501147 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900cf506-b0d1-452f-b378-61a04e4efe18 None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:22.501519 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900cf506-b0d1-452f-b378-61a04e4efe18 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:22.501881 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900cf506-b0d1-452f-b378-61a04e4efe18 None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:22.503322 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 67/132] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:57:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 10:57:22.508539 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a382e5-ab95-4774-8924-d70d1645ad16 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:22.508826 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a382e5-ab95-4774-8924-d70d1645ad16 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:22.509107 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a382e5-ab95-4774-8924-d70d1645ad16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:22.526365 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-e8a382e5-ab95-4774-8924-d70d1645ad16 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:22.527526 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-e8a382e5-ab95-4774-8924-d70d1645ad16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:22.530157 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:22.590670 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 66/133] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:57:22.758727 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900cf506-b0d1-452f-b378-61a04e4efe18 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:22.855688 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900cf506-b0d1-452f-b378-61a04e4efe18 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:22.859978 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a382e5-ab95-4774-8924-d70d1645ad16 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:22.889615 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f741e3c-d750-4c00-acf5-a24505fcffa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:22.890604 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f741e3c-d750-4c00-acf5-a24505fcffa2 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:22.890604 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f741e3c-d750-4c00-acf5-a24505fcffa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:22.890762 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f741e3c-d750-4c00-acf5-a24505fcffa2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:22.891839 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f741e3c-d750-4c00-acf5-a24505fcffa2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:22.893273 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f741e3c-d750-4c00-acf5-a24505fcffa2 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:22.894859 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 68/134] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 10:57:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:22.900689 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f741e3c-d750-4c00-acf5-a24505fcffa2 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:22.913301 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:22.961307 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a382e5-ab95-4774-8924-d70d1645ad16 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:22.994305 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d182a-234c-4d84-8e73-9119fe8a554f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:22.994936 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d182a-234c-4d84-8e73-9119fe8a554f None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:22.995215 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d182a-234c-4d84-8e73-9119fe8a554f None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:22.995490 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d182a-234c-4d84-8e73-9119fe8a554f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:22.997177 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f741e3c-d750-4c00-acf5-a24505fcffa2 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:23.002663 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:23.005842 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386d182a-234c-4d84-8e73-9119fe8a554f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:57:23.010893 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-386d182a-234c-4d84-8e73-9119fe8a554f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 13 10:57:23.010893 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:23.010893 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:57:23.010893 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:57:23.010893 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:57:23.010893 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:57:23.010893 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:57:23.010893 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:57:23.010893 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:57:23.010893 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:57:23.010893 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:57:23.010893 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:57:23.010893 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:57:23.010893 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:57:23.010893 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:57:23.010893 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:57:23.011908 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:57:23.011908 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:57:23.011908 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:57:23.011908 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:57:23.011908 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:57:23.011908 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:57:23.011908 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:57:23.011908 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:57:23.011908 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:57:23.011908 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:57:23.011908 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:57:23.011908 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 10:57:23.011908 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:57:23.011908 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:57:23.011908 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:57:23.011908 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:57:23.012698 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:57:23.012698 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:57:23.012698 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:57:23.012698 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:57:23.012698 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:57:23.012698 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:57:23.012698 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:57:23.012698 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:57:23.012698 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:57:23.012698 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:57:23.012698 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 13 10:57:23.012698 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:57:23.012698 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 67/135] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 10:57:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 10:57:23.017820 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d182a-234c-4d84-8e73-9119fe8a554f None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:23.032569 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed89b573-967a-4c45-8756-ea0cf7d8d306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:23.033181 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed89b573-967a-4c45-8756-ea0cf7d8d306 None admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:23.033456 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed89b573-967a-4c45-8756-ea0cf7d8d306 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:23.033726 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed89b573-967a-4c45-8756-ea0cf7d8d306 None admin] PATH_INFO: `/v3/users` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:23.034399 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed89b573-967a-4c45-8756-ea0cf7d8d306 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:23.035838 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed89b573-967a-4c45-8756-ea0cf7d8d306 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:23.056188 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 69/136] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Oct 13 10:57:22 2022] POST /identity/v3/users => generated 283 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 10:57:23.120794 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d182a-234c-4d84-8e73-9119fe8a554f None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:23.155682 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8088cf33-19c9-4c2e-8ead-9d59e395479b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:23.156300 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8088cf33-19c9-4c2e-8ead-9d59e395479b None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:23.156584 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8088cf33-19c9-4c2e-8ead-9d59e395479b None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:23.156862 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8088cf33-19c9-4c2e-8ead-9d59e395479b None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:23.157547 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8088cf33-19c9-4c2e-8ead-9d59e395479b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:23.157858 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8088cf33-19c9-4c2e-8ead-9d59e395479b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:23.159313 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8088cf33-19c9-4c2e-8ead-9d59e395479b None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:23.168565 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 68/137] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Oct 13 10:57:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:57:23.174673 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed89b573-967a-4c45-8756-ea0cf7d8d306 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:23.243105 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:23.280852 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed89b573-967a-4c45-8756-ea0cf7d8d306 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:23.314440 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fda4bf2-ac2c-4ef6-a679-63a374342943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:23.315080 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda4bf2-ac2c-4ef6-a679-63a374342943 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:23.315417 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda4bf2-ac2c-4ef6-a679-63a374342943 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:23.315702 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda4bf2-ac2c-4ef6-a679-63a374342943 None admin] PATH_INFO: `/v3/users/968f85615605409fa32682eb49d42d66` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:23.316949 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fda4bf2-ac2c-4ef6-a679-63a374342943 None admin] RBAC: Authorizing `identity:get_user(user_id=968f85615605409fa32682eb49d42d66)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:23.318459 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fda4bf2-ac2c-4ef6-a679-63a374342943 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:23.320024 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 70/138] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Oct 13 10:57:23 2022] GET /identity/v3/users/968f85615605409fa32682eb49d42d66 => generated 289 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:23.325642 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8088cf33-19c9-4c2e-8ead-9d59e395479b None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:23.391830 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:23.434699 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8088cf33-19c9-4c2e-8ead-9d59e395479b None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:23.470058 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503f5124-effc-475c-8dcb-177a9fbda7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:23.470711 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f5124-effc-475c-8dcb-177a9fbda7d8 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:23.471056 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f5124-effc-475c-8dcb-177a9fbda7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:23.471344 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f5124-effc-475c-8dcb-177a9fbda7d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:23.547316 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503f5124-effc-475c-8dcb-177a9fbda7d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:23.549070 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503f5124-effc-475c-8dcb-177a9fbda7d8 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:23.612697 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:23.655174 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 69/139] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Oct 13 10:57:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 13 10:57:23.661044 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fda4bf2-ac2c-4ef6-a679-63a374342943 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:23.761400 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fda4bf2-ac2c-4ef6-a679-63a374342943 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:23.797101 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0c6044-ffe3-43f2-99ec-f5839db739a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:23.797811 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c6044-ffe3-43f2-99ec-f5839db739a1 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:23.798075 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c6044-ffe3-43f2-99ec-f5839db739a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:23.798355 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c6044-ffe3-43f2-99ec-f5839db739a1 None admin] PATH_INFO: `/v3/projects/c72ae97522d241759a7f02e813ff1aab` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:23.799497 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0c6044-ffe3-43f2-99ec-f5839db739a1 None admin] RBAC: Authorizing `identity:get_project(project_id=c72ae97522d241759a7f02e813ff1aab)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:23.800956 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0c6044-ffe3-43f2-99ec-f5839db739a1 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:23.803032 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 71/140] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Oct 13 10:57:23 2022] GET /identity/v3/projects/c72ae97522d241759a7f02e813ff1aab => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:23.811233 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503f5124-effc-475c-8dcb-177a9fbda7d8 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:23.920394 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503f5124-effc-475c-8dcb-177a9fbda7d8 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:23.954534 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4238ad4-947c-4877-b5d1-40755632c18c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:23.955188 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4238ad4-947c-4877-b5d1-40755632c18c None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:23.955522 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4238ad4-947c-4877-b5d1-40755632c18c None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:23.955804 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4238ad4-947c-4877-b5d1-40755632c18c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:23.956578 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4238ad4-947c-4877-b5d1-40755632c18c None admin] RBAC: Adding query filter params (role.id=97c7067aa1ca411c9b8d3596c4d6abf6, scope.project.id=c72ae97522d241759a7f02e813ff1aab, user.id=968f85615605409fa32682eb49d42d66) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:23.956895 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4238ad4-947c-4877-b5d1-40755632c18c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:23.958444 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4238ad4-947c-4877-b5d1-40755632c18c None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:23.964552 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 70/141] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Oct 13 10:57:23 2022] GET /identity/v3/role_assignments?user.id=968f85615605409fa32682eb49d42d66&scope.project.id=c72ae97522d241759a7f02e813ff1aab&role.id=97c7067aa1ca411c9b8d3596c4d6abf6 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:25.298649 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5700a5-b678-4d7b-bd2d-a4d239acc62b None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:25.299201 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5700a5-b678-4d7b-bd2d-a4d239acc62b None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:25.299201 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5700a5-b678-4d7b-bd2d-a4d239acc62b None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:25.300522 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 72/142] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:57:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:25.305972 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331bc38-2e06-4171-8ab4-4888c0500eca None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:25.306388 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331bc38-2e06-4171-8ab4-4888c0500eca None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:25.306563 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331bc38-2e06-4171-8ab4-4888c0500eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:25.324806 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-9331bc38-2e06-4171-8ab4-4888c0500eca None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:25.326018 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-9331bc38-2e06-4171-8ab4-4888c0500eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:25.347132 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:25.399635 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 71/143] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 13 10:57:25.483384 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb2b8f-0cad-4fd7-bca4-2e2d4b428868 None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:25.483669 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb2b8f-0cad-4fd7-bca4-2e2d4b428868 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:25.484106 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb2b8f-0cad-4fd7-bca4-2e2d4b428868 None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:25.485712 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 73/144] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:57:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:25.492145 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21857a0c-b028-465f-ab66-416a676459eb None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:25.492689 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21857a0c-b028-465f-ab66-416a676459eb None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:25.493116 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21857a0c-b028-465f-ab66-416a676459eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:25.514748 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-21857a0c-b028-465f-ab66-416a676459eb None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:25.516206 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-21857a0c-b028-465f-ab66-416a676459eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:25.582157 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 72/145] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:57:25.604817 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1972aae6-c511-4b0c-bd60-53eec9b4cd38 None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:25.605103 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1972aae6-c511-4b0c-bd60-53eec9b4cd38 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:25.605375 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1972aae6-c511-4b0c-bd60-53eec9b4cd38 None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:25.606768 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 74/146] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:57:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:25.612070 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a79735-9aa4-4d05-a61c-4dec9133d0ba None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:25.612361 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a79735-9aa4-4d05-a61c-4dec9133d0ba None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:25.612636 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a79735-9aa4-4d05-a61c-4dec9133d0ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:25.630614 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-28a79735-9aa4-4d05-a61c-4dec9133d0ba None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:25.631840 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-28a79735-9aa4-4d05-a61c-4dec9133d0ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:25.669145 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1972aae6-c511-4b0c-bd60-53eec9b4cd38 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:25.671970 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:25.706221 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 73/147] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:57:25.768768 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1972aae6-c511-4b0c-bd60-53eec9b4cd38 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:25.801947 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469714cf-3e92-407f-b167-1ffd674b3aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:25.802594 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469714cf-3e92-407f-b167-1ffd674b3aac None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:25.802875 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469714cf-3e92-407f-b167-1ffd674b3aac None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:25.803146 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469714cf-3e92-407f-b167-1ffd674b3aac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:25.812890 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469714cf-3e92-407f-b167-1ffd674b3aac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:57:25.817721 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-469714cf-3e92-407f-b167-1ffd674b3aac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 10:57:25.817721 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:25.817721 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:57:25.817721 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:57:25.817721 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:57:25.817721 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:57:25.817721 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:57:25.817721 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:57:25.817721 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:57:25.817721 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:57:25.817721 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:57:25.817721 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:57:25.817721 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:57:25.817721 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:57:25.817721 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:57:25.817721 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:57:25.818588 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:57:25.818588 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:57:25.818588 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:57:25.818588 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:57:25.818588 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:57:25.818588 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:57:25.818588 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:57:25.818588 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:57:25.818588 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:57:25.818588 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:57:25.818588 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:57:25.818588 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:57:25.818588 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:57:25.818588 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:57:25.818588 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:57:25.818588 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:57:25.819447 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:57:25.819447 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:57:25.819447 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:57:25.819447 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:57:25.819447 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:57:25.819447 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:57:25.819447 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:57:25.819447 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:57:25.819447 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:57:25.819447 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:57:25.819447 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 10:57:25.819447 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:57:25.819447 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 75/148] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Oct 13 10:57:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 10:57:25.826072 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a79735-9aa4-4d05-a61c-4dec9133d0ba None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:25.843861 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:25.851364 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469714cf-3e92-407f-b167-1ffd674b3aac None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:25.920924 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:25.930198 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a79735-9aa4-4d05-a61c-4dec9133d0ba None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:25.960062 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469714cf-3e92-407f-b167-1ffd674b3aac None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:25.963024 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d4ea4-5d6d-4c1c-b357-6081875a24c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:25.963630 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d4ea4-5d6d-4c1c-b357-6081875a24c9 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:25.963910 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d4ea4-5d6d-4c1c-b357-6081875a24c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:25.964186 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d4ea4-5d6d-4c1c-b357-6081875a24c9 None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:25.964851 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972d4ea4-5d6d-4c1c-b357-6081875a24c9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:25.965155 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972d4ea4-5d6d-4c1c-b357-6081875a24c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:25.966559 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972d4ea4-5d6d-4c1c-b357-6081875a24c9 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:25.974655 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 74/149] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 10:57:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:25.975440 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d4ea4-5d6d-4c1c-b357-6081875a24c9 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:25.994051 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ab8d2-1b7b-49ea-a68b-d6b5ac191903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:25.994676 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ab8d2-1b7b-49ea-a68b-d6b5ac191903 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:25.994955 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ab8d2-1b7b-49ea-a68b-d6b5ac191903 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:25.995223 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ab8d2-1b7b-49ea-a68b-d6b5ac191903 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:26.005292 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3ab8d2-1b7b-49ea-a68b-d6b5ac191903 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:57:26.010151 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-ee3ab8d2-1b7b-49ea-a68b-d6b5ac191903 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 13 10:57:26.010151 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:26.010151 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:57:26.010151 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:57:26.010151 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:57:26.010151 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:57:26.010151 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:57:26.010151 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:57:26.010151 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:57:26.010151 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:57:26.010151 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:57:26.010151 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:57:26.010151 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:57:26.010151 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:57:26.010151 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:57:26.010151 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:57:26.011194 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:57:26.011194 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:57:26.011194 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:57:26.011194 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:57:26.011194 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:57:26.011194 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:57:26.011194 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:57:26.011194 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:57:26.011194 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:57:26.011194 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:57:26.011194 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:57:26.011194 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:57:26.011194 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:57:26.011194 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:57:26.011194 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:57:26.011194 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:57:26.012094 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:57:26.012094 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:57:26.012094 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:57:26.012094 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:57:26.012094 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:57:26.012094 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:57:26.012094 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:57:26.012094 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:57:26.012094 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:57:26.012094 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:57:26.012094 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 13 10:57:26.012094 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:57:26.012094 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 76/150] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Oct 13 10:57:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 10:57:26.012094 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ab8d2-1b7b-49ea-a68b-d6b5ac191903 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:26.055776 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:26.077309 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d4ea4-5d6d-4c1c-b357-6081875a24c9 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:26.110789 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8ffa36-145b-43a0-8fd3-e8521848ef03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:26.111458 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ab8d2-1b7b-49ea-a68b-d6b5ac191903 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:26.111593 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ffa36-145b-43a0-8fd3-e8521848ef03 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:26.111870 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ffa36-145b-43a0-8fd3-e8521848ef03 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:26.112137 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ffa36-145b-43a0-8fd3-e8521848ef03 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:26.113226 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8ffa36-145b-43a0-8fd3-e8521848ef03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:26.114773 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8ffa36-145b-43a0-8fd3-e8521848ef03 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:26.116317 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 75/151] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 10:57:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:26.118201 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8ffa36-145b-43a0-8fd3-e8521848ef03 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:26.133876 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:26.146153 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e0b39b-9598-4536-aedd-387fc4962a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:26.146778 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e0b39b-9598-4536-aedd-387fc4962a93 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:26.147051 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e0b39b-9598-4536-aedd-387fc4962a93 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:26.147323 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e0b39b-9598-4536-aedd-387fc4962a93 None admin] PATH_INFO: `/v3/users/fc041c76082e476580c705c5cd2cc672` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:26.160467 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e0b39b-9598-4536-aedd-387fc4962a93 None admin] RBAC: Authorizing `identity:get_user(user_id=fc041c76082e476580c705c5cd2cc672)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:26.162480 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e0b39b-9598-4536-aedd-387fc4962a93 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:26.164056 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 77/152] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Oct 13 10:57:26 2022] GET /identity/v3/users/fc041c76082e476580c705c5cd2cc672 => generated 283 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:26.164799 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e0b39b-9598-4536-aedd-387fc4962a93 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:26.215250 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8ffa36-145b-43a0-8fd3-e8521848ef03 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:26.247989 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eabf6d8-781a-4921-823c-efb932501c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:26.248592 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eabf6d8-781a-4921-823c-efb932501c10 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:26.248887 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eabf6d8-781a-4921-823c-efb932501c10 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:26.249136 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eabf6d8-781a-4921-823c-efb932501c10 None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:26.249793 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eabf6d8-781a-4921-823c-efb932501c10 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:26.250122 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eabf6d8-781a-4921-823c-efb932501c10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:26.251477 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eabf6d8-781a-4921-823c-efb932501c10 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:26.259217 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 76/153] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Oct 13 10:57:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:26.263720 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e0b39b-9598-4536-aedd-387fc4962a93 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:26.263829 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eabf6d8-781a-4921-823c-efb932501c10 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:26.270262 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:26.294409 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c99bf3-769b-4814-b444-4f119521690e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:26.295011 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c99bf3-769b-4814-b444-4f119521690e None admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:26.295287 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c99bf3-769b-4814-b444-4f119521690e None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:26.295556 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c99bf3-769b-4814-b444-4f119521690e None admin] PATH_INFO: `/v3/users` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:26.296203 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c99bf3-769b-4814-b444-4f119521690e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:26.297611 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c99bf3-769b-4814-b444-4f119521690e None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:26.318889 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 78/154] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Oct 13 10:57:26 2022] POST /identity/v3/users => generated 297 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 10:57:26.319653 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c99bf3-769b-4814-b444-4f119521690e None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:26.363799 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:26.368141 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eabf6d8-781a-4921-823c-efb932501c10 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:26.402777 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a63163-2cc1-460a-aad0-df9f933b73bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:26.403537 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a63163-2cc1-460a-aad0-df9f933b73bc None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:26.403828 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a63163-2cc1-460a-aad0-df9f933b73bc None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:26.404089 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a63163-2cc1-460a-aad0-df9f933b73bc None admin] PATH_INFO: `/v3/projects/c32dd153f5284943a7a036275c792a45` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:26.405293 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a63163-2cc1-460a-aad0-df9f933b73bc None admin] RBAC: Authorizing `identity:get_project(project_id=c32dd153f5284943a7a036275c792a45)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:26.406785 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a63163-2cc1-460a-aad0-df9f933b73bc None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:26.409056 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 77/155] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Oct 13 10:57:26 2022] GET /identity/v3/projects/c32dd153f5284943a7a036275c792a45 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:26.415241 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a63163-2cc1-460a-aad0-df9f933b73bc None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:26.445295 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c99bf3-769b-4814-b444-4f119521690e None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:26.482798 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b0d37-b624-4557-a3f7-ed9b4035d3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:26.483448 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b0d37-b624-4557-a3f7-ed9b4035d3d5 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:26.483725 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b0d37-b624-4557-a3f7-ed9b4035d3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:26.484057 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b0d37-b624-4557-a3f7-ed9b4035d3d5 None admin] PATH_INFO: `/v3/users/fc041c76082e476580c705c5cd2cc672` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:26.485292 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145b0d37-b624-4557-a3f7-ed9b4035d3d5 None admin] RBAC: Authorizing `identity:get_user(user_id=fc041c76082e476580c705c5cd2cc672)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:26.487034 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145b0d37-b624-4557-a3f7-ed9b4035d3d5 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:26.488618 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 79/156] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Oct 13 10:57:26 2022] GET /identity/v3/users/fc041c76082e476580c705c5cd2cc672 => generated 283 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:26.494731 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b0d37-b624-4557-a3f7-ed9b4035d3d5 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:26.502688 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:26.536046 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a63163-2cc1-460a-aad0-df9f933b73bc None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:26.574647 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a9f24-fcf5-4351-80a6-6621b94f7365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:26.575312 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a9f24-fcf5-4351-80a6-6621b94f7365 None admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:26.575592 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a9f24-fcf5-4351-80a6-6621b94f7365 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:26.575862 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a9f24-fcf5-4351-80a6-6621b94f7365 None admin] PATH_INFO: `/v3/projects/c32dd153f5284943a7a036275c792a45/users/fc041c76082e476580c705c5cd2cc672/roles/ea564961b1db4eb4a1d4d880964611b2` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:26.578755 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7a9f24-fcf5-4351-80a6-6621b94f7365 None admin] RBAC: Authorizing `identity:create_grant(project_id=c32dd153f5284943a7a036275c792a45, user_id=fc041c76082e476580c705c5cd2cc672, role_id=ea564961b1db4eb4a1d4d880964611b2)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:26.580227 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7a9f24-fcf5-4351-80a6-6621b94f7365 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:26.599165 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 78/157] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Oct 13 10:57:26 2022] PUT /identity/v3/projects/c32dd153f5284943a7a036275c792a45/users/fc041c76082e476580c705c5cd2cc672/roles/ea564961b1db4eb4a1d4d880964611b2 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 10:57:26.617329 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b0d37-b624-4557-a3f7-ed9b4035d3d5 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:26.620654 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:26.662515 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8337ac-e4a8-437c-ba1c-09beca68f072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:26.663211 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8337ac-e4a8-437c-ba1c-09beca68f072 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:26.663493 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8337ac-e4a8-437c-ba1c-09beca68f072 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:26.663761 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8337ac-e4a8-437c-ba1c-09beca68f072 None admin] PATH_INFO: `/v3/projects/c32dd153f5284943a7a036275c792a45` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:26.666155 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8337ac-e4a8-437c-ba1c-09beca68f072 None admin] RBAC: Authorizing `identity:get_project(project_id=c32dd153f5284943a7a036275c792a45)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:26.667297 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8337ac-e4a8-437c-ba1c-09beca68f072 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:26.669385 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 80/158] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Oct 13 10:57:26 2022] GET /identity/v3/projects/c32dd153f5284943a7a036275c792a45 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:57:26.674933 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a9f24-fcf5-4351-80a6-6621b94f7365 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:26.792439 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a9f24-fcf5-4351-80a6-6621b94f7365 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:26.826202 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0d1117-60da-4462-a776-87dd05b44983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:26.826866 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d1117-60da-4462-a776-87dd05b44983 None admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:26.827140 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d1117-60da-4462-a776-87dd05b44983 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:26.827467 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d1117-60da-4462-a776-87dd05b44983 None admin] PATH_INFO: `/v3/projects/c32dd153f5284943a7a036275c792a45/users/fc041c76082e476580c705c5cd2cc672/roles/84a5ec3770b4453bb7c3ff5b9af0bd17` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:26.829707 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0d1117-60da-4462-a776-87dd05b44983 None admin] RBAC: Authorizing `identity:create_grant(project_id=c32dd153f5284943a7a036275c792a45, user_id=fc041c76082e476580c705c5cd2cc672, role_id=84a5ec3770b4453bb7c3ff5b9af0bd17)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:26.831256 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0d1117-60da-4462-a776-87dd05b44983 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:26.837101 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:26.848241 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 79/159] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Oct 13 10:57:26 2022] PUT /identity/v3/projects/c32dd153f5284943a7a036275c792a45/users/fc041c76082e476580c705c5cd2cc672/roles/84a5ec3770b4453bb7c3ff5b9af0bd17 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 10:57:28.611125 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7d2e3-1281-4e8f-a4aa-22b44ed7f697 None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:28.611936 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7d2e3-1281-4e8f-a4aa-22b44ed7f697 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:28.611936 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7d2e3-1281-4e8f-a4aa-22b44ed7f697 None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:28.613393 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 81/160] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:57:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:28.618538 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b13699-6d73-450c-b3cf-2bd1f48bf580 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:28.618939 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b13699-6d73-450c-b3cf-2bd1f48bf580 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:28.619120 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b13699-6d73-450c-b3cf-2bd1f48bf580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:28.637797 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-69b13699-6d73-450c-b3cf-2bd1f48bf580 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:28.639035 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-69b13699-6d73-450c-b3cf-2bd1f48bf580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:28.715970 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 80/161] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:57:28.775534 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102229f9-bf39-4a24-b865-8f4386dbc41e None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:28.775831 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102229f9-bf39-4a24-b865-8f4386dbc41e None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:28.776092 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102229f9-bf39-4a24-b865-8f4386dbc41e None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:28.777430 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 82/162] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:57:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:28.782599 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555c1e3-8a40-4824-a737-b966c7eb23f7 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:28.782890 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555c1e3-8a40-4824-a737-b966c7eb23f7 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:28.783164 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555c1e3-8a40-4824-a737-b966c7eb23f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:28.799990 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e541db4-58ad-42a9-bc11-f57d46f53f02 None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:28.800298 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e541db4-58ad-42a9-bc11-f57d46f53f02 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:28.800541 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e541db4-58ad-42a9-bc11-f57d46f53f02 None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:28.802588 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 83/163] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:57:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 10:57:28.806918 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-1555c1e3-8a40-4824-a737-b966c7eb23f7 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:28.807239 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a4f3fc-6574-451c-9a3f-1cee336e44d8 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:28.807525 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a4f3fc-6574-451c-9a3f-1cee336e44d8 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:28.807801 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a4f3fc-6574-451c-9a3f-1cee336e44d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:28.809004 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-1555c1e3-8a40-4824-a737-b966c7eb23f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:28.826306 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-a7a4f3fc-6574-451c-9a3f-1cee336e44d8 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:28.827492 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-a7a4f3fc-6574-451c-9a3f-1cee336e44d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:28.888589 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 81/164] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:57:28.915123 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 84/165] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 13 10:57:29.005086 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1555c1e3-8a40-4824-a737-b966c7eb23f7 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:29.026814 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c34245-3b93-4d2d-a734-11a1b43f0096 None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:29.027124 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c34245-3b93-4d2d-a734-11a1b43f0096 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:29.027368 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c34245-3b93-4d2d-a734-11a1b43f0096 None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:29.029158 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 85/166] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:57:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:29.035512 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a2bba-d50e-4272-bf6a-10c4d01a0ee1 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:29.035794 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a2bba-d50e-4272-bf6a-10c4d01a0ee1 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:29.036420 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a2bba-d50e-4272-bf6a-10c4d01a0ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:29.058526 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-176a2bba-d50e-4272-bf6a-10c4d01a0ee1 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:29.059704 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-176a2bba-d50e-4272-bf6a-10c4d01a0ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:29.066281 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:29.108101 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1555c1e3-8a40-4824-a737-b966c7eb23f7 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:29.145667 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 86/167] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:57:29.150674 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c87dc8-f52c-4330-98ba-50af2c1245c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:29.151550 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c87dc8-f52c-4330-98ba-50af2c1245c7 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:29.152026 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c87dc8-f52c-4330-98ba-50af2c1245c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:29.152494 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c87dc8-f52c-4330-98ba-50af2c1245c7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:29.158547 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176a2bba-d50e-4272-bf6a-10c4d01a0ee1 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:29.166076 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c87dc8-f52c-4330-98ba-50af2c1245c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:57:29.171337 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-15c87dc8-f52c-4330-98ba-50af2c1245c7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 13 10:57:29.171337 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:29.171337 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:57:29.171337 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:57:29.171337 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:57:29.171337 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:57:29.171337 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:57:29.171337 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:57:29.171337 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:57:29.171337 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:57:29.171337 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:57:29.171337 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:57:29.171337 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:57:29.171337 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:57:29.171337 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:57:29.171337 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:57:29.172274 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:57:29.172274 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:57:29.172274 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:57:29.172274 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:57:29.172274 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:57:29.172274 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:57:29.172274 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:57:29.172274 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:57:29.172274 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:57:29.172274 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:57:29.172274 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:57:29.172274 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 10:57:29.172274 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:57:29.172274 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:57:29.172274 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:57:29.172274 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:57:29.173039 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:57:29.173039 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:57:29.173039 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:57:29.173039 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:57:29.173039 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:57:29.173039 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:57:29.173039 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:57:29.173039 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:57:29.173039 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:57:29.173039 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:57:29.173039 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 13 10:57:29.173039 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:57:29.173039 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 82/168] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 10:57:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:57:29.180176 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c87dc8-f52c-4330-98ba-50af2c1245c7 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:29.193912 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:29.261610 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176a2bba-d50e-4272-bf6a-10c4d01a0ee1 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:29.287204 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c87dc8-f52c-4330-98ba-50af2c1245c7 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:29.293918 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d08048-2d7b-471e-a434-2a4ee8c2ff60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:29.294564 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d08048-2d7b-471e-a434-2a4ee8c2ff60 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:29.294883 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d08048-2d7b-471e-a434-2a4ee8c2ff60 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:29.295102 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d08048-2d7b-471e-a434-2a4ee8c2ff60 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:29.296189 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d08048-2d7b-471e-a434-2a4ee8c2ff60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:29.297622 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d08048-2d7b-471e-a434-2a4ee8c2ff60 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:29.299200 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 87/169] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 10:57:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:57:29.299962 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d08048-2d7b-471e-a434-2a4ee8c2ff60 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:29.308516 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:29.328173 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcec61f-dae9-4988-9b4f-7fa7f9656603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:29.328776 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcec61f-dae9-4988-9b4f-7fa7f9656603 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:29.329052 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcec61f-dae9-4988-9b4f-7fa7f9656603 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:29.329323 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcec61f-dae9-4988-9b4f-7fa7f9656603 None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:29.330044 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcec61f-dae9-4988-9b4f-7fa7f9656603 None admin] RBAC: Adding query filter params (name=member) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:29.330353 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcec61f-dae9-4988-9b4f-7fa7f9656603 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:29.331735 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcec61f-dae9-4988-9b4f-7fa7f9656603 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:29.344234 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 83/170] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Oct 13 10:57:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:57:29.344234 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcec61f-dae9-4988-9b4f-7fa7f9656603 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:29.407465 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:29.410292 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d08048-2d7b-471e-a434-2a4ee8c2ff60 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:29.444558 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcec61f-dae9-4988-9b4f-7fa7f9656603 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:29.446762 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd78fae-ddf9-4618-b5f0-537451ce93a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:29.447390 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd78fae-ddf9-4618-b5f0-537451ce93a9 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:29.447670 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd78fae-ddf9-4618-b5f0-537451ce93a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:29.447942 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd78fae-ddf9-4618-b5f0-537451ce93a9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:29.457840 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd78fae-ddf9-4618-b5f0-537451ce93a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:57:29.463655 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-4bd78fae-ddf9-4618-b5f0-537451ce93a9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 10:57:29.463655 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:29.463655 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:57:29.463655 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:57:29.463655 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:57:29.463655 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:57:29.463655 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:57:29.463655 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:57:29.463655 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:57:29.463655 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:57:29.463655 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:57:29.463655 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:57:29.463655 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:57:29.463655 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:57:29.463655 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:57:29.463655 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:57:29.464583 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:57:29.464583 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:57:29.464583 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:57:29.464583 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:57:29.464583 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:57:29.464583 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:57:29.464583 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:57:29.464583 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:57:29.464583 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:57:29.464583 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:57:29.464583 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:57:29.464583 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:57:29.464583 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:57:29.464583 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:57:29.464583 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:57:29.464583 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:57:29.466311 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:57:29.466311 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:57:29.466311 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:57:29.466311 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:57:29.466311 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:57:29.466311 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:57:29.466311 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:57:29.466311 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:57:29.466311 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:57:29.466311 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:57:29.466311 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 10:57:29.466311 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:57:29.466311 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 88/171] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Oct 13 10:57:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:57:29.466311 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd78fae-ddf9-4618-b5f0-537451ce93a9 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:29.478220 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09dd3c4-e123-4647-b855-6b55d93cf897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:29.478829 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09dd3c4-e123-4647-b855-6b55d93cf897 None admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:29.479109 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09dd3c4-e123-4647-b855-6b55d93cf897 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:29.479386 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09dd3c4-e123-4647-b855-6b55d93cf897 None admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:29.480031 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09dd3c4-e123-4647-b855-6b55d93cf897 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:29.481470 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09dd3c4-e123-4647-b855-6b55d93cf897 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:29.506323 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 84/172] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Oct 13 10:57:29 2022] POST /identity/v3/users => generated 297 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 10:57:29.508167 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09dd3c4-e123-4647-b855-6b55d93cf897 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:29.557582 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:29.577411 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd78fae-ddf9-4618-b5f0-537451ce93a9 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:29.617067 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4586594-6c58-4cac-ac0f-78d1464ca1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:29.617780 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4586594-6c58-4cac-ac0f-78d1464ca1f0 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:29.618031 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4586594-6c58-4cac-ac0f-78d1464ca1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:29.618312 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4586594-6c58-4cac-ac0f-78d1464ca1f0 None admin] PATH_INFO: `/v3/users/6bd7a204cefe49f6acba5fd3fb2d8d16` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:29.633432 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4586594-6c58-4cac-ac0f-78d1464ca1f0 None admin] RBAC: Authorizing `identity:get_user(user_id=6bd7a204cefe49f6acba5fd3fb2d8d16)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:29.635014 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4586594-6c58-4cac-ac0f-78d1464ca1f0 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:29.636914 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 89/173] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Oct 13 10:57:29 2022] GET /identity/v3/users/6bd7a204cefe49f6acba5fd3fb2d8d16 => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:29.637046 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09dd3c4-e123-4647-b855-6b55d93cf897 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:29.639169 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4586594-6c58-4cac-ac0f-78d1464ca1f0 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:29.663168 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:29.675791 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d58493-0785-4bd2-be08-434066f4ebb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:29.676678 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d58493-0785-4bd2-be08-434066f4ebb7 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:29.677477 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d58493-0785-4bd2-be08-434066f4ebb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:29.677752 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d58493-0785-4bd2-be08-434066f4ebb7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:29.690130 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d58493-0785-4bd2-be08-434066f4ebb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:57:29.697266 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-38d58493-0785-4bd2-be08-434066f4ebb7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 13 10:57:29.697266 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:29.697266 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:57:29.697266 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:57:29.697266 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:57:29.697266 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:57:29.697266 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:57:29.697266 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:57:29.697266 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:57:29.697266 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:57:29.697266 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:57:29.697266 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:57:29.697266 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:57:29.697266 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:57:29.697266 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:57:29.697266 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:57:29.698449 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:57:29.698449 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:57:29.698449 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:57:29.698449 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:57:29.698449 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:57:29.698449 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:57:29.698449 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:57:29.698449 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:57:29.698449 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:57:29.698449 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:57:29.698449 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:57:29.698449 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 10:57:29.698449 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:57:29.698449 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:57:29.698449 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:57:29.698449 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:57:29.699372 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:57:29.699372 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:57:29.699372 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:57:29.699372 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:57:29.699372 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:57:29.699372 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:57:29.699372 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:57:29.699372 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:57:29.699372 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:57:29.699372 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:57:29.699372 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 13 10:57:29.699372 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:57:29.699372 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 85/174] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Oct 13 10:57:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:57:29.699372 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d58493-0785-4bd2-be08-434066f4ebb7 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:29.756535 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4586594-6c58-4cac-ac0f-78d1464ca1f0 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:29.801450 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99352c14-396f-4a97-b7b9-e867479385fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:29.802246 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99352c14-396f-4a97-b7b9-e867479385fd None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:29.802599 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99352c14-396f-4a97-b7b9-e867479385fd None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:29.802976 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99352c14-396f-4a97-b7b9-e867479385fd None admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:29.803774 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99352c14-396f-4a97-b7b9-e867479385fd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:29.804213 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99352c14-396f-4a97-b7b9-e867479385fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:29.805695 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99352c14-396f-4a97-b7b9-e867479385fd None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:29.815643 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 90/175] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 10:57:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:29.816303 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99352c14-396f-4a97-b7b9-e867479385fd None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:29.819129 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:29.823155 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d58493-0785-4bd2-be08-434066f4ebb7 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:29.866012 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f847c6e-8905-4153-b48c-71ad83c5792c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:29.866664 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f847c6e-8905-4153-b48c-71ad83c5792c None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:29.866993 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f847c6e-8905-4153-b48c-71ad83c5792c None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:29.867276 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f847c6e-8905-4153-b48c-71ad83c5792c None admin] PATH_INFO: `/v3/projects/c32dd153f5284943a7a036275c792a45` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:29.868434 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f847c6e-8905-4153-b48c-71ad83c5792c None admin] RBAC: Authorizing `identity:get_project(project_id=c32dd153f5284943a7a036275c792a45)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:29.870029 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f847c6e-8905-4153-b48c-71ad83c5792c None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:29.871684 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 86/176] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Oct 13 10:57:29 2022] GET /identity/v3/projects/c32dd153f5284943a7a036275c792a45 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:29.874707 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f847c6e-8905-4153-b48c-71ad83c5792c None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:29.929752 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:29.951675 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99352c14-396f-4a97-b7b9-e867479385fd None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:29.990253 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe1dd90-c6c0-4843-a06f-8782be219ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:29.990968 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1dd90-c6c0-4843-a06f-8782be219ced None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:29.991320 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1dd90-c6c0-4843-a06f-8782be219ced None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:29.991664 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1dd90-c6c0-4843-a06f-8782be219ced None admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:29.992400 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe1dd90-c6c0-4843-a06f-8782be219ced None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:29.992807 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe1dd90-c6c0-4843-a06f-8782be219ced None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:29.994316 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe1dd90-c6c0-4843-a06f-8782be219ced None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:30.003118 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f847c6e-8905-4153-b48c-71ad83c5792c None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:30.004017 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 91/177] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Oct 13 10:57:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:30.005628 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe1dd90-c6c0-4843-a06f-8782be219ced None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:30.038402 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca16b3d-fd13-4c2f-b4d2-20f2164a6d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:30.039232 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca16b3d-fd13-4c2f-b4d2-20f2164a6d67 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:30.039801 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca16b3d-fd13-4c2f-b4d2-20f2164a6d67 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:30.039918 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca16b3d-fd13-4c2f-b4d2-20f2164a6d67 None admin] PATH_INFO: `/v3/users/fc041c76082e476580c705c5cd2cc672` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:30.041187 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca16b3d-fd13-4c2f-b4d2-20f2164a6d67 None admin] RBAC: Authorizing `identity:get_user(user_id=fc041c76082e476580c705c5cd2cc672)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:30.042769 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca16b3d-fd13-4c2f-b4d2-20f2164a6d67 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:30.044474 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 87/178] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Oct 13 10:57:29 2022] GET /identity/v3/users/fc041c76082e476580c705c5cd2cc672 => generated 283 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:30.049676 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca16b3d-fd13-4c2f-b4d2-20f2164a6d67 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:30.125031 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe1dd90-c6c0-4843-a06f-8782be219ced None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:30.126353 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:30.169488 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1413fa93-cf8c-4cc0-9a4d-03b66d3efd79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:30.170341 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1413fa93-cf8c-4cc0-9a4d-03b66d3efd79 None admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:30.170839 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1413fa93-cf8c-4cc0-9a4d-03b66d3efd79 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:30.171083 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1413fa93-cf8c-4cc0-9a4d-03b66d3efd79 None admin] PATH_INFO: `/v3/projects/c32dd153f5284943a7a036275c792a45/users/6bd7a204cefe49f6acba5fd3fb2d8d16/roles/7c3871c0ab68438b9014489d50b53a22` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:30.173144 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1413fa93-cf8c-4cc0-9a4d-03b66d3efd79 None admin] RBAC: Authorizing `identity:create_grant(project_id=c32dd153f5284943a7a036275c792a45, user_id=6bd7a204cefe49f6acba5fd3fb2d8d16, role_id=7c3871c0ab68438b9014489d50b53a22)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:30.174715 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1413fa93-cf8c-4cc0-9a4d-03b66d3efd79 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:30.181274 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca16b3d-fd13-4c2f-b4d2-20f2164a6d67 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:30.191089 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 92/179] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Oct 13 10:57:30 2022] PUT /identity/v3/projects/c32dd153f5284943a7a036275c792a45/users/6bd7a204cefe49f6acba5fd3fb2d8d16/roles/7c3871c0ab68438b9014489d50b53a22 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 10:57:30.195243 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1413fa93-cf8c-4cc0-9a4d-03b66d3efd79 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:30.203513 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:30.236891 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19bb60b-33f8-4a8f-a81d-9e7cfbf0b3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:30.238013 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19bb60b-33f8-4a8f-a81d-9e7cfbf0b3ca None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:30.238493 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19bb60b-33f8-4a8f-a81d-9e7cfbf0b3ca None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:30.238941 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19bb60b-33f8-4a8f-a81d-9e7cfbf0b3ca None admin] PATH_INFO: `/v3/users/fc041c76082e476580c705c5cd2cc672` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:30.240493 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19bb60b-33f8-4a8f-a81d-9e7cfbf0b3ca None admin] RBAC: Authorizing `identity:get_user(user_id=fc041c76082e476580c705c5cd2cc672)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:30.242240 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19bb60b-33f8-4a8f-a81d-9e7cfbf0b3ca None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:30.244140 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 88/180] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Oct 13 10:57:30 2022] GET /identity/v3/users/fc041c76082e476580c705c5cd2cc672 => generated 283 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:30.255475 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19bb60b-33f8-4a8f-a81d-9e7cfbf0b3ca None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:30.380289 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19bb60b-33f8-4a8f-a81d-9e7cfbf0b3ca None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:30.383263 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:30.422523 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71208f7-ac3e-410a-a483-5feabe7421bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:30.423148 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71208f7-ac3e-410a-a483-5feabe7421bd None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:30.423816 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71208f7-ac3e-410a-a483-5feabe7421bd None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:30.424152 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71208f7-ac3e-410a-a483-5feabe7421bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:30.440700 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1413fa93-cf8c-4cc0-9a4d-03b66d3efd79 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:30.480886 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a962b79-9979-432c-b442-56423b6ed11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:30.481597 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a962b79-9979-432c-b442-56423b6ed11d None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:30.481963 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a962b79-9979-432c-b442-56423b6ed11d None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:30.482330 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a962b79-9979-432c-b442-56423b6ed11d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:30.515867 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71208f7-ac3e-410a-a483-5feabe7421bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:30.518023 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71208f7-ac3e-410a-a483-5feabe7421bd None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:30.627358 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 89/181] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Oct 13 10:57:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 13 10:57:30.627986 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:30.633802 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71208f7-ac3e-410a-a483-5feabe7421bd None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:30.662777 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a962b79-9979-432c-b442-56423b6ed11d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:30.664258 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a962b79-9979-432c-b442-56423b6ed11d None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:30.666413 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:30.742598 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71208f7-ac3e-410a-a483-5feabe7421bd None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:30.780156 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7277f05d-8a65-42ed-b75e-00d7bec8a456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:30.781020 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7277f05d-8a65-42ed-b75e-00d7bec8a456 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:30.781459 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7277f05d-8a65-42ed-b75e-00d7bec8a456 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:30.781870 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7277f05d-8a65-42ed-b75e-00d7bec8a456 None admin] PATH_INFO: `/v3/projects/c32dd153f5284943a7a036275c792a45` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:30.783297 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7277f05d-8a65-42ed-b75e-00d7bec8a456 None admin] RBAC: Authorizing `identity:get_project(project_id=c32dd153f5284943a7a036275c792a45)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:30.784894 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7277f05d-8a65-42ed-b75e-00d7bec8a456 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:30.786863 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 90/182] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Oct 13 10:57:30 2022] GET /identity/v3/projects/c32dd153f5284943a7a036275c792a45 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:57:30.792945 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7277f05d-8a65-42ed-b75e-00d7bec8a456 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:30.874383 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:30.909878 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 93/183] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Oct 13 10:57:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 718 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 13 10:57:30.916186 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a962b79-9979-432c-b442-56423b6ed11d None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:30.936599 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7277f05d-8a65-42ed-b75e-00d7bec8a456 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:31.011235 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8121df37-1246-4972-99f1-1f1a32908a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:31.011771 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8121df37-1246-4972-99f1-1f1a32908a6b None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:31.012048 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8121df37-1246-4972-99f1-1f1a32908a6b None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:31.012318 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8121df37-1246-4972-99f1-1f1a32908a6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:31.013055 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8121df37-1246-4972-99f1-1f1a32908a6b None admin] RBAC: Adding query filter params (role.id=84a5ec3770b4453bb7c3ff5b9af0bd17, scope.project.id=c32dd153f5284943a7a036275c792a45, user.id=fc041c76082e476580c705c5cd2cc672) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:31.013363 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8121df37-1246-4972-99f1-1f1a32908a6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:31.014840 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8121df37-1246-4972-99f1-1f1a32908a6b None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:31.021625 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 91/184] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Oct 13 10:57:30 2022] GET /identity/v3/role_assignments?user.id=fc041c76082e476580c705c5cd2cc672&scope.project.id=c32dd153f5284943a7a036275c792a45&role.id=84a5ec3770b4453bb7c3ff5b9af0bd17 => generated 608 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:31.111471 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a962b79-9979-432c-b442-56423b6ed11d None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:31.113307 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:31.163720 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654568a5-7ccb-4243-9ea2-f8153bf3cfa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:31.164814 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654568a5-7ccb-4243-9ea2-f8153bf3cfa5 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:31.165362 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654568a5-7ccb-4243-9ea2-f8153bf3cfa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:31.165828 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654568a5-7ccb-4243-9ea2-f8153bf3cfa5 None admin] PATH_INFO: `/v3/projects/c32dd153f5284943a7a036275c792a45` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:31.167445 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654568a5-7ccb-4243-9ea2-f8153bf3cfa5 None admin] RBAC: Authorizing `identity:get_project(project_id=c32dd153f5284943a7a036275c792a45)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:31.169162 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654568a5-7ccb-4243-9ea2-f8153bf3cfa5 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:31.171116 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 94/185] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Oct 13 10:57:30 2022] GET /identity/v3/projects/c32dd153f5284943a7a036275c792a45 => generated 302 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:31.177896 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8121df37-1246-4972-99f1-1f1a32908a6b None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:31.300575 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8121df37-1246-4972-99f1-1f1a32908a6b None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:31.330599 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:31.337383 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd92e3a-d91b-4881-9b90-7573935fd977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:31.338019 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd92e3a-d91b-4881-9b90-7573935fd977 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:31.338300 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd92e3a-d91b-4881-9b90-7573935fd977 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:31.338575 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd92e3a-d91b-4881-9b90-7573935fd977 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:31.339359 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd92e3a-d91b-4881-9b90-7573935fd977 None admin] RBAC: Adding query filter params (role.id=ea564961b1db4eb4a1d4d880964611b2, scope.project.id=c32dd153f5284943a7a036275c792a45, user.id=fc041c76082e476580c705c5cd2cc672) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:31.339671 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd92e3a-d91b-4881-9b90-7573935fd977 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:31.341108 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd92e3a-d91b-4881-9b90-7573935fd977 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:31.347176 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 92/186] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Oct 13 10:57:31 2022] GET /identity/v3/role_assignments?user.id=fc041c76082e476580c705c5cd2cc672&scope.project.id=c32dd153f5284943a7a036275c792a45&role.id=ea564961b1db4eb4a1d4d880964611b2 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:31.987763 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75517d76-27f8-4eac-8578-c99820c40458 None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:31.988279 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75517d76-27f8-4eac-8578-c99820c40458 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:31.988279 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75517d76-27f8-4eac-8578-c99820c40458 None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:31.990410 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 95/187] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:57:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:31.995883 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b96fd-319d-432a-babc-c48bdd057c12 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:31.996380 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b96fd-319d-432a-babc-c48bdd057c12 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:31.996449 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b96fd-319d-432a-babc-c48bdd057c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:32.014543 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-204b96fd-319d-432a-babc-c48bdd057c12 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:32.015718 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-204b96fd-319d-432a-babc-c48bdd057c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:32.082110 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 93/188] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:57:32.106547 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b23f4f0-2c24-4840-b9dd-4c718750f228 None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:32.106836 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b23f4f0-2c24-4840-b9dd-4c718750f228 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:32.107110 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b23f4f0-2c24-4840-b9dd-4c718750f228 None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:32.108565 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 96/189] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:57:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:32.113781 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa4afd-176a-4b2c-b4a4-561057739775 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:32.114102 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa4afd-176a-4b2c-b4a4-561057739775 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:32.114446 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa4afd-176a-4b2c-b4a4-561057739775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:32.133148 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-5aaa4afd-176a-4b2c-b4a4-561057739775 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:32.134282 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-5aaa4afd-176a-4b2c-b4a4-561057739775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:32.201169 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 94/190] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:57:32.352038 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b23f4f0-2c24-4840-b9dd-4c718750f228 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:32.455485 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b23f4f0-2c24-4840-b9dd-4c718750f228 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:32.469021 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaa4afd-176a-4b2c-b4a4-561057739775 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:32.496164 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2778c590-6a09-4e8e-a697-4bc92ee834f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:32.496811 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2778c590-6a09-4e8e-a697-4bc92ee834f1 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:32.497110 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2778c590-6a09-4e8e-a697-4bc92ee834f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:32.497367 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2778c590-6a09-4e8e-a697-4bc92ee834f1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:32.507423 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2778c590-6a09-4e8e-a697-4bc92ee834f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:57:32.512323 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-2778c590-6a09-4e8e-a697-4bc92ee834f1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 13 10:57:32.512323 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:32.512323 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:57:32.512323 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:57:32.512323 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:57:32.512323 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:57:32.512323 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:57:32.512323 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:57:32.512323 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:57:32.512323 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:57:32.512323 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:57:32.512323 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:57:32.512323 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:57:32.512323 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:57:32.512323 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:57:32.512323 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:57:32.513195 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:57:32.513195 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:57:32.513195 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:57:32.513195 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:57:32.513195 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:57:32.513195 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:57:32.513195 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:57:32.513195 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:57:32.513195 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:57:32.513195 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:57:32.513195 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:57:32.513195 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:57:32.513195 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:57:32.513195 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:57:32.513195 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:57:32.513195 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:57:32.514009 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:57:32.514009 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:57:32.514009 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:57:32.514009 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:57:32.514009 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:57:32.514009 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:57:32.514009 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:57:32.514009 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:57:32.514009 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:57:32.514009 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:57:32.514009 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 13 10:57:32.514009 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:57:32.514009 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 97/191] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 10:57:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:57:32.520922 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2778c590-6a09-4e8e-a697-4bc92ee834f1 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:32.532951 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:32.553905 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:32.580394 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaa4afd-176a-4b2c-b4a4-561057739775 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:32.614408 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa84e8c-db0c-4411-80e0-c3f01fdde17e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:32.615030 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa84e8c-db0c-4411-80e0-c3f01fdde17e None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:32.615311 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa84e8c-db0c-4411-80e0-c3f01fdde17e None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:32.615581 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa84e8c-db0c-4411-80e0-c3f01fdde17e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:32.616680 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa84e8c-db0c-4411-80e0-c3f01fdde17e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:32.618154 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa84e8c-db0c-4411-80e0-c3f01fdde17e None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:32.619817 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 95/192] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 10:57:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:57:32.621002 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c36772-8b69-4d47-a150-b97a079903f1 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:32.621287 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c36772-8b69-4d47-a150-b97a079903f1 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:32.621561 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c36772-8b69-4d47-a150-b97a079903f1 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:32.622050 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2778c590-6a09-4e8e-a697-4bc92ee834f1 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:32.622967 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 96/193] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:57:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:32.626787 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c36772-8b69-4d47-a150-b97a079903f1 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:32.656128 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4608edcb-932e-431d-9aa4-e631a0d4c73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:32.656731 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608edcb-932e-431d-9aa4-e631a0d4c73a None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:32.657008 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608edcb-932e-431d-9aa4-e631a0d4c73a None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:32.657280 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608edcb-932e-431d-9aa4-e631a0d4c73a None admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:32.657957 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4608edcb-932e-431d-9aa4-e631a0d4c73a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:32.658262 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4608edcb-932e-431d-9aa4-e631a0d4c73a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:32.659615 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4608edcb-932e-431d-9aa4-e631a0d4c73a None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:32.667996 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 98/194] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Oct 13 10:57:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:57:32.669118 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c74dead-ea15-44ab-8440-1b54846c15dd None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:32.669406 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c74dead-ea15-44ab-8440-1b54846c15dd None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:32.669682 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c74dead-ea15-44ab-8440-1b54846c15dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:32.686409 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-4c74dead-ea15-44ab-8440-1b54846c15dd None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:32.687598 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-4c74dead-ea15-44ab-8440-1b54846c15dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:32.727617 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c36772-8b69-4d47-a150-b97a079903f1 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:32.749528 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:32.751577 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 99/195] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:57:32.752562 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c74dead-ea15-44ab-8440-1b54846c15dd None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:32.763938 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96714a38-5330-4692-a888-050fdf086807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:32.764696 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96714a38-5330-4692-a888-050fdf086807 None admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:32.764982 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96714a38-5330-4692-a888-050fdf086807 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:32.765258 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96714a38-5330-4692-a888-050fdf086807 None admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:32.765911 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96714a38-5330-4692-a888-050fdf086807 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:32.767382 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96714a38-5330-4692-a888-050fdf086807 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:32.776147 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:32.801970 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 97/196] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Oct 13 10:57:32 2022] POST /identity/v3/users => generated 293 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 10:57:32.869092 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c74dead-ea15-44ab-8440-1b54846c15dd None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:32.913386 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e47794e-fe9f-416d-a087-8dfa17fd281b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:32.914069 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47794e-fe9f-416d-a087-8dfa17fd281b None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:32.914352 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47794e-fe9f-416d-a087-8dfa17fd281b None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:32.914624 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47794e-fe9f-416d-a087-8dfa17fd281b None admin] PATH_INFO: `/v3/users/ed1b7957156a45ef92f9fc736f0fdd77` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:32.929593 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e47794e-fe9f-416d-a087-8dfa17fd281b None admin] RBAC: Authorizing `identity:get_user(user_id=ed1b7957156a45ef92f9fc736f0fdd77)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:32.931115 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e47794e-fe9f-416d-a087-8dfa17fd281b None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:32.932836 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 100/197] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Oct 13 10:57:32 2022] GET /identity/v3/users/ed1b7957156a45ef92f9fc736f0fdd77 => generated 297 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:32.938550 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96714a38-5330-4692-a888-050fdf086807 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:33.023110 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e47794e-fe9f-416d-a087-8dfa17fd281b None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:33.048043 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96714a38-5330-4692-a888-050fdf086807 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:33.086364 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f08790-ab92-49c8-b0d6-a452e3fa1854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:33.087009 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f08790-ab92-49c8-b0d6-a452e3fa1854 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:33.087287 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f08790-ab92-49c8-b0d6-a452e3fa1854 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:33.087593 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f08790-ab92-49c8-b0d6-a452e3fa1854 None admin] PATH_INFO: `/v3/projects/c32dd153f5284943a7a036275c792a45` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:33.088893 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f08790-ab92-49c8-b0d6-a452e3fa1854 None admin] RBAC: Authorizing `identity:get_project(project_id=c32dd153f5284943a7a036275c792a45)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:33.090416 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f08790-ab92-49c8-b0d6-a452e3fa1854 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:33.093282 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 98/198] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Oct 13 10:57:32 2022] GET /identity/v3/projects/c32dd153f5284943a7a036275c792a45 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:33.098215 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f08790-ab92-49c8-b0d6-a452e3fa1854 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:33.131007 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:33.152653 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:33.154467 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e47794e-fe9f-416d-a087-8dfa17fd281b None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:33.205833 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4650b245-53eb-426c-bfc6-8167f8000d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:33.206610 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650b245-53eb-426c-bfc6-8167f8000d07 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:33.206791 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650b245-53eb-426c-bfc6-8167f8000d07 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:33.207048 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650b245-53eb-426c-bfc6-8167f8000d07 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:33.217847 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4650b245-53eb-426c-bfc6-8167f8000d07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:57:33.218716 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f08790-ab92-49c8-b0d6-a452e3fa1854 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:33.222746 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-4650b245-53eb-426c-bfc6-8167f8000d07 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 13 10:57:33.222746 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:33.222746 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:57:33.222746 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:57:33.222746 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:57:33.222746 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:57:33.222746 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:57:33.222746 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:57:33.222746 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:57:33.222746 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:57:33.222746 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:57:33.222746 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:57:33.222746 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:57:33.222746 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:57:33.222746 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:57:33.222746 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:57:33.223683 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:57:33.223683 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:57:33.223683 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:57:33.223683 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:57:33.223683 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:57:33.223683 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:57:33.223683 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:57:33.223683 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:57:33.223683 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:57:33.223683 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:57:33.223683 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:57:33.223683 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:57:33.223683 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:57:33.223683 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:57:33.223683 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:57:33.223683 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:57:33.224495 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:57:33.224495 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:57:33.224495 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:57:33.224495 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:57:33.224495 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:57:33.224495 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:57:33.224495 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:57:33.224495 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:57:33.224495 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:57:33.224495 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:57:33.224495 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 13 10:57:33.224495 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:57:33.224495 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 101/199] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 10:57:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 10:57:33.229779 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4650b245-53eb-426c-bfc6-8167f8000d07 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:33.266513 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351be947-9a6b-4474-b538-134f7a27935a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:33.266991 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351be947-9a6b-4474-b538-134f7a27935a None admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:33.267270 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351be947-9a6b-4474-b538-134f7a27935a None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:33.267546 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351be947-9a6b-4474-b538-134f7a27935a None admin] PATH_INFO: `/v3/projects/c32dd153f5284943a7a036275c792a45/users/ed1b7957156a45ef92f9fc736f0fdd77/roles/97c7067aa1ca411c9b8d3596c4d6abf6` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:33.271307 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351be947-9a6b-4474-b538-134f7a27935a None admin] RBAC: Authorizing `identity:create_grant(project_id=c32dd153f5284943a7a036275c792a45, user_id=ed1b7957156a45ef92f9fc736f0fdd77, role_id=97c7067aa1ca411c9b8d3596c4d6abf6)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:33.273610 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351be947-9a6b-4474-b538-134f7a27935a None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:33.293540 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 99/200] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Oct 13 10:57:33 2022] PUT /identity/v3/projects/c32dd153f5284943a7a036275c792a45/users/ed1b7957156a45ef92f9fc736f0fdd77/roles/97c7067aa1ca411c9b8d3596c4d6abf6 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 10:57:33.348362 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4650b245-53eb-426c-bfc6-8167f8000d07 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:33.390425 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982d4c6e-e994-4fa0-85ad-737089b49177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:33.391051 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d4c6e-e994-4fa0-85ad-737089b49177 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:33.391444 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d4c6e-e994-4fa0-85ad-737089b49177 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:33.391706 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d4c6e-e994-4fa0-85ad-737089b49177 None admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:33.392397 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982d4c6e-e994-4fa0-85ad-737089b49177 None admin] RBAC: Adding query filter params (name=member) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:33.392786 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982d4c6e-e994-4fa0-85ad-737089b49177 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:33.394217 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982d4c6e-e994-4fa0-85ad-737089b49177 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:33.405134 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 102/201] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Oct 13 10:57:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:33.411138 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351be947-9a6b-4474-b538-134f7a27935a None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:33.530013 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351be947-9a6b-4474-b538-134f7a27935a None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:33.538276 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:33.567110 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab05df82-b35d-4470-b2ee-e0dffdadb864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:33.568283 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05df82-b35d-4470-b2ee-e0dffdadb864 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:33.568566 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05df82-b35d-4470-b2ee-e0dffdadb864 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:33.568843 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05df82-b35d-4470-b2ee-e0dffdadb864 None admin] PATH_INFO: `/v3/users/6bd7a204cefe49f6acba5fd3fb2d8d16` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:33.570002 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab05df82-b35d-4470-b2ee-e0dffdadb864 None admin] RBAC: Authorizing `identity:get_user(user_id=6bd7a204cefe49f6acba5fd3fb2d8d16)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:33.571458 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab05df82-b35d-4470-b2ee-e0dffdadb864 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:33.573126 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 100/202] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Oct 13 10:57:33 2022] GET /identity/v3/users/6bd7a204cefe49f6acba5fd3fb2d8d16 => generated 297 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:33.578696 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982d4c6e-e994-4fa0-85ad-737089b49177 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:33.581809 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:33.685426 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982d4c6e-e994-4fa0-85ad-737089b49177 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:33.720198 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5969321-05e7-4298-8649-5bf2ca82498e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:33.720818 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5969321-05e7-4298-8649-5bf2ca82498e None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:33.721098 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5969321-05e7-4298-8649-5bf2ca82498e None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:33.721371 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5969321-05e7-4298-8649-5bf2ca82498e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:33.794137 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5969321-05e7-4298-8649-5bf2ca82498e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:33.795605 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5969321-05e7-4298-8649-5bf2ca82498e None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:33.797505 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:33.903521 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 103/203] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Oct 13 10:57:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 13 10:57:33.909161 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab05df82-b35d-4470-b2ee-e0dffdadb864 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:34.011127 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab05df82-b35d-4470-b2ee-e0dffdadb864 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:34.044270 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af5ed84-5b26-4f3d-9322-20fa80de89f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:34.044842 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5ed84-5b26-4f3d-9322-20fa80de89f4 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:34.045171 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5ed84-5b26-4f3d-9322-20fa80de89f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:34.045457 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5ed84-5b26-4f3d-9322-20fa80de89f4 None admin] PATH_INFO: `/v3/projects/c32dd153f5284943a7a036275c792a45` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:34.046610 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af5ed84-5b26-4f3d-9322-20fa80de89f4 None admin] RBAC: Authorizing `identity:get_project(project_id=c32dd153f5284943a7a036275c792a45)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:34.048072 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af5ed84-5b26-4f3d-9322-20fa80de89f4 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:34.049933 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 101/204] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Oct 13 10:57:33 2022] GET /identity/v3/projects/c32dd153f5284943a7a036275c792a45 => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:34.057500 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5969321-05e7-4298-8649-5bf2ca82498e None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:34.159731 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5969321-05e7-4298-8649-5bf2ca82498e None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:34.161484 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:34.195967 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4ec0f7-6959-44eb-99e1-b9e69d651281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:34.196585 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ec0f7-6959-44eb-99e1-b9e69d651281 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:34.196863 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ec0f7-6959-44eb-99e1-b9e69d651281 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:34.197139 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ec0f7-6959-44eb-99e1-b9e69d651281 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:34.197868 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4ec0f7-6959-44eb-99e1-b9e69d651281 None admin] RBAC: Adding query filter params (role.id=7c3871c0ab68438b9014489d50b53a22, scope.project.id=c32dd153f5284943a7a036275c792a45, user.id=6bd7a204cefe49f6acba5fd3fb2d8d16) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:34.198201 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4ec0f7-6959-44eb-99e1-b9e69d651281 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:34.199638 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4ec0f7-6959-44eb-99e1-b9e69d651281 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:34.205929 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 104/205] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Oct 13 10:57:34 2022] GET /identity/v3/role_assignments?user.id=6bd7a204cefe49f6acba5fd3fb2d8d16&scope.project.id=c32dd153f5284943a7a036275c792a45&role.id=7c3871c0ab68438b9014489d50b53a22 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:57:35.121887 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566f07ba-9af5-4e78-9f01-c388a1c5c61e None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:35.122429 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566f07ba-9af5-4e78-9f01-c388a1c5c61e None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:35.122531 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566f07ba-9af5-4e78-9f01-c388a1c5c61e None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:35.123854 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 102/206] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:57:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:35.129002 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f97fa0-0b30-4e56-892f-b7296bf4a507 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:35.129390 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f97fa0-0b30-4e56-892f-b7296bf4a507 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:35.129564 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f97fa0-0b30-4e56-892f-b7296bf4a507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:35.148416 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-15f97fa0-0b30-4e56-892f-b7296bf4a507 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:35.149543 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-15f97fa0-0b30-4e56-892f-b7296bf4a507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:35.155185 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d643f64-72ca-4db1-b4e8-fa88a8559407 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:35.155472 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d643f64-72ca-4db1-b4e8-fa88a8559407 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:35.155748 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d643f64-72ca-4db1-b4e8-fa88a8559407 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:35.157119 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 103/207] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:57:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:35.162390 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1165999-7281-4d1e-8c13-cd937351de72 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:35.162669 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1165999-7281-4d1e-8c13-cd937351de72 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:35.162937 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1165999-7281-4d1e-8c13-cd937351de72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:35.182348 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-c1165999-7281-4d1e-8c13-cd937351de72 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:35.183582 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-c1165999-7281-4d1e-8c13-cd937351de72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:35.217074 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 105/208] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:57:35.224299 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:35.257339 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 104/209] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 13 10:57:35.487563 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f97fa0-0b30-4e56-892f-b7296bf4a507 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:35.526291 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1165999-7281-4d1e-8c13-cd937351de72 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:35.587878 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:35.594670 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f97fa0-0b30-4e56-892f-b7296bf4a507 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:35.631436 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62e3559-fe4a-444c-b807-69fa8b7f6bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:35.631768 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1165999-7281-4d1e-8c13-cd937351de72 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:35.632063 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e3559-fe4a-444c-b807-69fa8b7f6bb9 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:35.632338 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e3559-fe4a-444c-b807-69fa8b7f6bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:35.632607 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e3559-fe4a-444c-b807-69fa8b7f6bb9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:35.642732 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62e3559-fe4a-444c-b807-69fa8b7f6bb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:57:35.647524 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-a62e3559-fe4a-444c-b807-69fa8b7f6bb9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 13 10:57:35.647524 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:35.647524 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:57:35.647524 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:57:35.647524 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:57:35.647524 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:57:35.647524 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:57:35.647524 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:57:35.647524 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:57:35.647524 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:57:35.647524 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:57:35.647524 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:57:35.647524 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:57:35.647524 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:57:35.647524 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:57:35.647524 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:57:35.648578 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:57:35.648578 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:57:35.648578 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:57:35.648578 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:57:35.648578 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:57:35.648578 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:57:35.648578 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:57:35.648578 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:57:35.648578 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:57:35.648578 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:57:35.648578 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:57:35.648578 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:57:35.648578 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:57:35.648578 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:57:35.648578 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:57:35.648578 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:57:35.649726 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:57:35.649726 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:57:35.649726 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:57:35.649726 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:57:35.649726 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:57:35.649726 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:57:35.649726 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:57:35.649726 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:57:35.649726 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:57:35.649726 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:57:35.649726 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 13 10:57:35.649726 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:57:35.649726 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 106/210] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 10:57:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:57:35.649726 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e0dfa-56a2-4988-9719-57d2652cb283 None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:35.650607 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e0dfa-56a2-4988-9719-57d2652cb283 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:35.650607 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e0dfa-56a2-4988-9719-57d2652cb283 None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:35.651628 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 107/211] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:57:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:35.654222 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e0dfa-56a2-4988-9719-57d2652cb283 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:35.668666 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4142f0e1-125f-4af9-8c9c-b0989670323c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:35.669297 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4142f0e1-125f-4af9-8c9c-b0989670323c None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:35.669568 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4142f0e1-125f-4af9-8c9c-b0989670323c None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:35.669839 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4142f0e1-125f-4af9-8c9c-b0989670323c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:35.670955 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4142f0e1-125f-4af9-8c9c-b0989670323c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:35.672383 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4142f0e1-125f-4af9-8c9c-b0989670323c None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:35.673919 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 105/212] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 10:57:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:57:35.678145 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a0a14-242e-47be-bb68-c166049d3af7 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:35.678145 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a0a14-242e-47be-bb68-c166049d3af7 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:35.678145 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a0a14-242e-47be-bb68-c166049d3af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:35.692965 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-2c1a0a14-242e-47be-bb68-c166049d3af7 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:35.694158 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-2c1a0a14-242e-47be-bb68-c166049d3af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:35.727330 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:35.753621 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e0dfa-56a2-4988-9719-57d2652cb283 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:35.758081 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 106/213] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:57:35.758881 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1a0a14-242e-47be-bb68-c166049d3af7 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:35.791470 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc81f67-fe3e-4fd7-b888-a01586796fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:35.792230 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc81f67-fe3e-4fd7-b888-a01586796fac None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:35.792512 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc81f67-fe3e-4fd7-b888-a01586796fac None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:35.793487 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc81f67-fe3e-4fd7-b888-a01586796fac None admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:35.794196 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc81f67-fe3e-4fd7-b888-a01586796fac None admin] RBAC: Adding query filter params (name=member) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:35.794505 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc81f67-fe3e-4fd7-b888-a01586796fac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:35.795889 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc81f67-fe3e-4fd7-b888-a01586796fac None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:35.805379 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 108/214] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Oct 13 10:57:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:57:35.810708 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc81f67-fe3e-4fd7-b888-a01586796fac None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:35.830833 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:35.859411 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1a0a14-242e-47be-bb68-c166049d3af7 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:35.901083 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c285cd31-e4e0-48df-b9ac-38c92fc6436a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:35.902108 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285cd31-e4e0-48df-b9ac-38c92fc6436a None admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:35.902108 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285cd31-e4e0-48df-b9ac-38c92fc6436a None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:35.902480 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285cd31-e4e0-48df-b9ac-38c92fc6436a None admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:35.903189 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c285cd31-e4e0-48df-b9ac-38c92fc6436a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:35.904680 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c285cd31-e4e0-48df-b9ac-38c92fc6436a None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:35.922530 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc81f67-fe3e-4fd7-b888-a01586796fac None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:35.928249 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 107/215] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Oct 13 10:57:35 2022] POST /identity/v3/users => generated 293 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 10:57:35.960690 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c478db7-dacd-435b-a73c-12360f4c631e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:35.961442 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c478db7-dacd-435b-a73c-12360f4c631e None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:35.961787 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c478db7-dacd-435b-a73c-12360f4c631e None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:35.962157 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c478db7-dacd-435b-a73c-12360f4c631e None admin] PATH_INFO: `/v3/users/30b54193430d48c390cb2d115e20d808` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:35.977800 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c478db7-dacd-435b-a73c-12360f4c631e None admin] RBAC: Authorizing `identity:get_user(user_id=30b54193430d48c390cb2d115e20d808)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:35.979406 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c478db7-dacd-435b-a73c-12360f4c631e None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:35.981147 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 109/216] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Oct 13 10:57:35 2022] GET /identity/v3/users/30b54193430d48c390cb2d115e20d808 => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:57:35.987455 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c285cd31-e4e0-48df-b9ac-38c92fc6436a None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:36.017187 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:36.030767 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c478db7-dacd-435b-a73c-12360f4c631e None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:36.100547 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c285cd31-e4e0-48df-b9ac-38c92fc6436a None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:36.123050 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:36.138754 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbcdf8c-8235-45fe-b2b9-8d9ec37f6d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:36.139417 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbcdf8c-8235-45fe-b2b9-8d9ec37f6d28 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:36.139694 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbcdf8c-8235-45fe-b2b9-8d9ec37f6d28 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:36.139965 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbcdf8c-8235-45fe-b2b9-8d9ec37f6d28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:36.140693 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbcdf8c-8235-45fe-b2b9-8d9ec37f6d28 None admin] RBAC: Adding query filter params (role.id=7c3871c0ab68438b9014489d50b53a22, user.id=30b54193430d48c390cb2d115e20d808, scope.system=all) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:36.141006 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbcdf8c-8235-45fe-b2b9-8d9ec37f6d28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:36.142478 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbcdf8c-8235-45fe-b2b9-8d9ec37f6d28 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:36.148280 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 108/217] 10.222.0.25 () {56 vars in 1308 bytes} [Thu Oct 13 10:57:35 2022] GET /identity/v3/role_assignments?user.id=30b54193430d48c390cb2d115e20d808&scope.system=all&role.id=7c3871c0ab68438b9014489d50b53a22 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:36.152815 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c478db7-dacd-435b-a73c-12360f4c631e None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:36.198949 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58859b05-5a9f-4d34-a375-1be249a79c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:36.199672 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58859b05-5a9f-4d34-a375-1be249a79c84 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:36.199904 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58859b05-5a9f-4d34-a375-1be249a79c84 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:36.200180 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58859b05-5a9f-4d34-a375-1be249a79c84 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:36.213231 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58859b05-5a9f-4d34-a375-1be249a79c84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:57:36.218297 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-58859b05-5a9f-4d34-a375-1be249a79c84 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 13 10:57:36.218297 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:36.218297 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:57:36.218297 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:57:36.218297 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:57:36.218297 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:57:36.218297 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:57:36.218297 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:57:36.218297 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:57:36.218297 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:57:36.218297 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:57:36.218297 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:57:36.218297 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:57:36.218297 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:57:36.218297 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:57:36.218297 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:57:36.219182 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:57:36.219182 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:57:36.219182 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:57:36.219182 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:57:36.219182 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:57:36.219182 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:57:36.219182 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:57:36.219182 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:57:36.219182 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:57:36.219182 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:57:36.219182 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:57:36.219182 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:57:36.219182 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:57:36.219182 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:57:36.219182 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:57:36.219182 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:57:36.219964 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:57:36.219964 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:57:36.219964 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:57:36.219964 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:57:36.219964 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:57:36.219964 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:57:36.219964 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:57:36.219964 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:57:36.219964 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:57:36.219964 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:57:36.219964 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 13 10:57:36.219964 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:57:36.219964 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 110/218] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 10:57:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 10:57:36.227385 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbcdf8c-8235-45fe-b2b9-8d9ec37f6d28 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:36.334712 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:36.346367 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbcdf8c-8235-45fe-b2b9-8d9ec37f6d28 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:36.383174 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45d9473-1e60-4f9b-84be-b743f36caa05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:36.383867 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45d9473-1e60-4f9b-84be-b743f36caa05 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:36.384202 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45d9473-1e60-4f9b-84be-b743f36caa05 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:36.384484 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45d9473-1e60-4f9b-84be-b743f36caa05 None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:36.385159 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45d9473-1e60-4f9b-84be-b743f36caa05 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:36.385472 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45d9473-1e60-4f9b-84be-b743f36caa05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:36.386885 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45d9473-1e60-4f9b-84be-b743f36caa05 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:36.396793 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 109/219] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Oct 13 10:57:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:36.402725 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58859b05-5a9f-4d34-a375-1be249a79c84 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:36.514585 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58859b05-5a9f-4d34-a375-1be249a79c84 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:36.551091 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3621cc10-dbd4-43a0-9166-3eee0070ecbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:36.552282 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621cc10-dbd4-43a0-9166-3eee0070ecbe None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:36.552757 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621cc10-dbd4-43a0-9166-3eee0070ecbe None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:36.553218 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621cc10-dbd4-43a0-9166-3eee0070ecbe None admin] PATH_INFO: `/v3/users/ed1b7957156a45ef92f9fc736f0fdd77` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:36.554616 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3621cc10-dbd4-43a0-9166-3eee0070ecbe None admin] RBAC: Authorizing `identity:get_user(user_id=ed1b7957156a45ef92f9fc736f0fdd77)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:36.556242 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3621cc10-dbd4-43a0-9166-3eee0070ecbe None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:36.558323 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 111/220] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Oct 13 10:57:36 2022] GET /identity/v3/users/ed1b7957156a45ef92f9fc736f0fdd77 => generated 297 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:36.563585 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45d9473-1e60-4f9b-84be-b743f36caa05 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:36.672457 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45d9473-1e60-4f9b-84be-b743f36caa05 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:36.707687 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a640d5-6db5-4dc4-a10d-d96e92db5925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:36.708747 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a640d5-6db5-4dc4-a10d-d96e92db5925 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:36.709234 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a640d5-6db5-4dc4-a10d-d96e92db5925 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:36.709695 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a640d5-6db5-4dc4-a10d-d96e92db5925 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:36.731950 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:36.780145 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a640d5-6db5-4dc4-a10d-d96e92db5925 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:36.781971 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a640d5-6db5-4dc4-a10d-d96e92db5925 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:36.885635 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 110/221] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Oct 13 10:57:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 13 10:57:36.895049 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3621cc10-dbd4-43a0-9166-3eee0070ecbe None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:36.900858 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:37.003277 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3621cc10-dbd4-43a0-9166-3eee0070ecbe None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:37.043546 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f8033e-4b57-42d9-b0b6-f4e627904fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:37.044562 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f8033e-4b57-42d9-b0b6-f4e627904fc7 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:37.045046 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f8033e-4b57-42d9-b0b6-f4e627904fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:37.045522 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f8033e-4b57-42d9-b0b6-f4e627904fc7 None admin] PATH_INFO: `/v3/projects/c32dd153f5284943a7a036275c792a45` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:37.047096 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f8033e-4b57-42d9-b0b6-f4e627904fc7 None admin] RBAC: Authorizing `identity:get_project(project_id=c32dd153f5284943a7a036275c792a45)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:37.048909 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f8033e-4b57-42d9-b0b6-f4e627904fc7 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:37.051293 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 112/222] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Oct 13 10:57:36 2022] GET /identity/v3/projects/c32dd153f5284943a7a036275c792a45 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:37.058181 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a640d5-6db5-4dc4-a10d-d96e92db5925 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:37.111652 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:37.159692 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a640d5-6db5-4dc4-a10d-d96e92db5925 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:37.194263 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d563682e-12ea-4b7f-b1ee-4ab113101fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:37.195109 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563682e-12ea-4b7f-b1ee-4ab113101fdc None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:37.195583 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563682e-12ea-4b7f-b1ee-4ab113101fdc None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:37.196053 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563682e-12ea-4b7f-b1ee-4ab113101fdc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:37.197013 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d563682e-12ea-4b7f-b1ee-4ab113101fdc None admin] RBAC: Adding query filter params (role.id=97c7067aa1ca411c9b8d3596c4d6abf6, scope.project.id=c32dd153f5284943a7a036275c792a45, user.id=ed1b7957156a45ef92f9fc736f0fdd77) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:37.197522 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d563682e-12ea-4b7f-b1ee-4ab113101fdc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:37.199244 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d563682e-12ea-4b7f-b1ee-4ab113101fdc None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:37.205221 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 111/223] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Oct 13 10:57:37 2022] GET /identity/v3/role_assignments?user.id=ed1b7957156a45ef92f9fc736f0fdd77&scope.project.id=c32dd153f5284943a7a036275c792a45&role.id=97c7067aa1ca411c9b8d3596c4d6abf6 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:38.305497 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf07f18-12b6-41d8-a778-3e7393e41409 None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:38.306064 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf07f18-12b6-41d8-a778-3e7393e41409 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:38.306064 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf07f18-12b6-41d8-a778-3e7393e41409 None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:38.307553 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 113/224] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:57:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:38.312720 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f25246-8f87-46cb-b44f-b650009e47e0 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:38.313116 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f25246-8f87-46cb-b44f-b650009e47e0 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:38.313317 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f25246-8f87-46cb-b44f-b650009e47e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:38.316705 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068dfde0-a48d-4f53-96dc-a0f5bd76eb9e None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:38.317046 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068dfde0-a48d-4f53-96dc-a0f5bd76eb9e None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:38.317815 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068dfde0-a48d-4f53-96dc-a0f5bd76eb9e None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:38.319240 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 114/225] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:57:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:38.320109 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8189f9f2-924b-48f9-9af9-31ed91dda103 None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:38.320392 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8189f9f2-924b-48f9-9af9-31ed91dda103 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:38.320670 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8189f9f2-924b-48f9-9af9-31ed91dda103 None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:38.322279 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 115/226] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:57:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:38.323909 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42a9fa-3234-4ff0-9b8e-68542500c101 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:38.324198 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42a9fa-3234-4ff0-9b8e-68542500c101 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:38.324471 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42a9fa-3234-4ff0-9b8e-68542500c101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:38.332683 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-72f25246-8f87-46cb-b44f-b650009e47e0 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:38.334457 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-72f25246-8f87-46cb-b44f-b650009e47e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:38.342437 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-5e42a9fa-3234-4ff0-9b8e-68542500c101 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:38.343594 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-5e42a9fa-3234-4ff0-9b8e-68542500c101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:38.398658 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 112/227] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:57:38.402115 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d3275-46e0-46a6-9b7b-e92c49b7e98a None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:38.402115 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d3275-46e0-46a6-9b7b-e92c49b7e98a None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:38.402115 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d3275-46e0-46a6-9b7b-e92c49b7e98a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:38.413476 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 116/228] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 13 10:57:38.417631 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-d84d3275-46e0-46a6-9b7b-e92c49b7e98a None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:38.418823 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-d84d3275-46e0-46a6-9b7b-e92c49b7e98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:38.460437 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:38.485030 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 113/229] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:57:38.667438 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e42a9fa-3234-4ff0-9b8e-68542500c101 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:38.670276 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:38.685274 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d3275-46e0-46a6-9b7b-e92c49b7e98a None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:38.767417 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e42a9fa-3234-4ff0-9b8e-68542500c101 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:38.787040 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d3275-46e0-46a6-9b7b-e92c49b7e98a None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:38.801543 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b2515d-ace2-45e0-9121-94c15974937f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:38.802336 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b2515d-ace2-45e0-9121-94c15974937f None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:38.802623 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b2515d-ace2-45e0-9121-94c15974937f None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:38.802887 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b2515d-ace2-45e0-9121-94c15974937f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:38.803983 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b2515d-ace2-45e0-9121-94c15974937f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:38.805407 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b2515d-ace2-45e0-9121-94c15974937f None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:38.807144 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 117/230] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 10:57:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:38.807821 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b2515d-ace2-45e0-9121-94c15974937f None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:38.820862 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f8bf9f-17c0-4552-bd43-06f98ebe7fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:38.821499 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8bf9f-17c0-4552-bd43-06f98ebe7fdf None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:38.821775 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8bf9f-17c0-4552-bd43-06f98ebe7fdf None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:38.822081 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8bf9f-17c0-4552-bd43-06f98ebe7fdf None admin] PATH_INFO: `/v3/roles/member` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:38.832076 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f8bf9f-17c0-4552-bd43-06f98ebe7fdf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:57:38.837519 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-95f8bf9f-17c0-4552-bd43-06f98ebe7fdf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 13 10:57:38.837519 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:38.837519 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:57:38.837519 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:57:38.837519 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:57:38.837519 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:57:38.837519 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:57:38.837519 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:57:38.837519 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:57:38.837519 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:57:38.837519 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:57:38.837519 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:57:38.837519 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:57:38.837519 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:57:38.837519 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:57:38.837519 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:57:38.838530 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:57:38.838530 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:57:38.838530 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:57:38.838530 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:57:38.838530 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:57:38.838530 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:57:38.838530 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:57:38.838530 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:57:38.838530 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:57:38.838530 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:57:38.838530 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:57:38.838530 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 10:57:38.838530 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:57:38.838530 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:57:38.838530 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:57:38.838530 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:57:38.839286 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:57:38.839286 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:57:38.839286 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:57:38.839286 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:57:38.839286 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:57:38.839286 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:57:38.839286 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:57:38.839286 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:57:38.839286 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:57:38.839286 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:57:38.839286 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 13 10:57:38.839286 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:57:38.839286 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 114/231] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 10:57:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 10:57:38.842877 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f8bf9f-17c0-4552-bd43-06f98ebe7fdf None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:38.876591 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:38.877249 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:38.909039 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b2515d-ace2-45e0-9121-94c15974937f None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:38.941515 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23abc759-4021-4fef-be64-58b9b698b17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:38.941759 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f8bf9f-17c0-4552-bd43-06f98ebe7fdf None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:38.942686 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23abc759-4021-4fef-be64-58b9b698b17c None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:38.942972 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23abc759-4021-4fef-be64-58b9b698b17c None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:38.943248 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23abc759-4021-4fef-be64-58b9b698b17c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:38.953147 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23abc759-4021-4fef-be64-58b9b698b17c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:57:38.958568 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-23abc759-4021-4fef-be64-58b9b698b17c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 13 10:57:38.958568 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:38.958568 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:57:38.958568 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:57:38.958568 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:57:38.958568 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:57:38.958568 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:57:38.958568 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:57:38.958568 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:57:38.958568 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:57:38.958568 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:57:38.958568 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:57:38.958568 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:57:38.958568 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:57:38.958568 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:57:38.958568 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:57:38.959436 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:57:38.959436 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:57:38.959436 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:57:38.959436 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:57:38.959436 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:57:38.959436 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:57:38.959436 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:57:38.959436 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:57:38.959436 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:57:38.959436 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:57:38.959436 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:57:38.959436 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:57:38.959436 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:57:38.959436 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:57:38.959436 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:57:38.959436 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:57:38.960208 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:57:38.960208 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:57:38.960208 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:57:38.960208 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:57:38.960208 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:57:38.960208 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:57:38.960208 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:57:38.960208 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:57:38.960208 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:57:38.960208 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:57:38.960208 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 13 10:57:38.960208 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:57:38.960208 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 118/232] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 10:57:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:57:38.960839 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23abc759-4021-4fef-be64-58b9b698b17c None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:38.977717 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18becd12-252f-4c80-adc2-eab3afa22ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:38.978366 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18becd12-252f-4c80-adc2-eab3afa22ee6 None admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:38.978638 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18becd12-252f-4c80-adc2-eab3afa22ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:38.978904 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18becd12-252f-4c80-adc2-eab3afa22ee6 None admin] PATH_INFO: `/v3/groups` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:38.979525 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18becd12-252f-4c80-adc2-eab3afa22ee6 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:38.980945 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18becd12-252f-4c80-adc2-eab3afa22ee6 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:38.996485 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 115/233] 10.222.0.25 () {60 vars in 1134 bytes} [Thu Oct 13 10:57:38 2022] POST /identity/v3/groups => generated 229 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 10:57:38.997270 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18becd12-252f-4c80-adc2-eab3afa22ee6 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:39.072567 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23abc759-4021-4fef-be64-58b9b698b17c None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:39.104675 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:39.108734 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:39.111130 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da30d813-1091-426b-be5d-e23e7c1e4a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:39.112027 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30d813-1091-426b-be5d-e23e7c1e4a9e None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:39.112295 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30d813-1091-426b-be5d-e23e7c1e4a9e None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:39.112621 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30d813-1091-426b-be5d-e23e7c1e4a9e None admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:39.113310 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da30d813-1091-426b-be5d-e23e7c1e4a9e None admin] RBAC: Adding query filter params (name=member) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:39.113617 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da30d813-1091-426b-be5d-e23e7c1e4a9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:39.115169 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da30d813-1091-426b-be5d-e23e7c1e4a9e None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:39.118041 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18becd12-252f-4c80-adc2-eab3afa22ee6 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:39.126823 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 119/234] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Oct 13 10:57:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:39.132856 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da30d813-1091-426b-be5d-e23e7c1e4a9e None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:39.157150 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0f02e8-a302-41b9-a22f-ab399eb819a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:39.157770 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f02e8-a302-41b9-a22f-ab399eb819a4 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:39.158190 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f02e8-a302-41b9-a22f-ab399eb819a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:39.158469 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f02e8-a302-41b9-a22f-ab399eb819a4 None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:39.159145 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0f02e8-a302-41b9-a22f-ab399eb819a4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:39.159456 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0f02e8-a302-41b9-a22f-ab399eb819a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:39.160987 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0f02e8-a302-41b9-a22f-ab399eb819a4 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:39.174819 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 116/235] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Oct 13 10:57:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:39.175946 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0f02e8-a302-41b9-a22f-ab399eb819a4 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:39.252524 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da30d813-1091-426b-be5d-e23e7c1e4a9e None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:39.282198 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0f02e8-a302-41b9-a22f-ab399eb819a4 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:39.287604 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e239158-ee0e-476d-991d-da4b3b53bf3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:39.288238 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e239158-ee0e-476d-991d-da4b3b53bf3b None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:39.288516 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e239158-ee0e-476d-991d-da4b3b53bf3b None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:39.288787 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e239158-ee0e-476d-991d-da4b3b53bf3b None admin] PATH_INFO: `/v3/users/30b54193430d48c390cb2d115e20d808` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:39.290048 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e239158-ee0e-476d-991d-da4b3b53bf3b None admin] RBAC: Authorizing `identity:get_user(user_id=30b54193430d48c390cb2d115e20d808)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:39.291616 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e239158-ee0e-476d-991d-da4b3b53bf3b None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:39.293601 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 120/236] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Oct 13 10:57:39 2022] GET /identity/v3/users/30b54193430d48c390cb2d115e20d808 => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:57:39.298723 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e239158-ee0e-476d-991d-da4b3b53bf3b None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:39.319015 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98027a54-7813-4e27-92c7-68c559f6af48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:39.319645 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98027a54-7813-4e27-92c7-68c559f6af48 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:39.319921 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98027a54-7813-4e27-92c7-68c559f6af48 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:39.320191 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98027a54-7813-4e27-92c7-68c559f6af48 None admin] PATH_INFO: `/v3/users/ea54ef718dbb4cf2ac2faf5ccb36f2e5` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:39.335435 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98027a54-7813-4e27-92c7-68c559f6af48 None admin] RBAC: Authorizing `identity:get_user(user_id=ea54ef718dbb4cf2ac2faf5ccb36f2e5)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:39.336897 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98027a54-7813-4e27-92c7-68c559f6af48 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:39.338736 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 117/237] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Oct 13 10:57:39 2022] GET /identity/v3/users/ea54ef718dbb4cf2ac2faf5ccb36f2e5 => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:39.344281 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98027a54-7813-4e27-92c7-68c559f6af48 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:39.360340 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:39.364441 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:39.404034 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e239158-ee0e-476d-991d-da4b3b53bf3b None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:39.441934 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6e7275-72ee-4c67-bfa6-05dbb09c728f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:39.442683 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e7275-72ee-4c67-bfa6-05dbb09c728f None admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:39.442961 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e7275-72ee-4c67-bfa6-05dbb09c728f None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:39.443229 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e7275-72ee-4c67-bfa6-05dbb09c728f None admin] PATH_INFO: `/v3/system/users/30b54193430d48c390cb2d115e20d808/roles/7c3871c0ab68438b9014489d50b53a22` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:39.444639 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6e7275-72ee-4c67-bfa6-05dbb09c728f None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=30b54193430d48c390cb2d115e20d808, role_id=7c3871c0ab68438b9014489d50b53a22)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:39.446049 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6e7275-72ee-4c67-bfa6-05dbb09c728f None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:39.449355 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98027a54-7813-4e27-92c7-68c559f6af48 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:39.455886 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 121/238] 10.222.0.25 () {58 vars in 1334 bytes} [Thu Oct 13 10:57:39 2022] PUT /identity/v3/system/users/30b54193430d48c390cb2d115e20d808/roles/7c3871c0ab68438b9014489d50b53a22 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 10:57:39.488893 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ad57e5-fcf6-4461-90e3-638f07663486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:39.490073 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad57e5-fcf6-4461-90e3-638f07663486 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:39.490350 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad57e5-fcf6-4461-90e3-638f07663486 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:39.490616 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad57e5-fcf6-4461-90e3-638f07663486 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:39.491350 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ad57e5-fcf6-4461-90e3-638f07663486 None admin] RBAC: Adding query filter params (role.id=97c7067aa1ca411c9b8d3596c4d6abf6, user.id=ea54ef718dbb4cf2ac2faf5ccb36f2e5, scope.system=all) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:39.491655 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ad57e5-fcf6-4461-90e3-638f07663486 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:39.493275 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ad57e5-fcf6-4461-90e3-638f07663486 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:39.501672 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 118/239] 10.222.0.25 () {56 vars in 1308 bytes} [Thu Oct 13 10:57:39 2022] GET /identity/v3/role_assignments?user.id=ea54ef718dbb4cf2ac2faf5ccb36f2e5&scope.system=all&role.id=97c7067aa1ca411c9b8d3596c4d6abf6 => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:41.171776 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ecade7-a6dc-40b6-a07c-315179bf3569 None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:41.172298 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ecade7-a6dc-40b6-a07c-315179bf3569 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:41.172298 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ecade7-a6dc-40b6-a07c-315179bf3569 None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:41.173796 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 122/240] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:57:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:41.179093 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782f9f9-097f-41cd-9bda-5fd0c777ca3d None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:41.179501 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782f9f9-097f-41cd-9bda-5fd0c777ca3d None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:41.179656 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782f9f9-097f-41cd-9bda-5fd0c777ca3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:41.198605 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-1782f9f9-097f-41cd-9bda-5fd0c777ca3d None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:41.199788 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-1782f9f9-097f-41cd-9bda-5fd0c777ca3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:41.267867 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 119/241] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:57:41.531253 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ecade7-a6dc-40b6-a07c-315179bf3569 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:41.640976 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ecade7-a6dc-40b6-a07c-315179bf3569 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:41.664403 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:41.677264 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c7cad-dd35-450e-ad8c-a879cab21b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:41.677897 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c7cad-dd35-450e-ad8c-a879cab21b9d None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:41.678199 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c7cad-dd35-450e-ad8c-a879cab21b9d None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:41.678470 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c7cad-dd35-450e-ad8c-a879cab21b9d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:41.679559 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767c7cad-dd35-450e-ad8c-a879cab21b9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:41.680981 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767c7cad-dd35-450e-ad8c-a879cab21b9d None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:41.682770 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 123/242] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 10:57:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:41.687731 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c7cad-dd35-450e-ad8c-a879cab21b9d None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:41.687863 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85c554-e3c2-4554-9685-0dbf447602aa None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:41.688220 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85c554-e3c2-4554-9685-0dbf447602aa None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:41.688502 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85c554-e3c2-4554-9685-0dbf447602aa None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:41.689984 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 120/243] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:57:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 10:57:41.695605 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161d568-63e4-4aec-8498-64640060af77 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:41.695885 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161d568-63e4-4aec-8498-64640060af77 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:41.696160 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161d568-63e4-4aec-8498-64640060af77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:41.713846 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-9161d568-63e4-4aec-8498-64640060af77 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:41.715087 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-9161d568-63e4-4aec-8498-64640060af77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:41.718497 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:41.780051 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 121/244] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 13 10:57:41.783276 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d395b21-62fb-4253-bc1c-8c3f3d351efb None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:41.783496 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d395b21-62fb-4253-bc1c-8c3f3d351efb None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:41.783872 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d395b21-62fb-4253-bc1c-8c3f3d351efb None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:41.785492 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 122/245] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:57:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:41.790989 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c7cad-dd35-450e-ad8c-a879cab21b9d None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:41.791289 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f55c6-7862-4de5-99b7-18a44868727a None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:41.791554 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f55c6-7862-4de5-99b7-18a44868727a None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:41.791826 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f55c6-7862-4de5-99b7-18a44868727a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:41.809826 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-2e1f55c6-7862-4de5-99b7-18a44868727a None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:41.811111 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-2e1f55c6-7862-4de5-99b7-18a44868727a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:41.824098 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da1f8ab-ad18-4ad4-b237-f7110f2a2e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:41.824705 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da1f8ab-ad18-4ad4-b237-f7110f2a2e0f None admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:41.824979 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da1f8ab-ad18-4ad4-b237-f7110f2a2e0f None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:41.825235 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da1f8ab-ad18-4ad4-b237-f7110f2a2e0f None admin] PATH_INFO: `/v3/groups` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:41.825851 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da1f8ab-ad18-4ad4-b237-f7110f2a2e0f None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:41.827309 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da1f8ab-ad18-4ad4-b237-f7110f2a2e0f None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:41.843859 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 124/246] 10.222.0.25 () {60 vars in 1134 bytes} [Thu Oct 13 10:57:41 2022] POST /identity/v3/groups => generated 226 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 10:57:41.891584 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 123/247] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:57:42.054784 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da1f8ab-ad18-4ad4-b237-f7110f2a2e0f None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:42.112047 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:42.162886 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1f55c6-7862-4de5-99b7-18a44868727a None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:42.163080 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da1f8ab-ad18-4ad4-b237-f7110f2a2e0f None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:42.202763 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3b2d90-75ee-44ac-a78a-384b5b81bc24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:42.203411 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b2d90-75ee-44ac-a78a-384b5b81bc24 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:42.203411 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b2d90-75ee-44ac-a78a-384b5b81bc24 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:42.203411 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b2d90-75ee-44ac-a78a-384b5b81bc24 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:42.215802 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3b2d90-75ee-44ac-a78a-384b5b81bc24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:57:42.221833 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-4e3b2d90-75ee-44ac-a78a-384b5b81bc24 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 13 10:57:42.221833 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:42.221833 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:57:42.221833 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:57:42.221833 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:57:42.221833 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:57:42.221833 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:57:42.221833 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:57:42.221833 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:57:42.221833 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:57:42.221833 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:57:42.221833 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:57:42.221833 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:57:42.221833 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:57:42.221833 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:57:42.221833 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:57:42.222857 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:57:42.222857 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:57:42.222857 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:57:42.222857 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:57:42.222857 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:57:42.222857 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:57:42.222857 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:57:42.222857 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:57:42.222857 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:57:42.222857 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:57:42.222857 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:57:42.222857 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:57:42.222857 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:57:42.222857 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:57:42.222857 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:57:42.222857 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:57:42.228809 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:57:42.228809 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:57:42.228809 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:57:42.228809 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:57:42.228809 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:57:42.228809 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:57:42.228809 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:57:42.228809 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:57:42.228809 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:57:42.228809 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:57:42.228809 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 13 10:57:42.228809 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:57:42.228809 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 125/248] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 10:57:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:57:42.230940 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3b2d90-75ee-44ac-a78a-384b5b81bc24 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:42.269991 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:42.320879 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1f55c6-7862-4de5-99b7-18a44868727a None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:42.351903 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3b2d90-75ee-44ac-a78a-384b5b81bc24 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:42.363285 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5f909d-dc84-4ec4-a0a1-5cd28f57adb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:42.364593 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f909d-dc84-4ec4-a0a1-5cd28f57adb8 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:42.364959 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f909d-dc84-4ec4-a0a1-5cd28f57adb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:42.365356 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f909d-dc84-4ec4-a0a1-5cd28f57adb8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:42.367714 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:42.377768 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5f909d-dc84-4ec4-a0a1-5cd28f57adb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:57:42.383410 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-fc5f909d-dc84-4ec4-a0a1-5cd28f57adb8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 13 10:57:42.383410 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:42.383410 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:57:42.383410 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:57:42.383410 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:57:42.383410 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:57:42.383410 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:57:42.383410 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:57:42.383410 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:57:42.383410 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:57:42.383410 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:57:42.383410 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:57:42.383410 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:57:42.383410 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:57:42.383410 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:57:42.383410 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:57:42.384360 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:57:42.384360 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:57:42.384360 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:57:42.384360 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:57:42.384360 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:57:42.384360 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:57:42.384360 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:57:42.384360 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:57:42.384360 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:57:42.384360 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:57:42.384360 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:57:42.384360 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 10:57:42.384360 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:57:42.384360 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:57:42.384360 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:57:42.384360 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:57:42.385130 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:57:42.385130 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:57:42.385130 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:57:42.385130 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:57:42.385130 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:57:42.385130 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:57:42.385130 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:57:42.385130 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:57:42.385130 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:57:42.385130 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:57:42.385130 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 13 10:57:42.385130 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:57:42.390248 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 124/249] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 10:57:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:57:42.393172 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5f909d-dc84-4ec4-a0a1-5cd28f57adb8 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:42.403409 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93991da-d1d5-4c30-bb17-9f4b38fae1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:42.404041 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93991da-d1d5-4c30-bb17-9f4b38fae1ef None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:42.404319 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93991da-d1d5-4c30-bb17-9f4b38fae1ef None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:42.404589 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93991da-d1d5-4c30-bb17-9f4b38fae1ef None admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:42.405270 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93991da-d1d5-4c30-bb17-9f4b38fae1ef None admin] RBAC: Adding query filter params (name=reader) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:42.405574 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93991da-d1d5-4c30-bb17-9f4b38fae1ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:42.407696 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93991da-d1d5-4c30-bb17-9f4b38fae1ef None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:42.424672 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 126/250] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Oct 13 10:57:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:57:42.425931 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93991da-d1d5-4c30-bb17-9f4b38fae1ef None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:42.518474 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5f909d-dc84-4ec4-a0a1-5cd28f57adb8 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:42.556853 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:42.559719 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93991da-d1d5-4c30-bb17-9f4b38fae1ef None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:42.570418 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c99a48-f594-4dd9-9c3c-c66550568346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:42.571089 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c99a48-f594-4dd9-9c3c-c66550568346 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:42.571306 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c99a48-f594-4dd9-9c3c-c66550568346 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:42.571578 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c99a48-f594-4dd9-9c3c-c66550568346 None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:42.572244 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c99a48-f594-4dd9-9c3c-c66550568346 None admin] RBAC: Adding query filter params (name=member) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:42.572547 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c99a48-f594-4dd9-9c3c-c66550568346 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:42.573924 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c99a48-f594-4dd9-9c3c-c66550568346 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:42.584098 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 125/251] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Oct 13 10:57:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:57:42.589899 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c99a48-f594-4dd9-9c3c-c66550568346 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:42.603078 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053266e0-0aa3-4d43-a72e-c1266d0152a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:42.603716 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053266e0-0aa3-4d43-a72e-c1266d0152a9 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:42.606078 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053266e0-0aa3-4d43-a72e-c1266d0152a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:42.606194 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053266e0-0aa3-4d43-a72e-c1266d0152a9 None admin] PATH_INFO: `/v3/users/ea54ef718dbb4cf2ac2faf5ccb36f2e5` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:42.607375 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053266e0-0aa3-4d43-a72e-c1266d0152a9 None admin] RBAC: Authorizing `identity:get_user(user_id=ea54ef718dbb4cf2ac2faf5ccb36f2e5)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:42.609516 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053266e0-0aa3-4d43-a72e-c1266d0152a9 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:42.611726 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 127/252] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Oct 13 10:57:42 2022] GET /identity/v3/users/ea54ef718dbb4cf2ac2faf5ccb36f2e5 => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:42.620099 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053266e0-0aa3-4d43-a72e-c1266d0152a9 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:42.678744 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:42.724626 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c99a48-f594-4dd9-9c3c-c66550568346 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:42.753599 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053266e0-0aa3-4d43-a72e-c1266d0152a9 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:42.798278 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d031f63a-c359-4c22-a733-0446fd38a144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:42.800874 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d031f63a-c359-4c22-a733-0446fd38a144 None admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:42.801714 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d031f63a-c359-4c22-a733-0446fd38a144 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:42.802694 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d031f63a-c359-4c22-a733-0446fd38a144 None admin] PATH_INFO: `/v3/system/users/ea54ef718dbb4cf2ac2faf5ccb36f2e5/roles/97c7067aa1ca411c9b8d3596c4d6abf6` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:42.804660 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d031f63a-c359-4c22-a733-0446fd38a144 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ea54ef718dbb4cf2ac2faf5ccb36f2e5, role_id=97c7067aa1ca411c9b8d3596c4d6abf6)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:42.806600 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d031f63a-c359-4c22-a733-0446fd38a144 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:42.809481 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2ad5d6-c4c6-48dd-bfc0-26646e4c610d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:42.810313 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ad5d6-c4c6-48dd-bfc0-26646e4c610d None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:42.810752 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ad5d6-c4c6-48dd-bfc0-26646e4c610d None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:42.811165 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ad5d6-c4c6-48dd-bfc0-26646e4c610d None admin] PATH_INFO: `/v3/users/30b54193430d48c390cb2d115e20d808` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:42.813420 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2ad5d6-c4c6-48dd-bfc0-26646e4c610d None admin] RBAC: Authorizing `identity:get_user(user_id=30b54193430d48c390cb2d115e20d808)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:42.815068 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2ad5d6-c4c6-48dd-bfc0-26646e4c610d None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:42.819071 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 126/253] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Oct 13 10:57:42 2022] GET /identity/v3/users/30b54193430d48c390cb2d115e20d808 => generated 293 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:57:42.826548 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2ad5d6-c4c6-48dd-bfc0-26646e4c610d None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:42.830605 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 128/254] 10.222.0.25 () {58 vars in 1334 bytes} [Thu Oct 13 10:57:42 2022] PUT /identity/v3/system/users/ea54ef718dbb4cf2ac2faf5ccb36f2e5/roles/97c7067aa1ca411c9b8d3596c4d6abf6 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 10:57:42.921498 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:42.972630 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2ad5d6-c4c6-48dd-bfc0-26646e4c610d None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:43.016540 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dd1ce6-ec21-4765-a16e-6b0054d64b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:43.017166 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd1ce6-ec21-4765-a16e-6b0054d64b1c None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:43.017442 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd1ce6-ec21-4765-a16e-6b0054d64b1c None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:43.017716 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd1ce6-ec21-4765-a16e-6b0054d64b1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:43.018485 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dd1ce6-ec21-4765-a16e-6b0054d64b1c None admin] RBAC: Adding query filter params (role.id=7c3871c0ab68438b9014489d50b53a22, user.id=30b54193430d48c390cb2d115e20d808, scope.system=all) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:43.018849 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dd1ce6-ec21-4765-a16e-6b0054d64b1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:43.020920 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dd1ce6-ec21-4765-a16e-6b0054d64b1c None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:43.034576 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 127/255] 10.222.0.25 () {56 vars in 1308 bytes} [Thu Oct 13 10:57:42 2022] GET /identity/v3/role_assignments?user.id=30b54193430d48c390cb2d115e20d808&scope.system=all&role.id=7c3871c0ab68438b9014489d50b53a22 => generated 510 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:44.368817 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f8570-3793-471a-85fa-f424638e01b3 None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:44.369326 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f8570-3793-471a-85fa-f424638e01b3 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:44.369429 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f8570-3793-471a-85fa-f424638e01b3 None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:44.370714 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 129/256] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:57:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:44.376209 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f37fd-a3ad-48cd-8223-139b22e68ca0 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:44.377022 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f37fd-a3ad-48cd-8223-139b22e68ca0 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:44.377505 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f37fd-a3ad-48cd-8223-139b22e68ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:44.403180 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-6a7f37fd-a3ad-48cd-8223-139b22e68ca0 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:44.404712 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-6a7f37fd-a3ad-48cd-8223-139b22e68ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:44.485216 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 128/257] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:44 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 13 10:57:44.969667 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0f8570-3793-471a-85fa-f424638e01b3 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:44.985557 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0f8570-3793-471a-85fa-f424638e01b3 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:44.991927 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fff4f3-ec63-45f5-9f7b-031b9c75c595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:44.992858 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fff4f3-ec63-45f5-9f7b-031b9c75c595 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:44.993308 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fff4f3-ec63-45f5-9f7b-031b9c75c595 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:44.993747 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fff4f3-ec63-45f5-9f7b-031b9c75c595 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:45.008064 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fff4f3-ec63-45f5-9f7b-031b9c75c595 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:57:45.013308 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-e6fff4f3-ec63-45f5-9f7b-031b9c75c595 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 13 10:57:45.013308 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:45.013308 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:57:45.013308 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:57:45.013308 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:57:45.013308 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:57:45.013308 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:57:45.013308 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:57:45.013308 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:57:45.013308 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:57:45.013308 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:57:45.013308 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:57:45.013308 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:57:45.013308 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:57:45.013308 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:57:45.013308 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:57:45.014168 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:57:45.014168 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:57:45.014168 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:57:45.014168 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:57:45.014168 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:57:45.014168 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:57:45.014168 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:57:45.014168 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:57:45.014168 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:57:45.014168 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:57:45.014168 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:57:45.014168 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:57:45.014168 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:57:45.014168 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:57:45.014168 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:57:45.014168 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:57:45.014975 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:57:45.014975 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:57:45.014975 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:57:45.014975 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:57:45.014975 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:57:45.014975 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:57:45.014975 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:57:45.014975 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:57:45.014975 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:57:45.014975 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:57:45.014975 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 13 10:57:45.014975 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:57:45.017226 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 130/258] 10.222.0.25 () {56 vars in 1120 bytes} [Thu Oct 13 10:57:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:57:45.022763 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7f37fd-a3ad-48cd-8223-139b22e68ca0 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:45.039658 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7f37fd-a3ad-48cd-8223-139b22e68ca0 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:45.045985 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b4bc1-9c0b-464c-a684-4e1e7ad691de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:45.046609 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b4bc1-9c0b-464c-a684-4e1e7ad691de admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:45.046891 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b4bc1-9c0b-464c-a684-4e1e7ad691de admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:45.047170 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b4bc1-9c0b-464c-a684-4e1e7ad691de admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:45.047849 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6b4bc1-9c0b-464c-a684-4e1e7ad691de admin admin] RBAC: Adding query filter params (name=member) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:45.048154 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6b4bc1-9c0b-464c-a684-4e1e7ad691de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:45.049950 dv-cinder-861001-1-smb devstack@keystone.service[81550]: WARNING py.warnings [None req-1c6b4bc1-9c0b-464c-a684-4e1e7ad691de admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 10:57:45.049950 dv-cinder-861001-1-smb devstack@keystone.service[81550]: warnings.warn(msg) Oct 13 10:57:45.049950 dv-cinder-861001-1-smb devstack@keystone.service[81550]: Oct 13 10:57:45.050859 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6b4bc1-9c0b-464c-a684-4e1e7ad691de admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:45.066030 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 129/259] 10.222.0.25 () {56 vars in 1122 bytes} [Thu Oct 13 10:57:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:45.071758 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fff4f3-ec63-45f5-9f7b-031b9c75c595 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:45.084406 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fff4f3-ec63-45f5-9f7b-031b9c75c595 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:45.092836 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac34852-f846-461e-9e38-2f16cf443d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:45.093730 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac34852-f846-461e-9e38-2f16cf443d65 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:45.094225 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac34852-f846-461e-9e38-2f16cf443d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:45.094689 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac34852-f846-461e-9e38-2f16cf443d65 admin admin] PATH_INFO: `/v3/groups/63f369b2301643f2afe01dd346cdd0e2` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:45.104626 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac34852-f846-461e-9e38-2f16cf443d65 admin admin] RBAC: Authorizing `identity:get_group(group_id=63f369b2301643f2afe01dd346cdd0e2)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:45.106670 dv-cinder-861001-1-smb devstack@keystone.service[81551]: WARNING py.warnings [None req-7ac34852-f846-461e-9e38-2f16cf443d65 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 13 10:57:45.106670 dv-cinder-861001-1-smb devstack@keystone.service[81551]: warnings.warn(msg) Oct 13 10:57:45.106670 dv-cinder-861001-1-smb devstack@keystone.service[81551]: Oct 13 10:57:45.108294 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac34852-f846-461e-9e38-2f16cf443d65 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:45.110182 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 131/260] 10.222.0.25 () {56 vars in 1201 bytes} [Thu Oct 13 10:57:45 2022] GET /identity/v3/groups/63f369b2301643f2afe01dd346cdd0e2 => generated 226 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:45.116155 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b4bc1-9c0b-464c-a684-4e1e7ad691de admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:45.127668 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b4bc1-9c0b-464c-a684-4e1e7ad691de admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:45.134141 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41adabab-267d-44e4-8bf3-2dfa3a9326ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:45.134733 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41adabab-267d-44e4-8bf3-2dfa3a9326ec admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:45.135127 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41adabab-267d-44e4-8bf3-2dfa3a9326ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:45.135414 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41adabab-267d-44e4-8bf3-2dfa3a9326ec admin admin] PATH_INFO: `/v3/projects/c72ae97522d241759a7f02e813ff1aab` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:45.142703 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41adabab-267d-44e4-8bf3-2dfa3a9326ec admin admin] RBAC: Authorizing `identity:get_project(project_id=c72ae97522d241759a7f02e813ff1aab)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:45.144817 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41adabab-267d-44e4-8bf3-2dfa3a9326ec admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:45.146967 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 130/261] 10.222.0.25 () {56 vars in 1207 bytes} [Thu Oct 13 10:57:45 2022] GET /identity/v3/projects/c72ae97522d241759a7f02e813ff1aab => generated 298 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:45.152454 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac34852-f846-461e-9e38-2f16cf443d65 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:45.159358 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb59fa-4c25-4f2e-8642-58601fc56b9a None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:45.159626 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb59fa-4c25-4f2e-8642-58601fc56b9a None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:45.159910 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb59fa-4c25-4f2e-8642-58601fc56b9a None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:45.162447 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 131/262] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:57:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:45.166569 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac34852-f846-461e-9e38-2f16cf443d65 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:45.167776 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b94d913-3fbd-4854-8d2a-b054245957f3 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:45.168065 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b94d913-3fbd-4854-8d2a-b054245957f3 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:45.168347 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b94d913-3fbd-4854-8d2a-b054245957f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:45.172897 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a15bd8-5955-4ed1-bfb2-3408ab90fa48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:45.173863 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a15bd8-5955-4ed1-bfb2-3408ab90fa48 admin admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:45.174358 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a15bd8-5955-4ed1-bfb2-3408ab90fa48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:45.174852 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a15bd8-5955-4ed1-bfb2-3408ab90fa48 admin admin] PATH_INFO: `/v3/projects/c72ae97522d241759a7f02e813ff1aab/groups/63f369b2301643f2afe01dd346cdd0e2/roles/7c3871c0ab68438b9014489d50b53a22` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:45.177167 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a15bd8-5955-4ed1-bfb2-3408ab90fa48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c72ae97522d241759a7f02e813ff1aab, group_id=63f369b2301643f2afe01dd346cdd0e2, role_id=7c3871c0ab68438b9014489d50b53a22)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:45.178790 dv-cinder-861001-1-smb devstack@keystone.service[81551]: WARNING py.warnings [None req-c0a15bd8-5955-4ed1-bfb2-3408ab90fa48 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 13 10:57:45.178790 dv-cinder-861001-1-smb devstack@keystone.service[81551]: warnings.warn(msg) Oct 13 10:57:45.178790 dv-cinder-861001-1-smb devstack@keystone.service[81551]: Oct 13 10:57:45.181337 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a15bd8-5955-4ed1-bfb2-3408ab90fa48 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:45.201232 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 132/263] 10.222.0.25 () {58 vars in 1463 bytes} [Thu Oct 13 10:57:45 2022] PUT /identity/v3/projects/c72ae97522d241759a7f02e813ff1aab/groups/63f369b2301643f2afe01dd346cdd0e2/roles/7c3871c0ab68438b9014489d50b53a22 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 10:57:45.205288 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-9b94d913-3fbd-4854-8d2a-b054245957f3 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:45.206921 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-9b94d913-3fbd-4854-8d2a-b054245957f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:45.264024 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:45.278763 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 132/264] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 13 10:57:45.575114 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a15bd8-5955-4ed1-bfb2-3408ab90fa48 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:45.586743 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a15bd8-5955-4ed1-bfb2-3408ab90fa48 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:45.592230 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e853cf9f-e2c3-4741-a614-98c143961338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:45.592852 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e853cf9f-e2c3-4741-a614-98c143961338 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:45.593129 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e853cf9f-e2c3-4741-a614-98c143961338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:45.593394 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e853cf9f-e2c3-4741-a614-98c143961338 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:45.605053 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e853cf9f-e2c3-4741-a614-98c143961338 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:57:45.610165 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-e853cf9f-e2c3-4741-a614-98c143961338 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 13 10:57:45.610165 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:45.610165 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:57:45.610165 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:57:45.610165 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:57:45.610165 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:57:45.610165 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:57:45.610165 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:57:45.610165 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:57:45.610165 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:57:45.610165 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:57:45.610165 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:57:45.610165 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:57:45.610165 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:57:45.610165 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:57:45.610165 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:57:45.611024 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:57:45.611024 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:57:45.611024 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:57:45.611024 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:57:45.611024 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:57:45.611024 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:57:45.611024 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:57:45.611024 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:57:45.611024 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:57:45.611024 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:57:45.611024 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:57:45.611024 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:57:45.611024 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:57:45.611024 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:57:45.611024 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:57:45.611024 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:57:45.612442 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:57:45.612442 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:57:45.612442 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:57:45.612442 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:57:45.612442 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:57:45.612442 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:57:45.612442 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:57:45.612442 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:57:45.612442 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:57:45.612442 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:57:45.612442 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 13 10:57:45.612442 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:57:45.612442 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 133/265] 10.222.0.25 () {56 vars in 1135 bytes} [Thu Oct 13 10:57:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 10:57:45.617595 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b94d913-3fbd-4854-8d2a-b054245957f3 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:45.627033 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b94d913-3fbd-4854-8d2a-b054245957f3 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:45.632474 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70fc750-edfa-4d31-bcb3-ce639fcbdcf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:45.633088 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70fc750-edfa-4d31-bcb3-ce639fcbdcf5 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:45.633368 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70fc750-edfa-4d31-bcb3-ce639fcbdcf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:45.633635 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70fc750-edfa-4d31-bcb3-ce639fcbdcf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:45.634350 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70fc750-edfa-4d31-bcb3-ce639fcbdcf5 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:45.634652 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70fc750-edfa-4d31-bcb3-ce639fcbdcf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:45.636907 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70fc750-edfa-4d31-bcb3-ce639fcbdcf5 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:45.637288 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d4f4f-d051-49f7-a0cc-346094bc4d6a None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:45.637575 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d4f4f-d051-49f7-a0cc-346094bc4d6a None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:45.637845 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d4f4f-d051-49f7-a0cc-346094bc4d6a None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:45.639236 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 134/266] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:57:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 10:57:45.644480 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03afbfc-7dfa-41f1-9258-ef609683fb8d None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:45.644755 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03afbfc-7dfa-41f1-9258-ef609683fb8d None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:45.645635 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03afbfc-7dfa-41f1-9258-ef609683fb8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:45.650754 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 133/267] 10.222.0.25 () {56 vars in 1132 bytes} [Thu Oct 13 10:57:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:45.657119 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70fc750-edfa-4d31-bcb3-ce639fcbdcf5 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:45.667496 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70fc750-edfa-4d31-bcb3-ce639fcbdcf5 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:45.668722 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-f03afbfc-7dfa-41f1-9258-ef609683fb8d None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:45.670053 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-f03afbfc-7dfa-41f1-9258-ef609683fb8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:45.678559 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcdb624-504c-4142-a243-864ea4f098a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:45.679221 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcdb624-504c-4142-a243-864ea4f098a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:45.679496 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcdb624-504c-4142-a243-864ea4f098a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:45.679770 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcdb624-504c-4142-a243-864ea4f098a0 admin admin] PATH_INFO: `/v3/groups/63f369b2301643f2afe01dd346cdd0e2` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:45.681036 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcdb624-504c-4142-a243-864ea4f098a0 admin admin] RBAC: Authorizing `identity:get_group(group_id=63f369b2301643f2afe01dd346cdd0e2)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:45.682119 dv-cinder-861001-1-smb devstack@keystone.service[81550]: WARNING py.warnings [None req-9bcdb624-504c-4142-a243-864ea4f098a0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 13 10:57:45.682119 dv-cinder-861001-1-smb devstack@keystone.service[81550]: warnings.warn(msg) Oct 13 10:57:45.682119 dv-cinder-861001-1-smb devstack@keystone.service[81550]: Oct 13 10:57:45.683337 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcdb624-504c-4142-a243-864ea4f098a0 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:45.685057 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 134/268] 10.222.0.25 () {56 vars in 1201 bytes} [Thu Oct 13 10:57:45 2022] GET /identity/v3/groups/63f369b2301643f2afe01dd346cdd0e2 => generated 226 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:57:45.691390 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcdb624-504c-4142-a243-864ea4f098a0 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:45.704467 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcdb624-504c-4142-a243-864ea4f098a0 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:45.711223 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bda83ce-f6c1-49d9-b473-f525328480a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:45.712055 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda83ce-f6c1-49d9-b473-f525328480a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:45.712387 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda83ce-f6c1-49d9-b473-f525328480a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:45.712663 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda83ce-f6c1-49d9-b473-f525328480a8 admin admin] PATH_INFO: `/v3/projects/c72ae97522d241759a7f02e813ff1aab` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:45.714075 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bda83ce-f6c1-49d9-b473-f525328480a8 admin admin] RBAC: Authorizing `identity:get_project(project_id=c72ae97522d241759a7f02e813ff1aab)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:45.716878 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bda83ce-f6c1-49d9-b473-f525328480a8 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:45.719771 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 135/269] 10.222.0.25 () {56 vars in 1207 bytes} [Thu Oct 13 10:57:45 2022] GET /identity/v3/projects/c72ae97522d241759a7f02e813ff1aab => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:45.725966 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bda83ce-f6c1-49d9-b473-f525328480a8 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:45.738554 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bda83ce-f6c1-49d9-b473-f525328480a8 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:45.744430 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4028bebf-444b-4083-9768-bff9aa9ba0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:45.745305 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028bebf-444b-4083-9768-bff9aa9ba0e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:45.745590 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028bebf-444b-4083-9768-bff9aa9ba0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:45.745870 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028bebf-444b-4083-9768-bff9aa9ba0e2 admin admin] PATH_INFO: `/v3/projects/c72ae97522d241759a7f02e813ff1aab/groups/63f369b2301643f2afe01dd346cdd0e2/roles/84a5ec3770b4453bb7c3ff5b9af0bd17` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:45.748399 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4028bebf-444b-4083-9768-bff9aa9ba0e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c72ae97522d241759a7f02e813ff1aab, group_id=63f369b2301643f2afe01dd346cdd0e2, role_id=84a5ec3770b4453bb7c3ff5b9af0bd17)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:45.749989 dv-cinder-861001-1-smb devstack@keystone.service[81550]: WARNING py.warnings [None req-4028bebf-444b-4083-9768-bff9aa9ba0e2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 13 10:57:45.749989 dv-cinder-861001-1-smb devstack@keystone.service[81550]: warnings.warn(msg) Oct 13 10:57:45.749989 dv-cinder-861001-1-smb devstack@keystone.service[81550]: Oct 13 10:57:45.752259 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4028bebf-444b-4083-9768-bff9aa9ba0e2 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:45.753546 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:45.772448 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 135/270] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 13 10:57:45.781863 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 136/271] 10.222.0.25 () {58 vars in 1463 bytes} [Thu Oct 13 10:57:45 2022] PUT /identity/v3/projects/c72ae97522d241759a7f02e813ff1aab/groups/63f369b2301643f2afe01dd346cdd0e2/roles/84a5ec3770b4453bb7c3ff5b9af0bd17 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 10:57:45.868773 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af3c191-812b-44db-95c5-3aa99fe7cd1e None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:45.869046 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af3c191-812b-44db-95c5-3aa99fe7cd1e None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:45.869286 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af3c191-812b-44db-95c5-3aa99fe7cd1e None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:45.870910 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 136/272] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:57:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:45.876273 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7308f71-0c44-4dbc-8f15-c98611f3d517 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:45.876808 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7308f71-0c44-4dbc-8f15-c98611f3d517 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:45.877279 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7308f71-0c44-4dbc-8f15-c98611f3d517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:45.907678 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-a7308f71-0c44-4dbc-8f15-c98611f3d517 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:45.909278 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-a7308f71-0c44-4dbc-8f15-c98611f3d517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:45.991660 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 137/273] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 13 10:57:46.356061 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af3c191-812b-44db-95c5-3aa99fe7cd1e None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:46.360191 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7308f71-0c44-4dbc-8f15-c98611f3d517 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:46.374691 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af3c191-812b-44db-95c5-3aa99fe7cd1e None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:46.381837 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457fdcc2-ce3a-47e7-8c70-106847502d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:46.382518 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457fdcc2-ce3a-47e7-8c70-106847502d68 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:46.382795 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457fdcc2-ce3a-47e7-8c70-106847502d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:46.383068 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457fdcc2-ce3a-47e7-8c70-106847502d68 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:46.397215 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457fdcc2-ce3a-47e7-8c70-106847502d68 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:57:46.402334 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-457fdcc2-ce3a-47e7-8c70-106847502d68 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 13 10:57:46.402334 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:46.402334 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:57:46.402334 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:57:46.402334 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:57:46.402334 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:57:46.402334 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:57:46.402334 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:57:46.402334 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:57:46.402334 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:57:46.402334 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:57:46.402334 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:57:46.402334 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:57:46.402334 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:57:46.402334 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:57:46.402334 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:57:46.403186 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:57:46.403186 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:57:46.403186 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:57:46.403186 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:57:46.403186 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:57:46.403186 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:57:46.403186 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:57:46.403186 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:57:46.403186 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:57:46.403186 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:57:46.403186 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:57:46.403186 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:57:46.403186 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:57:46.403186 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:57:46.403186 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:57:46.403186 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:57:46.403959 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:57:46.403959 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:57:46.403959 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:57:46.403959 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:57:46.403959 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:57:46.403959 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:57:46.403959 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:57:46.403959 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:57:46.403959 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:57:46.403959 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:57:46.403959 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 13 10:57:46.403959 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:57:46.403959 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 137/274] 10.222.0.25 () {56 vars in 1120 bytes} [Thu Oct 13 10:57:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:57:46.413672 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457fdcc2-ce3a-47e7-8c70-106847502d68 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:46.429581 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457fdcc2-ce3a-47e7-8c70-106847502d68 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:46.434203 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de60bf-b3a3-4228-aa42-ed412a623942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:46.434809 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de60bf-b3a3-4228-aa42-ed412a623942 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:46.435191 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de60bf-b3a3-4228-aa42-ed412a623942 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:46.435528 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de60bf-b3a3-4228-aa42-ed412a623942 admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:46.436302 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54de60bf-b3a3-4228-aa42-ed412a623942 admin admin] RBAC: Adding query filter params (name=member) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:46.436656 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54de60bf-b3a3-4228-aa42-ed412a623942 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:46.437666 dv-cinder-861001-1-smb devstack@keystone.service[81551]: WARNING py.warnings [None req-54de60bf-b3a3-4228-aa42-ed412a623942 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 10:57:46.437666 dv-cinder-861001-1-smb devstack@keystone.service[81551]: warnings.warn(msg) Oct 13 10:57:46.437666 dv-cinder-861001-1-smb devstack@keystone.service[81551]: Oct 13 10:57:46.438589 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54de60bf-b3a3-4228-aa42-ed412a623942 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:46.450664 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 138/275] 10.222.0.25 () {56 vars in 1122 bytes} [Thu Oct 13 10:57:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:46.457242 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de60bf-b3a3-4228-aa42-ed412a623942 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:46.472206 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de60bf-b3a3-4228-aa42-ed412a623942 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:46.481769 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d0120-c7ff-4f21-9698-edd146d83a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:46.482458 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d0120-c7ff-4f21-9698-edd146d83a84 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:46.482737 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d0120-c7ff-4f21-9698-edd146d83a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:46.483010 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d0120-c7ff-4f21-9698-edd146d83a84 admin admin] PATH_INFO: `/v3/groups/63f369b2301643f2afe01dd346cdd0e2` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:46.484144 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2d0120-c7ff-4f21-9698-edd146d83a84 admin admin] RBAC: Authorizing `identity:get_group(group_id=63f369b2301643f2afe01dd346cdd0e2)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:46.486152 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2d0120-c7ff-4f21-9698-edd146d83a84 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:46.488046 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 139/276] 10.222.0.25 () {56 vars in 1201 bytes} [Thu Oct 13 10:57:46 2022] GET /identity/v3/groups/63f369b2301643f2afe01dd346cdd0e2 => generated 226 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:46.493968 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d0120-c7ff-4f21-9698-edd146d83a84 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:46.504880 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d0120-c7ff-4f21-9698-edd146d83a84 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:46.507166 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7308f71-0c44-4dbc-8f15-c98611f3d517 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:46.510927 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78537367-3708-4c08-bdd7-f965d4a8b31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:46.511561 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78537367-3708-4c08-bdd7-f965d4a8b31a admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:46.511891 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78537367-3708-4c08-bdd7-f965d4a8b31a admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:46.512214 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78537367-3708-4c08-bdd7-f965d4a8b31a admin admin] PATH_INFO: `/v3/projects/c32dd153f5284943a7a036275c792a45` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:46.513395 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78537367-3708-4c08-bdd7-f965d4a8b31a admin admin] RBAC: Authorizing `identity:get_project(project_id=c32dd153f5284943a7a036275c792a45)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:46.515674 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78537367-3708-4c08-bdd7-f965d4a8b31a admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:46.517849 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 140/277] 10.222.0.25 () {56 vars in 1207 bytes} [Thu Oct 13 10:57:46 2022] GET /identity/v3/projects/c32dd153f5284943a7a036275c792a45 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:57:46.523681 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78537367-3708-4c08-bdd7-f965d4a8b31a admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:46.525851 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:46.536327 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78537367-3708-4c08-bdd7-f965d4a8b31a admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:46.542378 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a96c51-401a-4c32-a814-09eea2e2a83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:46.543115 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a96c51-401a-4c32-a814-09eea2e2a83f admin admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:46.543394 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a96c51-401a-4c32-a814-09eea2e2a83f admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:46.543668 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a96c51-401a-4c32-a814-09eea2e2a83f admin admin] PATH_INFO: `/v3/projects/c32dd153f5284943a7a036275c792a45/groups/63f369b2301643f2afe01dd346cdd0e2/roles/7c3871c0ab68438b9014489d50b53a22` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:46.545927 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a96c51-401a-4c32-a814-09eea2e2a83f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c32dd153f5284943a7a036275c792a45, group_id=63f369b2301643f2afe01dd346cdd0e2, role_id=7c3871c0ab68438b9014489d50b53a22)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:46.549127 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a96c51-401a-4c32-a814-09eea2e2a83f admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:46.569409 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 141/278] 10.222.0.25 () {58 vars in 1463 bytes} [Thu Oct 13 10:57:46 2022] PUT /identity/v3/projects/c32dd153f5284943a7a036275c792a45/groups/63f369b2301643f2afe01dd346cdd0e2/roles/7c3871c0ab68438b9014489d50b53a22 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 10:57:46.570105 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc8051b-855e-4ab1-afcc-8c6792705c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:46.570845 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc8051b-855e-4ab1-afcc-8c6792705c01 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:46.571129 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc8051b-855e-4ab1-afcc-8c6792705c01 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:46.571403 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc8051b-855e-4ab1-afcc-8c6792705c01 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:46.588212 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc8051b-855e-4ab1-afcc-8c6792705c01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:57:46.593681 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-3cc8051b-855e-4ab1-afcc-8c6792705c01 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 13 10:57:46.593681 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:46.593681 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:57:46.593681 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:57:46.593681 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:57:46.593681 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:57:46.593681 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:57:46.593681 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:57:46.593681 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:57:46.593681 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:57:46.593681 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:57:46.593681 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:57:46.593681 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:57:46.593681 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:57:46.593681 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:57:46.593681 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:57:46.595867 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:57:46.595867 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:57:46.595867 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:57:46.595867 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:57:46.595867 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:57:46.595867 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:57:46.595867 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:57:46.595867 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:57:46.595867 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:57:46.595867 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:57:46.595867 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:57:46.595867 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 10:57:46.595867 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:57:46.595867 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:57:46.595867 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:57:46.595867 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:57:46.597825 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:57:46.597825 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:57:46.597825 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:57:46.597825 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:57:46.597825 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:57:46.597825 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:57:46.597825 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:57:46.597825 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:57:46.597825 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:57:46.597825 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:57:46.597825 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 13 10:57:46.597825 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:57:46.597825 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 138/279] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 10:57:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:57:46.605970 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a96c51-401a-4c32-a814-09eea2e2a83f admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:46.747332 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a96c51-401a-4c32-a814-09eea2e2a83f admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:46.793867 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24be3b0-e739-434a-b7d7-c9e11beb41fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:46.794530 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24be3b0-e739-434a-b7d7-c9e11beb41fa None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:46.794814 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24be3b0-e739-434a-b7d7-c9e11beb41fa None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:46.795087 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24be3b0-e739-434a-b7d7-c9e11beb41fa None admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:46.795786 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24be3b0-e739-434a-b7d7-c9e11beb41fa None admin] RBAC: Adding query filter params (name=reader) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:46.796095 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24be3b0-e739-434a-b7d7-c9e11beb41fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:46.797518 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24be3b0-e739-434a-b7d7-c9e11beb41fa None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:46.810014 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 142/280] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Oct 13 10:57:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:46.815921 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc8051b-855e-4ab1-afcc-8c6792705c01 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:46.849592 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa44d00-e2b7-4264-8bc3-670038a6bcd3 None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:46.849919 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa44d00-e2b7-4264-8bc3-670038a6bcd3 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:46.850171 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa44d00-e2b7-4264-8bc3-670038a6bcd3 None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:46.851634 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 143/281] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:57:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 10:57:46.857352 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d87ba-16e4-4dcb-91fa-fbaa290e0ce6 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:46.857647 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d87ba-16e4-4dcb-91fa-fbaa290e0ce6 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:46.857887 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d87ba-16e4-4dcb-91fa-fbaa290e0ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:46.899129 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-843d87ba-16e4-4dcb-91fa-fbaa290e0ce6 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:46.900383 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-843d87ba-16e4-4dcb-91fa-fbaa290e0ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:46.919455 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:46.975828 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc8051b-855e-4ab1-afcc-8c6792705c01 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:47.019588 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4175390a-ca98-4551-85ad-bb9e935661a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:47.021071 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4175390a-ca98-4551-85ad-bb9e935661a3 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:47.021494 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4175390a-ca98-4551-85ad-bb9e935661a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:47.021907 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4175390a-ca98-4551-85ad-bb9e935661a3 None admin] PATH_INFO: `/v3/users/ea54ef718dbb4cf2ac2faf5ccb36f2e5` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:47.023746 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4175390a-ca98-4551-85ad-bb9e935661a3 None admin] RBAC: Authorizing `identity:get_user(user_id=ea54ef718dbb4cf2ac2faf5ccb36f2e5)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:47.025607 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4175390a-ca98-4551-85ad-bb9e935661a3 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:47.027674 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 139/282] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Oct 13 10:57:46 2022] GET /identity/v3/users/ea54ef718dbb4cf2ac2faf5ccb36f2e5 => generated 293 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:47.033405 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4175390a-ca98-4551-85ad-bb9e935661a3 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:47.064482 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 144/283] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 13 10:57:47.087911 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:47.155892 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4175390a-ca98-4551-85ad-bb9e935661a3 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:47.193349 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab1fba1-d281-467c-9eae-a8e041cb0caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:47.194227 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab1fba1-d281-467c-9eae-a8e041cb0caa None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:47.194667 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab1fba1-d281-467c-9eae-a8e041cb0caa None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:47.195084 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab1fba1-d281-467c-9eae-a8e041cb0caa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:47.195962 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab1fba1-d281-467c-9eae-a8e041cb0caa None admin] RBAC: Adding query filter params (role.id=97c7067aa1ca411c9b8d3596c4d6abf6, user.id=ea54ef718dbb4cf2ac2faf5ccb36f2e5, scope.system=all) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:47.196414 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab1fba1-d281-467c-9eae-a8e041cb0caa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:47.198001 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab1fba1-d281-467c-9eae-a8e041cb0caa None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:47.214516 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 140/284] 10.222.0.25 () {56 vars in 1308 bytes} [Thu Oct 13 10:57:47 2022] GET /identity/v3/role_assignments?user.id=ea54ef718dbb4cf2ac2faf5ccb36f2e5&scope.system=all&role.id=97c7067aa1ca411c9b8d3596c4d6abf6 => generated 510 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:57:47.537211 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31168ade-5b5d-41bc-b2c1-57d70064d0c8 None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:47.537614 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31168ade-5b5d-41bc-b2c1-57d70064d0c8 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:47.537786 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31168ade-5b5d-41bc-b2c1-57d70064d0c8 None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:47.539165 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 145/285] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:57:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:47.544728 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec600d32-8485-4a2e-9431-a9bcffcbc352 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:47.545249 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec600d32-8485-4a2e-9431-a9bcffcbc352 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:47.545738 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec600d32-8485-4a2e-9431-a9bcffcbc352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:47.569428 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-ec600d32-8485-4a2e-9431-a9bcffcbc352 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:47.570974 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-ec600d32-8485-4a2e-9431-a9bcffcbc352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:47.578885 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 141/286] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:47 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 13 10:57:47.587658 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31168ade-5b5d-41bc-b2c1-57d70064d0c8 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:47.604101 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31168ade-5b5d-41bc-b2c1-57d70064d0c8 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:47.608782 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825b6ff0-68e3-4bea-b96f-2206e856697c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:47.610134 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b6ff0-68e3-4bea-b96f-2206e856697c admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:47.610609 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b6ff0-68e3-4bea-b96f-2206e856697c admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:47.611089 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b6ff0-68e3-4bea-b96f-2206e856697c admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:47.627408 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825b6ff0-68e3-4bea-b96f-2206e856697c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:57:47.632913 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-825b6ff0-68e3-4bea-b96f-2206e856697c admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 13 10:57:47.632913 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:47.632913 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:57:47.632913 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:57:47.632913 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:57:47.632913 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:57:47.632913 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:57:47.632913 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:57:47.632913 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:57:47.632913 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:57:47.632913 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:57:47.632913 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:57:47.632913 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:57:47.632913 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:57:47.632913 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:57:47.632913 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:57:47.633854 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:57:47.633854 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:57:47.633854 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:57:47.633854 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:57:47.633854 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:57:47.633854 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:57:47.633854 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:57:47.633854 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:57:47.633854 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:57:47.633854 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:57:47.633854 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:57:47.633854 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:57:47.633854 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:57:47.633854 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:57:47.633854 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:57:47.633854 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:57:47.634661 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:57:47.634661 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:57:47.634661 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:57:47.634661 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:57:47.634661 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:57:47.634661 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:57:47.634661 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:57:47.634661 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:57:47.634661 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:57:47.634661 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:57:47.634661 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 13 10:57:47.634661 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:57:47.636937 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 146/287] 10.222.0.25 () {56 vars in 1135 bytes} [Thu Oct 13 10:57:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:57:47.642835 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec600d32-8485-4a2e-9431-a9bcffcbc352 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:47.655079 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec600d32-8485-4a2e-9431-a9bcffcbc352 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:47.659918 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f53a888-ce6a-4287-bbd5-a5f971977f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:47.660818 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f53a888-ce6a-4287-bbd5-a5f971977f9d admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:47.661292 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f53a888-ce6a-4287-bbd5-a5f971977f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:47.661796 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f53a888-ce6a-4287-bbd5-a5f971977f9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:47.663337 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f53a888-ce6a-4287-bbd5-a5f971977f9d admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:47.663853 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f53a888-ce6a-4287-bbd5-a5f971977f9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:47.666108 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f53a888-ce6a-4287-bbd5-a5f971977f9d admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:47.676900 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 142/288] 10.222.0.25 () {56 vars in 1132 bytes} [Thu Oct 13 10:57:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:47.682495 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825b6ff0-68e3-4bea-b96f-2206e856697c admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:47.694704 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825b6ff0-68e3-4bea-b96f-2206e856697c admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:47.699581 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf5f984-be8f-492c-b694-144205d7b6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:47.700469 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf5f984-be8f-492c-b694-144205d7b6e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:47.701055 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf5f984-be8f-492c-b694-144205d7b6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:47.701540 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf5f984-be8f-492c-b694-144205d7b6e5 admin admin] PATH_INFO: `/v3/groups/63f369b2301643f2afe01dd346cdd0e2` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:47.702906 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf5f984-be8f-492c-b694-144205d7b6e5 admin admin] RBAC: Authorizing `identity:get_group(group_id=63f369b2301643f2afe01dd346cdd0e2)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:47.705068 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf5f984-be8f-492c-b694-144205d7b6e5 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:47.707022 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 147/289] 10.222.0.25 () {56 vars in 1201 bytes} [Thu Oct 13 10:57:47 2022] GET /identity/v3/groups/63f369b2301643f2afe01dd346cdd0e2 => generated 226 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:47.712810 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f53a888-ce6a-4287-bbd5-a5f971977f9d admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:47.723593 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f53a888-ce6a-4287-bbd5-a5f971977f9d admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:47.728469 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879710eb-7977-4070-807e-2429758644d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:47.729373 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879710eb-7977-4070-807e-2429758644d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:47.729847 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879710eb-7977-4070-807e-2429758644d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:47.730395 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879710eb-7977-4070-807e-2429758644d4 admin admin] PATH_INFO: `/v3/projects/c32dd153f5284943a7a036275c792a45` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:47.731739 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879710eb-7977-4070-807e-2429758644d4 admin admin] RBAC: Authorizing `identity:get_project(project_id=c32dd153f5284943a7a036275c792a45)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:47.734143 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879710eb-7977-4070-807e-2429758644d4 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:47.739770 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 143/290] 10.222.0.25 () {56 vars in 1207 bytes} [Thu Oct 13 10:57:47 2022] GET /identity/v3/projects/c32dd153f5284943a7a036275c792a45 => generated 302 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:57:47.745531 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf5f984-be8f-492c-b694-144205d7b6e5 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:47.757346 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf5f984-be8f-492c-b694-144205d7b6e5 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:47.764292 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b30e6f2-b255-4ee5-b137-87ddf3910166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:47.765229 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b30e6f2-b255-4ee5-b137-87ddf3910166 admin admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:47.765758 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b30e6f2-b255-4ee5-b137-87ddf3910166 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:47.766293 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b30e6f2-b255-4ee5-b137-87ddf3910166 admin admin] PATH_INFO: `/v3/projects/c32dd153f5284943a7a036275c792a45/groups/63f369b2301643f2afe01dd346cdd0e2/roles/84a5ec3770b4453bb7c3ff5b9af0bd17` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:47.768734 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b30e6f2-b255-4ee5-b137-87ddf3910166 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c32dd153f5284943a7a036275c792a45, group_id=63f369b2301643f2afe01dd346cdd0e2, role_id=84a5ec3770b4453bb7c3ff5b9af0bd17)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:47.771989 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b30e6f2-b255-4ee5-b137-87ddf3910166 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:47.790929 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 148/291] 10.222.0.25 () {58 vars in 1463 bytes} [Thu Oct 13 10:57:47 2022] PUT /identity/v3/projects/c32dd153f5284943a7a036275c792a45/groups/63f369b2301643f2afe01dd346cdd0e2/roles/84a5ec3770b4453bb7c3ff5b9af0bd17 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 10:57:47.902628 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879710eb-7977-4070-807e-2429758644d4 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:47.914971 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879710eb-7977-4070-807e-2429758644d4 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:47.982646 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5db77f-d510-4181-b13a-3d576c0f7401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:47.983734 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5db77f-d510-4181-b13a-3d576c0f7401 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:47.984213 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5db77f-d510-4181-b13a-3d576c0f7401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:47.984677 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5db77f-d510-4181-b13a-3d576c0f7401 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:47.999819 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5db77f-d510-4181-b13a-3d576c0f7401 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:57:48.006294 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-9f5db77f-d510-4181-b13a-3d576c0f7401 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 10:57:48.006294 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:48.006294 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:57:48.006294 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:57:48.006294 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:57:48.006294 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:57:48.006294 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:57:48.006294 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:57:48.006294 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:57:48.006294 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:57:48.006294 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:57:48.006294 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:57:48.006294 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:57:48.006294 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:57:48.006294 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:57:48.006294 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:57:48.007199 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:57:48.007199 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:57:48.007199 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:57:48.007199 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:57:48.007199 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:57:48.007199 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:57:48.007199 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:57:48.007199 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:57:48.007199 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:57:48.007199 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:57:48.007199 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:57:48.007199 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 10:57:48.007199 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:57:48.007199 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:57:48.007199 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:57:48.007199 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:57:48.008007 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:57:48.008007 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:57:48.008007 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:57:48.008007 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:57:48.008007 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:57:48.008007 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:57:48.008007 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:57:48.008007 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:57:48.008007 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:57:48.008007 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:57:48.008007 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 10:57:48.008007 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:57:48.010472 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 144/292] 10.222.0.25 () {56 vars in 1117 bytes} [Thu Oct 13 10:57:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 108 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:57:48.016410 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b30e6f2-b255-4ee5-b137-87ddf3910166 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:48.027700 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b30e6f2-b255-4ee5-b137-87ddf3910166 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:48.032688 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a99c5-b1ce-4e2b-b6a6-f47b2fd39e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:48.033723 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a99c5-b1ce-4e2b-b6a6-f47b2fd39e11 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:48.038398 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a99c5-b1ce-4e2b-b6a6-f47b2fd39e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:48.038977 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a99c5-b1ce-4e2b-b6a6-f47b2fd39e11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:48.039913 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3a99c5-b1ce-4e2b-b6a6-f47b2fd39e11 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:48.040444 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3a99c5-b1ce-4e2b-b6a6-f47b2fd39e11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:48.042436 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3a99c5-b1ce-4e2b-b6a6-f47b2fd39e11 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:48.053041 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 149/293] 10.222.0.25 () {56 vars in 1120 bytes} [Thu Oct 13 10:57:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:48.058905 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5db77f-d510-4181-b13a-3d576c0f7401 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:48.075644 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5db77f-d510-4181-b13a-3d576c0f7401 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:48.080467 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebbb7f8-25ed-4b97-b123-cc38fc3a46f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:48.081342 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebbb7f8-25ed-4b97-b123-cc38fc3a46f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:48.081818 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebbb7f8-25ed-4b97-b123-cc38fc3a46f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:48.082352 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebbb7f8-25ed-4b97-b123-cc38fc3a46f3 admin admin] PATH_INFO: `/v3/groups/a36807f493c7425cb83414151f3375bc` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:48.090214 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebbb7f8-25ed-4b97-b123-cc38fc3a46f3 admin admin] RBAC: Authorizing `identity:get_group(group_id=a36807f493c7425cb83414151f3375bc)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:48.092271 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebbb7f8-25ed-4b97-b123-cc38fc3a46f3 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:48.095289 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 145/294] 10.222.0.25 () {56 vars in 1201 bytes} [Thu Oct 13 10:57:48 2022] GET /identity/v3/groups/a36807f493c7425cb83414151f3375bc => generated 229 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:48.099901 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a99c5-b1ce-4e2b-b6a6-f47b2fd39e11 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:48.115729 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a99c5-b1ce-4e2b-b6a6-f47b2fd39e11 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:48.123001 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1819139-73e9-4993-b139-7292d52e8de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:48.123646 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1819139-73e9-4993-b139-7292d52e8de9 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:48.123920 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1819139-73e9-4993-b139-7292d52e8de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:48.124187 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1819139-73e9-4993-b139-7292d52e8de9 admin admin] PATH_INFO: `/v3/projects/cbde15a03afe4c128d89633ab934d9a0` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:48.126374 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1819139-73e9-4993-b139-7292d52e8de9 admin admin] RBAC: Authorizing `identity:get_project(project_id=cbde15a03afe4c128d89633ab934d9a0)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:48.128160 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1819139-73e9-4993-b139-7292d52e8de9 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:48.130379 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 150/295] 10.222.0.25 () {56 vars in 1207 bytes} [Thu Oct 13 10:57:48 2022] GET /identity/v3/projects/cbde15a03afe4c128d89633ab934d9a0 => generated 344 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:48.136059 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebbb7f8-25ed-4b97-b123-cc38fc3a46f3 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:48.147279 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebbb7f8-25ed-4b97-b123-cc38fc3a46f3 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:48.151686 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2722c506-18fd-431d-98d8-0cee58306777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:48.152344 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2722c506-18fd-431d-98d8-0cee58306777 admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:48.152618 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2722c506-18fd-431d-98d8-0cee58306777 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:48.152888 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2722c506-18fd-431d-98d8-0cee58306777 admin admin] PATH_INFO: `/v3/projects/cbde15a03afe4c128d89633ab934d9a0/groups/a36807f493c7425cb83414151f3375bc/roles/ea564961b1db4eb4a1d4d880964611b2` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:48.154808 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2722c506-18fd-431d-98d8-0cee58306777 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbde15a03afe4c128d89633ab934d9a0, group_id=a36807f493c7425cb83414151f3375bc, role_id=ea564961b1db4eb4a1d4d880964611b2)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:48.157442 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2722c506-18fd-431d-98d8-0cee58306777 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:48.167438 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:48.173314 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 146/296] 10.222.0.25 () {58 vars in 1463 bytes} [Thu Oct 13 10:57:48 2022] PUT /identity/v3/projects/cbde15a03afe4c128d89633ab934d9a0/groups/a36807f493c7425cb83414151f3375bc/roles/ea564961b1db4eb4a1d4d880964611b2 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 10:57:48.597010 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fcb464-9eef-42bd-a0b2-54555eeb8aba None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:48.597655 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fcb464-9eef-42bd-a0b2-54555eeb8aba None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:48.598705 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fcb464-9eef-42bd-a0b2-54555eeb8aba None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:48.600489 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 151/297] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:57:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:48.606301 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d90e5-5968-418f-b5f3-68560b2b2c80 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:48.606829 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d90e5-5968-418f-b5f3-68560b2b2c80 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:48.607300 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d90e5-5968-418f-b5f3-68560b2b2c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:48.632142 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-e75d90e5-5968-418f-b5f3-68560b2b2c80 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:48.633334 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-e75d90e5-5968-418f-b5f3-68560b2b2c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:48.727869 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 147/298] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:57:49.028854 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fcb464-9eef-42bd-a0b2-54555eeb8aba None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:49.155528 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fcb464-9eef-42bd-a0b2-54555eeb8aba None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:49.176893 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:49.196023 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e80992a-5aba-45b9-a3d8-45c96d174e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:49.196957 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80992a-5aba-45b9-a3d8-45c96d174e51 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:49.197433 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80992a-5aba-45b9-a3d8-45c96d174e51 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:49.197932 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80992a-5aba-45b9-a3d8-45c96d174e51 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:49.215962 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e80992a-5aba-45b9-a3d8-45c96d174e51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:57:49.221463 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-6e80992a-5aba-45b9-a3d8-45c96d174e51 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 13 10:57:49.221463 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:49.221463 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:57:49.221463 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:57:49.221463 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:57:49.221463 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:57:49.221463 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:57:49.221463 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:57:49.221463 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:57:49.221463 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:57:49.221463 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:57:49.221463 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:57:49.221463 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:57:49.221463 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:57:49.221463 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:57:49.221463 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:57:49.222443 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:57:49.222443 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:57:49.222443 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:57:49.222443 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:57:49.222443 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:57:49.222443 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:57:49.222443 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:57:49.222443 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:57:49.222443 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:57:49.222443 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:57:49.222443 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:57:49.222443 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:57:49.222443 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:57:49.222443 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:57:49.222443 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:57:49.222443 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:57:49.223662 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:57:49.223662 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:57:49.223662 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:57:49.223662 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:57:49.223662 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:57:49.223662 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:57:49.223662 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:57:49.223662 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:57:49.223662 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:57:49.223662 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:57:49.223662 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 13 10:57:49.223662 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:57:49.226211 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 152/299] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 10:57:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:57:49.235114 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75d90e5-5968-418f-b5f3-68560b2b2c80 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:49.362973 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75d90e5-5968-418f-b5f3-68560b2b2c80 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:49.391849 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:49.400917 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65cae38-20db-4ea4-8712-80a9e5ac5e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:49.402090 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65cae38-20db-4ea4-8712-80a9e5ac5e39 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:49.402376 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65cae38-20db-4ea4-8712-80a9e5ac5e39 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:49.402728 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65cae38-20db-4ea4-8712-80a9e5ac5e39 None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:49.403380 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65cae38-20db-4ea4-8712-80a9e5ac5e39 None admin] RBAC: Adding query filter params (name=member) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:49.404064 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65cae38-20db-4ea4-8712-80a9e5ac5e39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:49.405605 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65cae38-20db-4ea4-8712-80a9e5ac5e39 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:49.415050 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 148/300] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Oct 13 10:57:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:49.419232 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c61da1-f09d-4516-9824-18242a4f6031 None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:49.419518 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c61da1-f09d-4516-9824-18242a4f6031 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:49.419792 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c61da1-f09d-4516-9824-18242a4f6031 None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:49.421590 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 153/301] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:57:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:49.422344 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65cae38-20db-4ea4-8712-80a9e5ac5e39 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:49.427413 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30bbb84-4caf-4b1a-929d-61da8a52bf82 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:49.427696 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30bbb84-4caf-4b1a-929d-61da8a52bf82 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:49.427969 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30bbb84-4caf-4b1a-929d-61da8a52bf82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:49.452595 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-b30bbb84-4caf-4b1a-929d-61da8a52bf82 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:49.453802 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-b30bbb84-4caf-4b1a-929d-61da8a52bf82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:49.532216 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 154/302] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 13 10:57:49.545268 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65cae38-20db-4ea4-8712-80a9e5ac5e39 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:49.579983 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968621f0-cab9-415d-9bb8-a94bca6d582c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:49.580603 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968621f0-cab9-415d-9bb8-a94bca6d582c None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:49.580934 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968621f0-cab9-415d-9bb8-a94bca6d582c None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:49.581212 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968621f0-cab9-415d-9bb8-a94bca6d582c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:49.642021 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:49.652725 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968621f0-cab9-415d-9bb8-a94bca6d582c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:49.654280 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968621f0-cab9-415d-9bb8-a94bca6d582c None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:49.761409 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 149/303] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Oct 13 10:57:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 13 10:57:49.766618 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30bbb84-4caf-4b1a-929d-61da8a52bf82 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:49.831273 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968621f0-cab9-415d-9bb8-a94bca6d582c None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:49.878112 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30bbb84-4caf-4b1a-929d-61da8a52bf82 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:49.890333 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:49.930090 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a9a88c-8e59-435b-a2b6-7b086823139a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:49.931067 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9a88c-8e59-435b-a2b6-7b086823139a None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:49.931538 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9a88c-8e59-435b-a2b6-7b086823139a None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:49.932024 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9a88c-8e59-435b-a2b6-7b086823139a None admin] PATH_INFO: `/v3/projects/c72ae97522d241759a7f02e813ff1aab` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:49.934263 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a9a88c-8e59-435b-a2b6-7b086823139a None admin] RBAC: Authorizing `identity:get_project(project_id=c72ae97522d241759a7f02e813ff1aab)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:49.935952 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a9a88c-8e59-435b-a2b6-7b086823139a None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:49.942143 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 155/304] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Oct 13 10:57:49 2022] GET /identity/v3/projects/c72ae97522d241759a7f02e813ff1aab => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:57:49.944005 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabab743-4226-4afe-a480-671c7a694465 None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:49.944520 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabab743-4226-4afe-a480-671c7a694465 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:49.944981 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabab743-4226-4afe-a480-671c7a694465 None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:49.946454 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 156/305] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:57:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:49.948118 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabab743-4226-4afe-a480-671c7a694465 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:49.966990 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:49.979903 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968621f0-cab9-415d-9bb8-a94bca6d582c None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:50.031192 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea948078-ab5d-4026-95b2-52c47115696c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:50.031803 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea948078-ab5d-4026-95b2-52c47115696c None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:50.032089 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea948078-ab5d-4026-95b2-52c47115696c None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:50.032369 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea948078-ab5d-4026-95b2-52c47115696c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:50.055388 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea948078-ab5d-4026-95b2-52c47115696c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:57:50.061782 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-ea948078-ab5d-4026-95b2-52c47115696c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 13 10:57:50.061782 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:50.061782 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:57:50.061782 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:57:50.061782 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:57:50.061782 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:57:50.061782 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:57:50.061782 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:57:50.061782 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:57:50.061782 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:57:50.061782 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:57:50.061782 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:57:50.061782 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:57:50.061782 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:57:50.061782 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:57:50.061782 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:57:50.062693 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:57:50.062693 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:57:50.062693 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:57:50.062693 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:57:50.062693 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:57:50.062693 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:57:50.062693 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:57:50.062693 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:57:50.062693 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:57:50.062693 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:57:50.062693 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:57:50.062693 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 10:57:50.062693 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:57:50.062693 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:57:50.062693 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:57:50.062693 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:57:50.063470 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:57:50.063470 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:57:50.063470 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:57:50.063470 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:57:50.063470 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:57:50.063470 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:57:50.063470 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:57:50.063470 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:57:50.063470 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:57:50.063470 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:57:50.063470 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 13 10:57:50.063470 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:57:50.063470 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 150/306] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Oct 13 10:57:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 10:57:50.064594 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6857d38-a684-47d4-b6d6-b5627bfdd4f2 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:50.064688 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6857d38-a684-47d4-b6d6-b5627bfdd4f2 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:50.064963 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6857d38-a684-47d4-b6d6-b5627bfdd4f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:50.087353 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabab743-4226-4afe-a480-671c7a694465 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:50.088202 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-a6857d38-a684-47d4-b6d6-b5627bfdd4f2 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:50.089391 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-a6857d38-a684-47d4-b6d6-b5627bfdd4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:50.128098 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ce5d5c-f649-4ec7-beb8-984da0d5c2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:50.129109 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce5d5c-f649-4ec7-beb8-984da0d5c2cd None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:50.130133 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce5d5c-f649-4ec7-beb8-984da0d5c2cd None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:50.130595 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce5d5c-f649-4ec7-beb8-984da0d5c2cd None admin] PATH_INFO: `/v3/groups/63f369b2301643f2afe01dd346cdd0e2` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:50.131912 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ce5d5c-f649-4ec7-beb8-984da0d5c2cd None admin] RBAC: Authorizing `identity:get_group(group_id=63f369b2301643f2afe01dd346cdd0e2)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:50.133523 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ce5d5c-f649-4ec7-beb8-984da0d5c2cd None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:50.140323 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 157/307] 10.222.0.25 () {56 vars in 1180 bytes} [Thu Oct 13 10:57:49 2022] GET /identity/v3/groups/63f369b2301643f2afe01dd346cdd0e2 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:50.141401 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ce5d5c-f649-4ec7-beb8-984da0d5c2cd None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:50.175371 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 151/308] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:57:50.176770 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6857d38-a684-47d4-b6d6-b5627bfdd4f2 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:50.199636 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:50.266287 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ce5d5c-f649-4ec7-beb8-984da0d5c2cd None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:50.303649 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6109a8-a56c-4f5e-b38f-8ba0f6b03ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:50.304664 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6109a8-a56c-4f5e-b38f-8ba0f6b03ee8 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:50.305139 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6109a8-a56c-4f5e-b38f-8ba0f6b03ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:50.305641 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6109a8-a56c-4f5e-b38f-8ba0f6b03ee8 None admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:50.306553 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6109a8-a56c-4f5e-b38f-8ba0f6b03ee8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:50.307059 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6109a8-a56c-4f5e-b38f-8ba0f6b03ee8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:50.308625 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6109a8-a56c-4f5e-b38f-8ba0f6b03ee8 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:50.316538 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:50.321013 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 158/309] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Oct 13 10:57:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:50.327174 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6109a8-a56c-4f5e-b38f-8ba0f6b03ee8 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:50.344258 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6857d38-a684-47d4-b6d6-b5627bfdd4f2 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:50.381640 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a529dc5b-d2a7-451b-aa49-eb13e03f74e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:50.382322 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a529dc5b-d2a7-451b-aa49-eb13e03f74e5 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:50.382606 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a529dc5b-d2a7-451b-aa49-eb13e03f74e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:50.383151 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a529dc5b-d2a7-451b-aa49-eb13e03f74e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:50.383880 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a529dc5b-d2a7-451b-aa49-eb13e03f74e5 None admin] RBAC: Adding query filter params (group.id=63f369b2301643f2afe01dd346cdd0e2, role.id=7c3871c0ab68438b9014489d50b53a22, scope.project.id=c72ae97522d241759a7f02e813ff1aab) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:50.384425 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a529dc5b-d2a7-451b-aa49-eb13e03f74e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:50.386434 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a529dc5b-d2a7-451b-aa49-eb13e03f74e5 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:50.393777 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 152/310] 10.222.0.25 () {56 vars in 1376 bytes} [Thu Oct 13 10:57:50 2022] GET /identity/v3/role_assignments?group.id=63f369b2301643f2afe01dd346cdd0e2&scope.project.id=c72ae97522d241759a7f02e813ff1aab&role.id=7c3871c0ab68438b9014489d50b53a22 => generated 611 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:50.486089 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a529dc5b-d2a7-451b-aa49-eb13e03f74e5 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:50.522584 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6109a8-a56c-4f5e-b38f-8ba0f6b03ee8 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:50.532054 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:50.625432 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a529dc5b-d2a7-451b-aa49-eb13e03f74e5 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:50.626736 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38518859-f916-4d52-b897-764f39387aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:50.627373 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38518859-f916-4d52-b897-764f39387aa4 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:50.627655 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38518859-f916-4d52-b897-764f39387aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:50.627938 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38518859-f916-4d52-b897-764f39387aa4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:50.674760 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c2f87d-f6a7-4d6c-b424-208cb9e784ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:50.675399 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c2f87d-f6a7-4d6c-b424-208cb9e784ec None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:50.675875 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c2f87d-f6a7-4d6c-b424-208cb9e784ec None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:50.676675 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c2f87d-f6a7-4d6c-b424-208cb9e784ec None admin] PATH_INFO: `/v3/roles/member` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:50.694810 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c2f87d-f6a7-4d6c-b424-208cb9e784ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:57:50.704151 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-23c2f87d-f6a7-4d6c-b424-208cb9e784ec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 13 10:57:50.704151 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:50.704151 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:57:50.704151 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:57:50.704151 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:57:50.704151 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:57:50.704151 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:57:50.704151 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:57:50.704151 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:57:50.704151 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:57:50.704151 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:57:50.704151 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:57:50.704151 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:57:50.704151 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:57:50.704151 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:57:50.704151 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:57:50.705082 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:57:50.705082 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:57:50.705082 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:57:50.705082 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:57:50.705082 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:57:50.705082 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:57:50.705082 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:57:50.705082 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:57:50.705082 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:57:50.705082 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:57:50.705082 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:57:50.705082 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 10:57:50.705082 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:57:50.705082 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:57:50.705082 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:57:50.705082 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:57:50.705842 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:57:50.705842 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:57:50.705842 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:57:50.705842 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:57:50.705842 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:57:50.705842 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:57:50.705842 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:57:50.705842 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:57:50.705842 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:57:50.705842 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:57:50.705842 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 13 10:57:50.705842 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:57:50.707861 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 153/311] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 10:57:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:57:50.714289 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c2f87d-f6a7-4d6c-b424-208cb9e784ec None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:50.722273 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:50.739282 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38518859-f916-4d52-b897-764f39387aa4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:50.740780 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38518859-f916-4d52-b897-764f39387aa4 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:50.841214 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c2f87d-f6a7-4d6c-b424-208cb9e784ec None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:50.883421 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f23e535-9ba3-4721-bc31-6350c6e5480f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:50.883421 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23e535-9ba3-4721-bc31-6350c6e5480f None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:50.883421 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23e535-9ba3-4721-bc31-6350c6e5480f None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:50.883421 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23e535-9ba3-4721-bc31-6350c6e5480f None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:50.885797 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f23e535-9ba3-4721-bc31-6350c6e5480f None admin] RBAC: Adding query filter params (name=member) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:50.885797 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f23e535-9ba3-4721-bc31-6350c6e5480f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:50.887417 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f23e535-9ba3-4721-bc31-6350c6e5480f None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:50.899515 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 154/312] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Oct 13 10:57:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:57:50.900761 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f11ffb4-1d46-4f24-8158-0458405d1057 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:50.901048 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f11ffb4-1d46-4f24-8158-0458405d1057 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:50.901326 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f11ffb4-1d46-4f24-8158-0458405d1057 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:50.902576 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 155/313] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:57:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:50.906791 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f11ffb4-1d46-4f24-8158-0458405d1057 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:50.913532 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 159/314] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Oct 13 10:57:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 587 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 13 10:57:50.915092 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc789eb-d44d-40ab-b2d7-15dca6935ae9 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:50.915551 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc789eb-d44d-40ab-b2d7-15dca6935ae9 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:50.915970 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc789eb-d44d-40ab-b2d7-15dca6935ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:50.926425 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:50.939895 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-ecc789eb-d44d-40ab-b2d7-15dca6935ae9 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:50.941400 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-ecc789eb-d44d-40ab-b2d7-15dca6935ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:50.990116 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:51.029934 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 160/315] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:57:51.030792 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc789eb-d44d-40ab-b2d7-15dca6935ae9 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:51.031803 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f11ffb4-1d46-4f24-8158-0458405d1057 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:51.075691 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e8e514-82f6-49a5-a067-42228f3261ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:51.076326 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8e514-82f6-49a5-a067-42228f3261ad None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:51.076604 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8e514-82f6-49a5-a067-42228f3261ad None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:51.076875 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8e514-82f6-49a5-a067-42228f3261ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:51.145635 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc789eb-d44d-40ab-b2d7-15dca6935ae9 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:51.170868 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e8e514-82f6-49a5-a067-42228f3261ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:51.172441 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e8e514-82f6-49a5-a067-42228f3261ad None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:51.187125 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a889da97-7899-4c1b-a994-22538adaf967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:51.188071 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a889da97-7899-4c1b-a994-22538adaf967 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:51.188492 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a889da97-7899-4c1b-a994-22538adaf967 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:51.188945 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a889da97-7899-4c1b-a994-22538adaf967 None admin] PATH_INFO: `/v3/projects/c72ae97522d241759a7f02e813ff1aab` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:51.190316 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a889da97-7899-4c1b-a994-22538adaf967 None admin] RBAC: Authorizing `identity:get_project(project_id=c72ae97522d241759a7f02e813ff1aab)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:51.192044 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a889da97-7899-4c1b-a994-22538adaf967 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:51.194308 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 161/316] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Oct 13 10:57:51 2022] GET /identity/v3/projects/c72ae97522d241759a7f02e813ff1aab => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:51.203180 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a889da97-7899-4c1b-a994-22538adaf967 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:51.208642 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:51.246011 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:51.295259 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 156/317] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Oct 13 10:57:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 13 10:57:51.300749 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e8e514-82f6-49a5-a067-42228f3261ad None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:51.324690 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a889da97-7899-4c1b-a994-22538adaf967 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:51.365967 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88532361-2473-4dce-bc1f-81d56f2c21c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:51.366916 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88532361-2473-4dce-bc1f-81d56f2c21c0 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:51.367120 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88532361-2473-4dce-bc1f-81d56f2c21c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:51.367402 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88532361-2473-4dce-bc1f-81d56f2c21c0 None admin] PATH_INFO: `/v3/groups/63f369b2301643f2afe01dd346cdd0e2` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:51.369230 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88532361-2473-4dce-bc1f-81d56f2c21c0 None admin] RBAC: Authorizing `identity:get_group(group_id=63f369b2301643f2afe01dd346cdd0e2)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:51.370757 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88532361-2473-4dce-bc1f-81d56f2c21c0 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:51.372909 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 162/318] 10.222.0.25 () {56 vars in 1180 bytes} [Thu Oct 13 10:57:51 2022] GET /identity/v3/groups/63f369b2301643f2afe01dd346cdd0e2 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:51.373749 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88532361-2473-4dce-bc1f-81d56f2c21c0 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:51.417304 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e8e514-82f6-49a5-a067-42228f3261ad None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:51.456373 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:51.462739 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf36a04-d5bf-434a-be3a-c4d68da2d7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:51.463860 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf36a04-d5bf-434a-be3a-c4d68da2d7df None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:51.464142 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf36a04-d5bf-434a-be3a-c4d68da2d7df None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:51.464412 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf36a04-d5bf-434a-be3a-c4d68da2d7df None admin] PATH_INFO: `/v3/projects/c32dd153f5284943a7a036275c792a45` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:51.466265 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf36a04-d5bf-434a-be3a-c4d68da2d7df None admin] RBAC: Authorizing `identity:get_project(project_id=c32dd153f5284943a7a036275c792a45)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:51.468207 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf36a04-d5bf-434a-be3a-c4d68da2d7df None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:51.470911 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 157/319] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Oct 13 10:57:51 2022] GET /identity/v3/projects/c32dd153f5284943a7a036275c792a45 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:57:51.471648 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf36a04-d5bf-434a-be3a-c4d68da2d7df None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:51.493820 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88532361-2473-4dce-bc1f-81d56f2c21c0 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:51.510950 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:51.531380 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c233596-c4f2-4121-8a53-d8518f0f783f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:51.532023 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c233596-c4f2-4121-8a53-d8518f0f783f None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:51.532307 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c233596-c4f2-4121-8a53-d8518f0f783f None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:51.532578 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c233596-c4f2-4121-8a53-d8518f0f783f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:51.544954 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c233596-c4f2-4121-8a53-d8518f0f783f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:57:51.550415 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-4c233596-c4f2-4121-8a53-d8518f0f783f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 13 10:57:51.550415 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:51.550415 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:57:51.550415 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:57:51.550415 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:57:51.550415 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:57:51.550415 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:57:51.550415 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:57:51.550415 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:57:51.550415 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:57:51.550415 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:57:51.550415 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:57:51.550415 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:57:51.550415 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:57:51.550415 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:57:51.550415 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:57:51.551540 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:57:51.551540 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:57:51.551540 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:57:51.551540 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:57:51.551540 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:57:51.551540 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:57:51.551540 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:57:51.551540 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:57:51.551540 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:57:51.551540 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:57:51.551540 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:57:51.551540 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:57:51.551540 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:57:51.551540 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:57:51.551540 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:57:51.551540 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:57:51.552385 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:57:51.552385 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:57:51.552385 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:57:51.552385 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:57:51.552385 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:57:51.552385 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:57:51.552385 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:57:51.552385 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:57:51.552385 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:57:51.552385 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:57:51.552385 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 13 10:57:51.552385 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:57:51.552385 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 163/320] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Oct 13 10:57:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:57:51.553195 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40b6b93-3062-4759-b554-4e5a312efc24 None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:51.553195 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40b6b93-3062-4759-b554-4e5a312efc24 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:51.553195 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40b6b93-3062-4759-b554-4e5a312efc24 None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:51.554858 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 164/321] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:57:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:51.555573 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40b6b93-3062-4759-b554-4e5a312efc24 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:51.595653 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf36a04-d5bf-434a-be3a-c4d68da2d7df None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:51.636900 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa56391-fb13-4a0e-b0c2-1454551a4fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:51.637515 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa56391-fb13-4a0e-b0c2-1454551a4fbe None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:51.637801 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa56391-fb13-4a0e-b0c2-1454551a4fbe None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:51.638107 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa56391-fb13-4a0e-b0c2-1454551a4fbe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:51.639414 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa56391-fb13-4a0e-b0c2-1454551a4fbe None admin] RBAC: Adding query filter params (group.id=63f369b2301643f2afe01dd346cdd0e2, role.id=84a5ec3770b4453bb7c3ff5b9af0bd17, scope.project.id=c72ae97522d241759a7f02e813ff1aab) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:51.639414 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa56391-fb13-4a0e-b0c2-1454551a4fbe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:51.640572 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa56391-fb13-4a0e-b0c2-1454551a4fbe None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:51.648114 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 158/322] 10.222.0.25 () {56 vars in 1376 bytes} [Thu Oct 13 10:57:51 2022] GET /identity/v3/role_assignments?group.id=63f369b2301643f2afe01dd346cdd0e2&scope.project.id=c72ae97522d241759a7f02e813ff1aab&role.id=84a5ec3770b4453bb7c3ff5b9af0bd17 => generated 611 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:51.649297 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9937a745-92f8-48bb-8864-ae3be181e812 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:51.649580 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9937a745-92f8-48bb-8864-ae3be181e812 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:51.649859 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9937a745-92f8-48bb-8864-ae3be181e812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:51.671737 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-9937a745-92f8-48bb-8864-ae3be181e812 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:51.672882 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-9937a745-92f8-48bb-8864-ae3be181e812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:51.701120 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40b6b93-3062-4759-b554-4e5a312efc24 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:51.745825 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:51.752077 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43e9d59-a884-44c1-b28b-8a85da36a7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:51.753214 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e9d59-a884-44c1-b28b-8a85da36a7ed None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:51.753658 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e9d59-a884-44c1-b28b-8a85da36a7ed None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:51.754022 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e9d59-a884-44c1-b28b-8a85da36a7ed None admin] PATH_INFO: `/v3/groups/63f369b2301643f2afe01dd346cdd0e2` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:51.756413 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43e9d59-a884-44c1-b28b-8a85da36a7ed None admin] RBAC: Authorizing `identity:get_group(group_id=63f369b2301643f2afe01dd346cdd0e2)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:51.757842 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43e9d59-a884-44c1-b28b-8a85da36a7ed None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:51.759987 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 165/323] 10.222.0.25 () {56 vars in 1180 bytes} [Thu Oct 13 10:57:51 2022] GET /identity/v3/groups/63f369b2301643f2afe01dd346cdd0e2 => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:51.760702 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43e9d59-a884-44c1-b28b-8a85da36a7ed None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:51.766552 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 159/324] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:57:51.767838 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9937a745-92f8-48bb-8864-ae3be181e812 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:51.803250 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:51.898935 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9937a745-92f8-48bb-8864-ae3be181e812 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:51.907087 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43e9d59-a884-44c1-b28b-8a85da36a7ed None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:51.952465 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d266949-38fa-4fa4-9e09-85cd03aaf9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:51.953010 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d266949-38fa-4fa4-9e09-85cd03aaf9a9 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:51.953286 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d266949-38fa-4fa4-9e09-85cd03aaf9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:51.953560 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d266949-38fa-4fa4-9e09-85cd03aaf9a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:51.954318 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d266949-38fa-4fa4-9e09-85cd03aaf9a9 None admin] RBAC: Adding query filter params (group.id=63f369b2301643f2afe01dd346cdd0e2, role.id=7c3871c0ab68438b9014489d50b53a22, scope.project.id=c32dd153f5284943a7a036275c792a45) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:51.954629 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d266949-38fa-4fa4-9e09-85cd03aaf9a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:51.956064 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d266949-38fa-4fa4-9e09-85cd03aaf9a9 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:51.959831 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7615d5c8-c3a0-4be9-9099-f88069ecb03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:51.960696 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615d5c8-c3a0-4be9-9099-f88069ecb03e None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:51.961493 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615d5c8-c3a0-4be9-9099-f88069ecb03e None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:51.961774 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615d5c8-c3a0-4be9-9099-f88069ecb03e None admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:51.962791 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7615d5c8-c3a0-4be9-9099-f88069ecb03e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:51.963099 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7615d5c8-c3a0-4be9-9099-f88069ecb03e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:51.964450 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7615d5c8-c3a0-4be9-9099-f88069ecb03e None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:51.964972 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 160/325] 10.222.0.25 () {56 vars in 1376 bytes} [Thu Oct 13 10:57:51 2022] GET /identity/v3/role_assignments?group.id=63f369b2301643f2afe01dd346cdd0e2&scope.project.id=c32dd153f5284943a7a036275c792a45&role.id=7c3871c0ab68438b9014489d50b53a22 => generated 611 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:51.975699 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 166/326] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Oct 13 10:57:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:51.981400 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d266949-38fa-4fa4-9e09-85cd03aaf9a9 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:52.084532 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:52.091646 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7615d5c8-c3a0-4be9-9099-f88069ecb03e None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:52.096028 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d266949-38fa-4fa4-9e09-85cd03aaf9a9 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:52.137999 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16275fe3-baec-4d13-b947-cdd83d746b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:52.138332 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16275fe3-baec-4d13-b947-cdd83d746b8d None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:52.139740 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16275fe3-baec-4d13-b947-cdd83d746b8d None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:52.139740 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16275fe3-baec-4d13-b947-cdd83d746b8d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:52.187056 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:52.227762 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16275fe3-baec-4d13-b947-cdd83d746b8d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:52.229655 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16275fe3-baec-4d13-b947-cdd83d746b8d None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:52.237387 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7615d5c8-c3a0-4be9-9099-f88069ecb03e None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:52.278570 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430702bd-8cd8-45a4-b647-1bdad3be9cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:52.279217 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430702bd-8cd8-45a4-b647-1bdad3be9cd2 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:52.280102 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430702bd-8cd8-45a4-b647-1bdad3be9cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:52.280102 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430702bd-8cd8-45a4-b647-1bdad3be9cd2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:52.290612 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430702bd-8cd8-45a4-b647-1bdad3be9cd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:57:52.295936 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-430702bd-8cd8-45a4-b647-1bdad3be9cd2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 10:57:52.295936 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:52.295936 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:57:52.295936 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:57:52.295936 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:57:52.295936 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:57:52.295936 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:57:52.295936 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:57:52.295936 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:57:52.295936 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:57:52.295936 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:57:52.295936 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:57:52.295936 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:57:52.295936 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:57:52.295936 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:57:52.295936 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:57:52.296817 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:57:52.296817 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:57:52.296817 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:57:52.296817 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:57:52.296817 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:57:52.296817 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:57:52.296817 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:57:52.296817 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:57:52.296817 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:57:52.296817 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:57:52.296817 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:57:52.296817 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:57:52.296817 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:57:52.296817 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:57:52.296817 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:57:52.296817 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:57:52.297605 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:57:52.297605 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:57:52.297605 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:57:52.297605 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:57:52.297605 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:57:52.297605 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:57:52.297605 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:57:52.297605 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:57:52.297605 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:57:52.297605 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:57:52.297605 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 10:57:52.297605 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:57:52.298245 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 167/327] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Oct 13 10:57:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 10:57:52.303027 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430702bd-8cd8-45a4-b647-1bdad3be9cd2 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:52.343063 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:52.356002 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 161/328] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Oct 13 10:57:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 13 10:57:52.362833 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16275fe3-baec-4d13-b947-cdd83d746b8d None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:52.420679 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430702bd-8cd8-45a4-b647-1bdad3be9cd2 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:52.448296 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:52.469970 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae7a70b-350e-4cce-b152-e7d40c74ace5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:52.469970 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae7a70b-350e-4cce-b152-e7d40c74ace5 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:52.469970 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae7a70b-350e-4cce-b152-e7d40c74ace5 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:52.469970 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae7a70b-350e-4cce-b152-e7d40c74ace5 None admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:52.470642 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae7a70b-350e-4cce-b152-e7d40c74ace5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:52.470944 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae7a70b-350e-4cce-b152-e7d40c74ace5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:52.472649 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae7a70b-350e-4cce-b152-e7d40c74ace5 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:52.476243 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16275fe3-baec-4d13-b947-cdd83d746b8d None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:52.484511 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 168/329] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 10:57:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:57:52.489827 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae7a70b-350e-4cce-b152-e7d40c74ace5 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:52.522633 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c875a4-f8d2-4db6-a077-ea2f7baf0238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:52.523227 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c875a4-f8d2-4db6-a077-ea2f7baf0238 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:52.523495 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c875a4-f8d2-4db6-a077-ea2f7baf0238 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:52.523770 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c875a4-f8d2-4db6-a077-ea2f7baf0238 None admin] PATH_INFO: `/v3/projects/c32dd153f5284943a7a036275c792a45` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:52.524903 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c875a4-f8d2-4db6-a077-ea2f7baf0238 None admin] RBAC: Authorizing `identity:get_project(project_id=c32dd153f5284943a7a036275c792a45)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:52.526404 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c875a4-f8d2-4db6-a077-ea2f7baf0238 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:52.528024 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 162/330] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Oct 13 10:57:52 2022] GET /identity/v3/projects/c32dd153f5284943a7a036275c792a45 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:57:52.533848 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c875a4-f8d2-4db6-a077-ea2f7baf0238 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:52.597131 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:52.602315 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae7a70b-350e-4cce-b152-e7d40c74ace5 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:52.636468 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f1ee92-1af9-4d66-a0eb-1deef146d7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:52.637070 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1ee92-1af9-4d66-a0eb-1deef146d7c9 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:52.637353 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1ee92-1af9-4d66-a0eb-1deef146d7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:52.637476 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c875a4-f8d2-4db6-a077-ea2f7baf0238 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:52.637629 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1ee92-1af9-4d66-a0eb-1deef146d7c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:52.671119 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a3e0e6-64b0-4fa3-bf2f-68d8148abb78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:52.671737 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a3e0e6-64b0-4fa3-bf2f-68d8148abb78 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:52.672016 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a3e0e6-64b0-4fa3-bf2f-68d8148abb78 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:52.672291 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a3e0e6-64b0-4fa3-bf2f-68d8148abb78 None admin] PATH_INFO: `/v3/groups/63f369b2301643f2afe01dd346cdd0e2` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:52.673397 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a3e0e6-64b0-4fa3-bf2f-68d8148abb78 None admin] RBAC: Authorizing `identity:get_group(group_id=63f369b2301643f2afe01dd346cdd0e2)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:52.674864 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a3e0e6-64b0-4fa3-bf2f-68d8148abb78 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:52.676976 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 163/331] 10.222.0.25 () {56 vars in 1180 bytes} [Thu Oct 13 10:57:52 2022] GET /identity/v3/groups/63f369b2301643f2afe01dd346cdd0e2 => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:57:52.682777 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a3e0e6-64b0-4fa3-bf2f-68d8148abb78 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:52.686925 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:52.708470 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f1ee92-1af9-4d66-a0eb-1deef146d7c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:52.709997 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f1ee92-1af9-4d66-a0eb-1deef146d7c9 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:52.782185 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a3e0e6-64b0-4fa3-bf2f-68d8148abb78 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:52.806128 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 169/332] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Oct 13 10:57:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 13 10:57:52.807784 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:52.811653 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f1ee92-1af9-4d66-a0eb-1deef146d7c9 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:52.815717 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336eef33-a270-4e48-814f-669de7c6d837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:52.816314 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336eef33-a270-4e48-814f-669de7c6d837 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:52.816586 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336eef33-a270-4e48-814f-669de7c6d837 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:52.816881 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336eef33-a270-4e48-814f-669de7c6d837 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:52.817598 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336eef33-a270-4e48-814f-669de7c6d837 None admin] RBAC: Adding query filter params (group.id=63f369b2301643f2afe01dd346cdd0e2, role.id=84a5ec3770b4453bb7c3ff5b9af0bd17, scope.project.id=c32dd153f5284943a7a036275c792a45) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:52.817905 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336eef33-a270-4e48-814f-669de7c6d837 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:52.819339 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336eef33-a270-4e48-814f-669de7c6d837 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:52.834507 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 164/333] 10.222.0.25 () {56 vars in 1376 bytes} [Thu Oct 13 10:57:52 2022] GET /identity/v3/role_assignments?group.id=63f369b2301643f2afe01dd346cdd0e2&scope.project.id=c32dd153f5284943a7a036275c792a45&role.id=84a5ec3770b4453bb7c3ff5b9af0bd17 => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:57:52.899399 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:52.918556 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f1ee92-1af9-4d66-a0eb-1deef146d7c9 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:52.953636 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66a0341-202f-4036-9767-e058b95570fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:52.954389 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a0341-202f-4036-9767-e058b95570fb None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:52.954669 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a0341-202f-4036-9767-e058b95570fb None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:52.954938 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a0341-202f-4036-9767-e058b95570fb None admin] PATH_INFO: `/v3/projects/cbde15a03afe4c128d89633ab934d9a0` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:52.956067 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66a0341-202f-4036-9767-e058b95570fb None admin] RBAC: Authorizing `identity:get_project(project_id=cbde15a03afe4c128d89633ab934d9a0)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:52.957531 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66a0341-202f-4036-9767-e058b95570fb None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:52.959259 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 170/334] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Oct 13 10:57:52 2022] GET /identity/v3/projects/cbde15a03afe4c128d89633ab934d9a0 => generated 344 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:57:52.964955 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336eef33-a270-4e48-814f-669de7c6d837 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:53.065873 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336eef33-a270-4e48-814f-669de7c6d837 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:53.099400 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a686f9-3e5f-4823-a46b-5d340b74e2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:53.100033 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a686f9-3e5f-4823-a46b-5d340b74e2fa None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:53.100312 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a686f9-3e5f-4823-a46b-5d340b74e2fa None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:53.100579 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a686f9-3e5f-4823-a46b-5d340b74e2fa None admin] PATH_INFO: `/v3/groups/a36807f493c7425cb83414151f3375bc` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:53.101681 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a686f9-3e5f-4823-a46b-5d340b74e2fa None admin] RBAC: Authorizing `identity:get_group(group_id=a36807f493c7425cb83414151f3375bc)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:53.103148 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a686f9-3e5f-4823-a46b-5d340b74e2fa None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:53.104708 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 165/335] 10.222.0.25 () {56 vars in 1180 bytes} [Thu Oct 13 10:57:52 2022] GET /identity/v3/groups/a36807f493c7425cb83414151f3375bc => generated 229 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:53.110611 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66a0341-202f-4036-9767-e058b95570fb None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:53.211159 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66a0341-202f-4036-9767-e058b95570fb None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:53.242760 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c8b8ac-0f55-41ae-ab09-a0a7e73af38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:53.243360 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c8b8ac-0f55-41ae-ab09-a0a7e73af38a None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:53.243637 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c8b8ac-0f55-41ae-ab09-a0a7e73af38a None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:53.243904 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c8b8ac-0f55-41ae-ab09-a0a7e73af38a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:53.244622 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c8b8ac-0f55-41ae-ab09-a0a7e73af38a None admin] RBAC: Adding query filter params (group.id=a36807f493c7425cb83414151f3375bc, role.id=ea564961b1db4eb4a1d4d880964611b2, scope.project.id=cbde15a03afe4c128d89633ab934d9a0) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:53.244930 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c8b8ac-0f55-41ae-ab09-a0a7e73af38a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:53.246367 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c8b8ac-0f55-41ae-ab09-a0a7e73af38a None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:53.251812 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 171/336] 10.222.0.25 () {56 vars in 1376 bytes} [Thu Oct 13 10:57:53 2022] GET /identity/v3/role_assignments?group.id=a36807f493c7425cb83414151f3375bc&scope.project.id=cbde15a03afe4c128d89633ab934d9a0&role.id=ea564961b1db4eb4a1d4d880964611b2 => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:55.822981 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3531ed5-bced-4844-87cc-2c4f2f85299d None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:55.823571 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3531ed5-bced-4844-87cc-2c4f2f85299d None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:55.823571 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3531ed5-bced-4844-87cc-2c4f2f85299d None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:55.825095 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 166/337] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:57:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:55.830560 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdce776-39a7-4b2c-9bb3-f725ecbeb984 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:55.831002 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdce776-39a7-4b2c-9bb3-f725ecbeb984 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:55.831168 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdce776-39a7-4b2c-9bb3-f725ecbeb984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:55.865974 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-2bdce776-39a7-4b2c-9bb3-f725ecbeb984 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:55.867229 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-2bdce776-39a7-4b2c-9bb3-f725ecbeb984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:55.878457 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:55.965489 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 172/338] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 13 10:57:56.002829 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fe6075-51b5-429d-a7ad-53f000f29fa2 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:56.003459 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fe6075-51b5-429d-a7ad-53f000f29fa2 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:56.003944 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fe6075-51b5-429d-a7ad-53f000f29fa2 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:56.005849 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 167/339] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:57:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:56.011410 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ba8fe-fc19-4f3b-8c33-05644c1c2e21 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:56.011707 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ba8fe-fc19-4f3b-8c33-05644c1c2e21 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:56.011979 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ba8fe-fc19-4f3b-8c33-05644c1c2e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:56.038926 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-043ba8fe-fc19-4f3b-8c33-05644c1c2e21 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:56.040119 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-043ba8fe-fc19-4f3b-8c33-05644c1c2e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:56.125145 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 173/340] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:57:56.254584 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fe6075-51b5-429d-a7ad-53f000f29fa2 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:56.293554 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8dc58-5e72-4302-a73d-d3fde8fc079f None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:56.294228 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8dc58-5e72-4302-a73d-d3fde8fc079f None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:56.294734 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8dc58-5e72-4302-a73d-d3fde8fc079f None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:56.296527 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 174/341] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:57:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:56.302179 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8ae29-28ab-47a7-9e81-5e12c8143f1b None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:56.302569 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8ae29-28ab-47a7-9e81-5e12c8143f1b None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:56.302845 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8ae29-28ab-47a7-9e81-5e12c8143f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:56.330302 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:56.334918 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-66f8ae29-28ab-47a7-9e81-5e12c8143f1b None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:56.336112 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-66f8ae29-28ab-47a7-9e81-5e12c8143f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:56.371067 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fe6075-51b5-429d-a7ad-53f000f29fa2 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:56.405408 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e004ab-2675-42e6-aaeb-c9a65a10c4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:56.405974 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e004ab-2675-42e6-aaeb-c9a65a10c4c6 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:56.406255 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e004ab-2675-42e6-aaeb-c9a65a10c4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:56.406526 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e004ab-2675-42e6-aaeb-c9a65a10c4c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:56.418332 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e004ab-2675-42e6-aaeb-c9a65a10c4c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:56.419766 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e004ab-2675-42e6-aaeb-c9a65a10c4c6 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:56.435610 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-16e004ab-2675-42e6-aaeb-c9a65a10c4c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:57:56.435610 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:56.435610 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:57:56.435610 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:57:56.435610 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:57:56.435610 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:57:56.435610 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:57:56.435610 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:57:56.435610 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:57:56.435610 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:57:56.435610 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:57:56.435610 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:57:56.435610 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:57:56.435610 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:57:56.435610 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:57:56.435610 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:57:56.436553 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:57:56.436553 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:57:56.436553 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:57:56.436553 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:57:56.436553 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:57:56.436553 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:57:56.436553 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:57:56.436553 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 10:57:56.436553 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:57:56.436553 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:57:56.436553 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:57:56.436553 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:57:56.436553 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:57:56.436553 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:57:56.436553 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:57:56.436553 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:57:56.436553 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:57:56.437417 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:57:56.437417 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:57:56.437417 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:57:56.437417 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 168/342] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 10:57:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:57:56.442904 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e004ab-2675-42e6-aaeb-c9a65a10c4c6 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:56.468847 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 175/343] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:57:56.546940 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e004ab-2675-42e6-aaeb-c9a65a10c4c6 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:56.551546 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f8ae29-28ab-47a7-9e81-5e12c8143f1b None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:56.558995 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:56.561187 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:56.583983 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5f4cda-5f6b-4a66-9e43-5310dc0ed815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:56.584593 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f4cda-5f6b-4a66-9e43-5310dc0ed815 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:56.584868 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f4cda-5f6b-4a66-9e43-5310dc0ed815 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:56.585141 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f4cda-5f6b-4a66-9e43-5310dc0ed815 None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:56.585775 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5f4cda-5f6b-4a66-9e43-5310dc0ed815 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:56.586120 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5f4cda-5f6b-4a66-9e43-5310dc0ed815 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:56.587569 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5f4cda-5f6b-4a66-9e43-5310dc0ed815 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:56.605529 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 169/344] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 10:57:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:57:56.611038 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5f4cda-5f6b-4a66-9e43-5310dc0ed815 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:56.718490 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5f4cda-5f6b-4a66-9e43-5310dc0ed815 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:56.753271 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f8ae29-28ab-47a7-9e81-5e12c8143f1b None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:56.760461 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db1d5f-cad4-43a8-9002-b96152ac56d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:56.761064 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db1d5f-cad4-43a8-9002-b96152ac56d4 None admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:56.761337 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db1d5f-cad4-43a8-9002-b96152ac56d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:56.761604 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db1d5f-cad4-43a8-9002-b96152ac56d4 None admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:56.762846 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64db1d5f-cad4-43a8-9002-b96152ac56d4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:56.764730 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64db1d5f-cad4-43a8-9002-b96152ac56d4 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:56.791623 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b5fe1a-b953-415f-93b1-bba2274c25b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:56.792490 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5fe1a-b953-415f-93b1-bba2274c25b1 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:56.792773 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5fe1a-b953-415f-93b1-bba2274c25b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:56.793185 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5fe1a-b953-415f-93b1-bba2274c25b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:56.793295 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 170/345] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Oct 13 10:57:56 2022] POST /identity/v3/users => generated 246 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 10:57:56.794621 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b90f089-45ca-4d3d-845b-4a9b5bf01ed1 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:56.795160 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b90f089-45ca-4d3d-845b-4a9b5bf01ed1 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:56.795490 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b90f089-45ca-4d3d-845b-4a9b5bf01ed1 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:56.797476 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 171/346] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:57:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:56.798266 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b90f089-45ca-4d3d-845b-4a9b5bf01ed1 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:56.806121 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b5fe1a-b953-415f-93b1-bba2274c25b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:56.807663 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b5fe1a-b953-415f-93b1-bba2274c25b1 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:56.826992 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-44b5fe1a-b953-415f-93b1-bba2274c25b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:57:56.826992 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:56.826992 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:57:56.826992 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:57:56.826992 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:57:56.826992 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:57:56.826992 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:57:56.826992 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:57:56.826992 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:57:56.826992 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:57:56.826992 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:57:56.826992 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:57:56.826992 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:57:56.826992 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:57:56.826992 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:57:56.826992 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:57:56.827933 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:57:56.827933 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:57:56.827933 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:57:56.827933 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:57:56.827933 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:57:56.827933 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:57:56.827933 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:57:56.827933 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:57:56.827933 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:57:56.827933 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:57:56.827933 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:57:56.827933 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:57:56.827933 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:57:56.827933 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:57:56.827933 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:57:56.827933 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:57:56.827933 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:57:56.828786 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:57:56.828786 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:57:56.828786 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:57:56.828786 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 176/347] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 10:57:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:57:56.829961 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379969b-e03c-44d9-9ae3-cce6c930404b None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:56.830590 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379969b-e03c-44d9-9ae3-cce6c930404b None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:56.831519 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379969b-e03c-44d9-9ae3-cce6c930404b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:56.834558 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:56.852453 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-1379969b-e03c-44d9-9ae3-cce6c930404b None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:56.854206 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-1379969b-e03c-44d9-9ae3-cce6c930404b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:56.923212 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:56.936085 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b90f089-45ca-4d3d-845b-4a9b5bf01ed1 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:56.946353 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 177/348] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:57:56.947775 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1379969b-e03c-44d9-9ae3-cce6c930404b None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:56.972379 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb6cfa3-9562-43e7-8c9b-24b97bab1c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:56.973463 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6cfa3-9562-43e7-8c9b-24b97bab1c42 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:56.973742 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6cfa3-9562-43e7-8c9b-24b97bab1c42 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:56.974045 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6cfa3-9562-43e7-8c9b-24b97bab1c42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:56.987071 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb6cfa3-9562-43e7-8c9b-24b97bab1c42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:56.989529 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb6cfa3-9562-43e7-8c9b-24b97bab1c42 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:57.007047 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-1eb6cfa3-9562-43e7-8c9b-24b97bab1c42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:57:57.007047 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:57.007047 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:57:57.007047 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:57:57.007047 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:57:57.007047 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:57:57.007047 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:57:57.007047 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:57:57.007047 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:57:57.007047 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:57:57.007047 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:57:57.007047 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:57:57.007047 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:57:57.007047 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:57:57.007047 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:57:57.007047 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:57:57.008016 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:57:57.008016 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:57:57.008016 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:57:57.008016 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:57:57.008016 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:57:57.008016 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:57:57.008016 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:57:57.008016 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 10:57:57.008016 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:57:57.008016 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:57:57.008016 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:57:57.008016 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:57:57.008016 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:57:57.008016 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:57:57.008016 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:57:57.008016 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:57:57.008016 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:57:57.009069 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:57:57.009069 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:57:57.009069 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:57:57.009069 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 172/349] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 10:57:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:57:57.014251 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb6cfa3-9562-43e7-8c9b-24b97bab1c42 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:57.071770 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1379969b-e03c-44d9-9ae3-cce6c930404b None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:57.108880 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebbc4ff-3d45-4684-a55b-23a65252b209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:57.109728 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebbc4ff-3d45-4684-a55b-23a65252b209 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:57.110198 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebbc4ff-3d45-4684-a55b-23a65252b209 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:57.110710 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebbc4ff-3d45-4684-a55b-23a65252b209 None admin] PATH_INFO: `/v3/domains` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:57.111747 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebbc4ff-3d45-4684-a55b-23a65252b209 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:57.112199 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebbc4ff-3d45-4684-a55b-23a65252b209 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:57.113835 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebbc4ff-3d45-4684-a55b-23a65252b209 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:57.126155 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 178/350] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 10:57:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:57.130319 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:57.132747 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebbc4ff-3d45-4684-a55b-23a65252b209 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:57.141675 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb6cfa3-9562-43e7-8c9b-24b97bab1c42 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:57.180708 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891eaaec-e912-45bb-8792-9b88eefe15e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:57.181496 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891eaaec-e912-45bb-8792-9b88eefe15e5 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:57.181778 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891eaaec-e912-45bb-8792-9b88eefe15e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:57.182160 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891eaaec-e912-45bb-8792-9b88eefe15e5 None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:57.182723 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891eaaec-e912-45bb-8792-9b88eefe15e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:57.183024 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891eaaec-e912-45bb-8792-9b88eefe15e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:57.184495 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891eaaec-e912-45bb-8792-9b88eefe15e5 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:57.185726 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:57.199425 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 173/351] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 10:57:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:57.205059 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891eaaec-e912-45bb-8792-9b88eefe15e5 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:57.244703 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebbc4ff-3d45-4684-a55b-23a65252b209 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:57.292761 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5677a266-db6e-4506-9109-dff43216bee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:57.293372 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677a266-db6e-4506-9109-dff43216bee6 None admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:57.293652 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677a266-db6e-4506-9109-dff43216bee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:57.293921 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677a266-db6e-4506-9109-dff43216bee6 None admin] PATH_INFO: `/v3/users` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:57.294597 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5677a266-db6e-4506-9109-dff43216bee6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:57.296016 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5677a266-db6e-4506-9109-dff43216bee6 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:57.322691 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 179/352] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Oct 13 10:57:57 2022] POST /identity/v3/users => generated 248 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 10:57:57.324193 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5677a266-db6e-4506-9109-dff43216bee6 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:57.353600 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891eaaec-e912-45bb-8792-9b88eefe15e5 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:57.402432 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cdadc2-dfbe-4b93-9d1e-50341aeb8f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:57.403668 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cdadc2-dfbe-4b93-9d1e-50341aeb8f66 None admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:57.404140 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cdadc2-dfbe-4b93-9d1e-50341aeb8f66 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:57.404622 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cdadc2-dfbe-4b93-9d1e-50341aeb8f66 None admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:57.405899 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cdadc2-dfbe-4b93-9d1e-50341aeb8f66 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:57.407781 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cdadc2-dfbe-4b93-9d1e-50341aeb8f66 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:57.421788 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:57.441295 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 174/353] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Oct 13 10:57:57 2022] POST /identity/v3/users => generated 248 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 10:57:57.474966 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5677a266-db6e-4506-9109-dff43216bee6 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:57.477468 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:57.529214 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c73b88a-57da-454f-befc-2dc49a96f8b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:57.534513 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c73b88a-57da-454f-befc-2dc49a96f8b2 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:57.535263 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c73b88a-57da-454f-befc-2dc49a96f8b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:57.535810 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c73b88a-57da-454f-befc-2dc49a96f8b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:57.547614 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c73b88a-57da-454f-befc-2dc49a96f8b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:57.549454 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c73b88a-57da-454f-befc-2dc49a96f8b2 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:57.570732 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-1c73b88a-57da-454f-befc-2dc49a96f8b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:57:57.570732 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:57.570732 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:57:57.570732 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:57:57.570732 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:57:57.570732 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:57:57.570732 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:57:57.570732 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:57:57.570732 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:57:57.570732 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:57:57.570732 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:57:57.570732 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:57:57.570732 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:57:57.570732 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:57:57.570732 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:57:57.570732 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:57:57.571700 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:57:57.571700 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:57:57.571700 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:57:57.571700 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:57:57.571700 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:57:57.571700 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:57:57.571700 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:57:57.571700 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:57:57.571700 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:57:57.571700 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:57:57.571700 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:57:57.571700 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:57:57.571700 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:57:57.571700 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:57:57.571700 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:57:57.571700 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:57:57.571700 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:57:57.572793 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:57:57.572793 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:57:57.572793 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:57:57.572793 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 180/354] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 10:57:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:57:57.578116 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cdadc2-dfbe-4b93-9d1e-50341aeb8f66 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:57.620843 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65accb-5f92-4829-8175-30d85fd194ac None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:57.621169 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65accb-5f92-4829-8175-30d85fd194ac None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:57.621391 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65accb-5f92-4829-8175-30d85fd194ac None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:57.623035 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 181/355] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:57:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:57.629891 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2e1ac-fc78-4001-8a12-a2a46dbdc898 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:57.630321 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2e1ac-fc78-4001-8a12-a2a46dbdc898 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:57.630514 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2e1ac-fc78-4001-8a12-a2a46dbdc898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:57.662654 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-35b2e1ac-fc78-4001-8a12-a2a46dbdc898 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:57.664014 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-35b2e1ac-fc78-4001-8a12-a2a46dbdc898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:57.703824 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cdadc2-dfbe-4b93-9d1e-50341aeb8f66 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:57.744846 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 182/356] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:57:57.755644 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b22336-26f8-44e3-8a28-d5a7f6bc4fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:57.756259 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b22336-26f8-44e3-8a28-d5a7f6bc4fba None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:57.756534 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b22336-26f8-44e3-8a28-d5a7f6bc4fba None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:57.756808 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b22336-26f8-44e3-8a28-d5a7f6bc4fba None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:57.757452 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b22336-26f8-44e3-8a28-d5a7f6bc4fba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:57.757755 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b22336-26f8-44e3-8a28-d5a7f6bc4fba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:57.759161 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b22336-26f8-44e3-8a28-d5a7f6bc4fba None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:57.771871 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 175/357] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 10:57:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:57.776924 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b2e1ac-fc78-4001-8a12-a2a46dbdc898 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:57.893776 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:57.917025 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b2e1ac-fc78-4001-8a12-a2a46dbdc898 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:57.967880 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741ca256-4a17-4551-8df5-b7669bd7259e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:57.968489 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ca256-4a17-4551-8df5-b7669bd7259e None admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:57.968766 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ca256-4a17-4551-8df5-b7669bd7259e None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:57.969033 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ca256-4a17-4551-8df5-b7669bd7259e None admin] PATH_INFO: `/v3/users` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:57.969689 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741ca256-4a17-4551-8df5-b7669bd7259e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:57.971122 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741ca256-4a17-4551-8df5-b7669bd7259e None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:58.011297 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 183/358] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Oct 13 10:57:57 2022] POST /identity/v3/users => generated 249 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 10:57:58.022369 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b22336-26f8-44e3-8a28-d5a7f6bc4fba None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:58.116850 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:58.172938 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b22336-26f8-44e3-8a28-d5a7f6bc4fba None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:58.216104 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11daec03-d6a0-4d71-9f10-965f82819983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:58.216712 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11daec03-d6a0-4d71-9f10-965f82819983 None admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:58.216991 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11daec03-d6a0-4d71-9f10-965f82819983 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:58.217260 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11daec03-d6a0-4d71-9f10-965f82819983 None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:58.217970 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11daec03-d6a0-4d71-9f10-965f82819983 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:58.219388 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11daec03-d6a0-4d71-9f10-965f82819983 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:58.227314 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.sql.core [None req-11daec03-d6a0-4d71-9f10-965f82819983 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 13 10:57:58.227314 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 13 10:57:58.227314 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [parameters: {'id': 'ed328f63d4d04546a78c75ecb90a33d8', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 13 10:57:58.227314 dv-cinder-861001-1-smb devstack@keystone.service[81550]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81550) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 13 10:57:58.244438 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-11daec03-d6a0-4d71-9f10-965f82819983 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 13 10:57:58.244438 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:58.244438 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 13 10:57:58.244438 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 13 10:57:58.244438 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 13 10:57:58.244438 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 13 10:57:58.244438 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 13 10:57:58.244438 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application result = self._query(query) Oct 13 10:57:58.244438 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 13 10:57:58.244438 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application conn.query(q) Oct 13 10:57:58.244438 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 13 10:57:58.244438 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 13 10:57:58.244438 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 13 10:57:58.244438 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application result.read() Oct 13 10:57:58.244438 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 13 10:57:58.245378 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 13 10:57:58.245378 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 13 10:57:58.245378 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 13 10:57:58.245378 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 13 10:57:58.245378 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 13 10:57:58.245378 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 13 10:57:58.245378 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 13 10:57:58.245378 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 13 10:57:58.245378 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:57:58.245378 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 13 10:57:58.245378 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:57:58.245378 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:58.245378 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 13 10:57:58.245378 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 13 10:57:58.245378 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 13 10:57:58.245378 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return ref.to_dict() Oct 13 10:57:58.245378 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 13 10:57:58.245378 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application next(self.gen) Oct 13 10:57:58.246921 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 13 10:57:58.246921 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application yield resource Oct 13 10:57:58.246921 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 13 10:57:58.246921 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application next(self.gen) Oct 13 10:57:58.246921 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 13 10:57:58.246921 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self.session.rollback() Oct 13 10:57:58.246921 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 13 10:57:58.246921 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self.force_reraise() Oct 13 10:57:58.246921 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 13 10:57:58.246921 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise self.value Oct 13 10:57:58.246921 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 13 10:57:58.246921 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 13 10:57:58.246921 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 13 10:57:58.246921 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application session.commit() Oct 13 10:57:58.246921 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 13 10:57:58.246921 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 13 10:57:58.246921 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 13 10:57:58.247744 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self._prepare_impl() Oct 13 10:57:58.247744 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 13 10:57:58.247744 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self.session.flush() Oct 13 10:57:58.247744 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 13 10:57:58.247744 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self._flush(objects) Oct 13 10:57:58.247744 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 13 10:57:58.247744 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 13 10:57:58.247744 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 13 10:57:58.247744 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application compat.raise_( Oct 13 10:57:58.247744 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 13 10:57:58.247744 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception Oct 13 10:57:58.247744 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 13 10:57:58.247744 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application flush_context.execute() Oct 13 10:57:58.247744 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 13 10:57:58.247744 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rec.execute(self) Oct 13 10:57:58.247744 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 13 10:57:58.247744 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 13 10:57:58.248586 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 13 10:57:58.248586 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 13 10:57:58.248586 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 13 10:57:58.248586 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 13 10:57:58.248586 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 13 10:57:58.248586 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 13 10:57:58.248586 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 13 10:57:58.248586 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 13 10:57:58.248586 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 13 10:57:58.248586 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 13 10:57:58.248586 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 13 10:57:58.248586 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 13 10:57:58.248586 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 13 10:57:58.248586 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 13 10:57:58.248586 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 13 10:57:58.248586 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception Oct 13 10:57:58.249364 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 13 10:57:58.249364 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 13 10:57:58.249364 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 13 10:57:58.249364 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 13 10:57:58.249364 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 13 10:57:58.249364 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application result = self._query(query) Oct 13 10:57:58.249364 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 13 10:57:58.249364 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application conn.query(q) Oct 13 10:57:58.249364 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 13 10:57:58.249364 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 13 10:57:58.249364 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 13 10:57:58.249364 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application result.read() Oct 13 10:57:58.249364 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 13 10:57:58.249364 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 13 10:57:58.249364 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 13 10:57:58.249364 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 13 10:57:58.250949 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 13 10:57:58.250949 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 13 10:57:58.250949 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 13 10:57:58.250949 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 13 10:57:58.250949 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 13 10:57:58.250949 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 13 10:57:58.250949 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [parameters: {'id': 'ed328f63d4d04546a78c75ecb90a33d8', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 13 10:57:58.250949 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 13 10:57:58.250949 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:57:58.250949 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 10:57:58.250949 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:57:58.250949 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:58.250949 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:57:58.250949 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:57:58.250949 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:57:58.250949 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:57:58.252698 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:57:58.252698 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:57:58.252698 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:57:58.252698 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:57:58.252698 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:57:58.252698 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:57:58.252698 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 13 10:57:58.252698 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 13 10:57:58.252698 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:57:58.252698 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:57:58.252698 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 13 10:57:58.252698 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 13 10:57:58.252698 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 13 10:57:58.252698 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 13 10:57:58.252698 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 13 10:57:58.252698 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:57:58.253709 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 176/359] 10.222.0.25 () {60 vars in 1131 bytes} [Thu Oct 13 10:57:58 2022] POST /identity/v3/roles => generated 144 bytes in 224 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 13 10:57:58.253791 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741ca256-4a17-4551-8df5-b7669bd7259e None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:58.364628 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741ca256-4a17-4551-8df5-b7669bd7259e None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:58.400113 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db89b13-3548-4a79-a3f8-b3aec7f352af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:58.400755 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db89b13-3548-4a79-a3f8-b3aec7f352af None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:58.401035 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db89b13-3548-4a79-a3f8-b3aec7f352af None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:58.401361 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db89b13-3548-4a79-a3f8-b3aec7f352af None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:58.409187 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:58.413503 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db89b13-3548-4a79-a3f8-b3aec7f352af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:57:58.418367 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-5db89b13-3548-4a79-a3f8-b3aec7f352af None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 13 10:57:58.418367 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:58.418367 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:57:58.418367 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:57:58.418367 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:57:58.418367 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:57:58.418367 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:57:58.418367 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:57:58.418367 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:57:58.418367 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:57:58.418367 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:57:58.418367 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:57:58.418367 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:57:58.418367 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:57:58.418367 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:57:58.418367 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:57:58.419249 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:57:58.419249 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:57:58.419249 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:57:58.419249 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:57:58.419249 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:57:58.419249 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:57:58.419249 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:57:58.419249 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:57:58.419249 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:57:58.419249 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:57:58.419249 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:57:58.419249 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:57:58.419249 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:57:58.419249 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:57:58.419249 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:57:58.419249 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:57:58.420073 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:57:58.420073 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:57:58.420073 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:57:58.420073 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:57:58.420073 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:57:58.420073 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:57:58.420073 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:57:58.420073 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:57:58.420073 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:57:58.420073 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:57:58.420073 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 13 10:57:58.420073 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:57:58.424629 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 184/360] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Oct 13 10:57:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:57:58.425917 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11daec03-d6a0-4d71-9f10-965f82819983 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:58.553414 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11daec03-d6a0-4d71-9f10-965f82819983 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:58.584270 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:58.601343 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b00daab-86e2-4e4d-b293-f1b2f372c103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:58.601980 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00daab-86e2-4e4d-b293-f1b2f372c103 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:58.602264 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00daab-86e2-4e4d-b293-f1b2f372c103 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:58.602537 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00daab-86e2-4e4d-b293-f1b2f372c103 None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:58.603279 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b00daab-86e2-4e4d-b293-f1b2f372c103 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:58.603588 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b00daab-86e2-4e4d-b293-f1b2f372c103 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:58.605041 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b00daab-86e2-4e4d-b293-f1b2f372c103 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:58.619139 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 177/361] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Oct 13 10:57:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:59.429974 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e071ae0b-655d-4549-9ef9-129061d55b2b None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:59.430492 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e071ae0b-655d-4549-9ef9-129061d55b2b None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:59.430592 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e071ae0b-655d-4549-9ef9-129061d55b2b None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:59.432122 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 185/362] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:57:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:59.437340 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7243dbf-ad60-482b-bc36-27e41e64c17d None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:59.437760 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7243dbf-ad60-482b-bc36-27e41e64c17d None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:59.437973 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7243dbf-ad60-482b-bc36-27e41e64c17d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:59.458854 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-c7243dbf-ad60-482b-bc36-27e41e64c17d None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:59.460035 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-c7243dbf-ad60-482b-bc36-27e41e64c17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:59.544149 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 178/363] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:57:59.882533 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e071ae0b-655d-4549-9ef9-129061d55b2b None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:59.997389 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e071ae0b-655d-4549-9ef9-129061d55b2b None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:00.032530 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c101c011-3daf-4277-87a7-1d4fcff05908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:00.033216 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101c011-3daf-4277-87a7-1d4fcff05908 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:00.033498 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101c011-3daf-4277-87a7-1d4fcff05908 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:00.033769 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101c011-3daf-4277-87a7-1d4fcff05908 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:00.044409 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c101c011-3daf-4277-87a7-1d4fcff05908 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:58:00.049322 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-c101c011-3daf-4277-87a7-1d4fcff05908 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 13 10:58:00.049322 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:00.049322 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:00.049322 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:00.049322 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:00.049322 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:00.049322 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:00.049322 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:00.049322 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:00.049322 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:00.049322 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:00.049322 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:00.049322 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:58:00.049322 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:58:00.049322 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:58:00.049322 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:58:00.050301 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:58:00.050301 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:58:00.050301 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:58:00.050301 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:58:00.050301 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:00.050301 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:00.050301 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:00.050301 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:00.050301 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:00.050301 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:00.050301 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:00.050301 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:00.050301 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:00.050301 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:00.050301 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:00.050301 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:00.051109 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:00.051109 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:00.051109 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:00.051109 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:00.051109 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:58:00.051109 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:58:00.051109 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:58:00.051109 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:58:00.051109 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:58:00.051109 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:58:00.051109 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 13 10:58:00.051109 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:00.051109 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 186/364] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Oct 13 10:57:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:00.057798 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7243dbf-ad60-482b-bc36-27e41e64c17d None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:00.220510 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7243dbf-ad60-482b-bc36-27e41e64c17d None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:00.245278 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:00.271315 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e293b382-e4c3-40f6-933e-6b1aed52ae94 None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:00.271960 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e293b382-e4c3-40f6-933e-6b1aed52ae94 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:00.272433 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e293b382-e4c3-40f6-933e-6b1aed52ae94 None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:00.274259 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 187/365] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:58:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:00.274361 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06ef24e-c0f9-497e-90e8-0997b93f8172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:00.278004 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ef24e-c0f9-497e-90e8-0997b93f8172 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:00.278004 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ef24e-c0f9-497e-90e8-0997b93f8172 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:00.278004 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ef24e-c0f9-497e-90e8-0997b93f8172 None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:00.278004 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06ef24e-c0f9-497e-90e8-0997b93f8172 None admin] RBAC: Adding query filter params (name=service) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:00.278004 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06ef24e-c0f9-497e-90e8-0997b93f8172 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:00.278004 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06ef24e-c0f9-497e-90e8-0997b93f8172 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:00.280313 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd61ec91-849d-4769-9948-90ba19c3f9d3 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:00.281074 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd61ec91-849d-4769-9948-90ba19c3f9d3 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:00.281544 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd61ec91-849d-4769-9948-90ba19c3f9d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:00.293520 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 179/366] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Oct 13 10:58:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:00.298751 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06ef24e-c0f9-497e-90e8-0997b93f8172 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:00.304054 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-fd61ec91-849d-4769-9948-90ba19c3f9d3 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:00.305525 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-fd61ec91-849d-4769-9948-90ba19c3f9d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:00.410394 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:00.429974 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 188/367] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 13 10:58:00.429974 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a72ef2-5aad-45f7-afc8-a666d6cb787a None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:00.429974 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a72ef2-5aad-45f7-afc8-a666d6cb787a None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:00.429974 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a72ef2-5aad-45f7-afc8-a666d6cb787a None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:00.429974 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 189/368] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:58:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:00.432410 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b82ce-fe1c-4f04-8788-390d7c3379ea None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:00.432691 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b82ce-fe1c-4f04-8788-390d7c3379ea None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:00.432957 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b82ce-fe1c-4f04-8788-390d7c3379ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:00.452274 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-7f8b82ce-fe1c-4f04-8788-390d7c3379ea None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:00.453476 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-7f8b82ce-fe1c-4f04-8788-390d7c3379ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:00.473811 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06ef24e-c0f9-497e-90e8-0997b93f8172 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:00.529816 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecefc8f-9153-439b-8f12-89f98867fb47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:00.530580 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecefc8f-9153-439b-8f12-89f98867fb47 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:00.530863 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecefc8f-9153-439b-8f12-89f98867fb47 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:00.531139 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecefc8f-9153-439b-8f12-89f98867fb47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:00.542958 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecefc8f-9153-439b-8f12-89f98867fb47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:00.544460 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecefc8f-9153-439b-8f12-89f98867fb47 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:00.560151 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-9ecefc8f-9153-439b-8f12-89f98867fb47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:00.560151 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:00.560151 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:00.560151 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:00.560151 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:00.560151 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:00.560151 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:00.560151 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:00.560151 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:00.560151 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:00.560151 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:00.560151 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:00.560151 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:00.560151 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:00.560151 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:00.560151 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:00.561039 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:00.561039 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:00.561039 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:00.561039 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:00.561039 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:00.561039 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:00.561039 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:00.561039 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:00.561039 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:00.561039 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:00.561039 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:00.561039 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:00.561039 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:00.561039 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:00.561039 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:00.561039 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:00.561039 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:00.561857 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:00.561857 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:00.561857 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:00.561857 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 180/369] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 10:58:00.569085 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecefc8f-9153-439b-8f12-89f98867fb47 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:00.592327 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 190/370] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 13 10:58:00.624855 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:00.706002 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecefc8f-9153-439b-8f12-89f98867fb47 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:00.727339 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b82ce-fe1c-4f04-8788-390d7c3379ea None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:00.740698 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1592d1a0-85dc-4d71-9c36-d82bbdda9657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:00.741312 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592d1a0-85dc-4d71-9c36-d82bbdda9657 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:00.741590 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592d1a0-85dc-4d71-9c36-d82bbdda9657 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:00.741863 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592d1a0-85dc-4d71-9c36-d82bbdda9657 None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:00.742531 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1592d1a0-85dc-4d71-9c36-d82bbdda9657 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:00.742833 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1592d1a0-85dc-4d71-9c36-d82bbdda9657 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:00.744216 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1592d1a0-85dc-4d71-9c36-d82bbdda9657 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:00.756754 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 181/371] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:00.762276 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1592d1a0-85dc-4d71-9c36-d82bbdda9657 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:00.866108 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:00.871854 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b82ce-fe1c-4f04-8788-390d7c3379ea None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:00.883158 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1592d1a0-85dc-4d71-9c36-d82bbdda9657 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:00.902527 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:00.921493 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab010769-a859-4a02-b8b8-cdd89531d6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:00.922261 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab010769-a859-4a02-b8b8-cdd89531d6a6 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:00.922949 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab010769-a859-4a02-b8b8-cdd89531d6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:00.923292 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab010769-a859-4a02-b8b8-cdd89531d6a6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:00.927782 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd4136b-cf00-433b-b9e9-2bf5e1457db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:00.928858 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd4136b-cf00-433b-b9e9-2bf5e1457db5 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:00.929329 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd4136b-cf00-433b-b9e9-2bf5e1457db5 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:00.929599 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd4136b-cf00-433b-b9e9-2bf5e1457db5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:00.934795 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab010769-a859-4a02-b8b8-cdd89531d6a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:58:00.936947 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd4136b-cf00-433b-b9e9-2bf5e1457db5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:00.938424 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd4136b-cf00-433b-b9e9-2bf5e1457db5 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:00.939550 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-ab010769-a859-4a02-b8b8-cdd89531d6a6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 13 10:58:00.939550 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:00.939550 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:00.939550 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:00.939550 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:00.939550 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:00.939550 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:00.939550 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:00.939550 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:00.939550 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:00.939550 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:00.939550 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:00.939550 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:58:00.939550 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:58:00.939550 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:58:00.939550 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:58:00.940414 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:58:00.940414 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:58:00.940414 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:58:00.940414 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:58:00.940414 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:00.940414 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:00.940414 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:00.940414 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:00.940414 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:00.940414 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:00.940414 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:00.940414 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:00.940414 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:00.940414 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:00.940414 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:00.940414 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:00.942764 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:00.942764 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:00.942764 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:00.942764 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:00.942764 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:58:00.942764 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:58:00.942764 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:58:00.942764 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:58:00.942764 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:58:00.942764 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:58:00.942764 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 13 10:58:00.942764 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:00.942764 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 191/372] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Oct 13 10:58:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 10:58:00.942764 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087423a0-9a68-483a-88ba-3c4b8ba9e649 None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:00.943484 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087423a0-9a68-483a-88ba-3c4b8ba9e649 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:00.943484 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087423a0-9a68-483a-88ba-3c4b8ba9e649 None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:00.944382 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 192/373] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:58:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:00.944944 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087423a0-9a68-483a-88ba-3c4b8ba9e649 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:00.958421 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-ecd4136b-cf00-433b-b9e9-2bf5e1457db5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 13 10:58:00.958421 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:00.958421 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:00.958421 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:00.958421 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:00.958421 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:00.958421 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:00.958421 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:00.958421 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:00.958421 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:00.958421 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:00.958421 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:00.958421 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 10:58:00.958421 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 10:58:00.958421 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 10:58:00.958421 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 10:58:00.959323 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:00.959323 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:00.959323 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 10:58:00.959323 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:00.959323 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 10:58:00.959323 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:00.959323 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:00.959323 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:00.959323 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:00.959323 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:00.959323 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:00.959323 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:00.959323 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:00.959323 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:00.959323 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:00.959323 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:00.959323 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:00.959323 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:00.960179 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:00.960179 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:00.960179 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 10:58:00.960179 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 10:58:00.960179 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 10:58:00.960179 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 10:58:00.960179 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 10:58:00.960179 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 10:58:00.960179 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 13 10:58:00.960179 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:00.961322 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 182/374] 10.222.0.25 () {56 vars in 1093 bytes} [Thu Oct 13 10:58:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 10:58:00.962362 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd4136b-cf00-433b-b9e9-2bf5e1457db5 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:01.048331 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087423a0-9a68-483a-88ba-3c4b8ba9e649 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:01.074729 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd4136b-cf00-433b-b9e9-2bf5e1457db5 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:01.083401 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd8f4cf-879e-413f-b054-54a2117a81db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:01.084031 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd8f4cf-879e-413f-b054-54a2117a81db None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:01.084300 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd8f4cf-879e-413f-b054-54a2117a81db None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:01.084573 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd8f4cf-879e-413f-b054-54a2117a81db None admin] PATH_INFO: `/v3/roles/service` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:01.094953 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd8f4cf-879e-413f-b054-54a2117a81db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:58:01.100256 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-bcd8f4cf-879e-413f-b054-54a2117a81db None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 13 10:58:01.100256 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:01.100256 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:01.100256 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:01.100256 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:01.100256 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:01.100256 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:01.100256 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:01.100256 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:01.100256 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:01.100256 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:01.100256 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:01.100256 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:58:01.100256 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:58:01.100256 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:58:01.100256 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:58:01.101128 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:58:01.101128 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:58:01.101128 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:58:01.101128 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:58:01.101128 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:01.101128 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:01.101128 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:01.101128 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:01.101128 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:01.101128 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:01.101128 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:01.101128 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:01.101128 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:01.101128 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:01.101128 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:01.101128 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:01.101925 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:01.101925 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:01.101925 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:01.101925 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:01.101925 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:58:01.101925 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:58:01.101925 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:58:01.101925 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:58:01.101925 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:58:01.101925 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:58:01.101925 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 13 10:58:01.101925 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:01.101925 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 193/375] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Oct 13 10:58:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:01.103199 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e33a782-4f17-4f4c-af95-9f56d7b015ae None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:01.103199 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e33a782-4f17-4f4c-af95-9f56d7b015ae None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:01.103199 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e33a782-4f17-4f4c-af95-9f56d7b015ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:01.115436 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8243141-9f73-4e31-8673-6fb042c91caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:01.116066 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8243141-9f73-4e31-8673-6fb042c91caf None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:01.116599 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8243141-9f73-4e31-8673-6fb042c91caf None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:01.116599 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8243141-9f73-4e31-8673-6fb042c91caf None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:01.117254 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8243141-9f73-4e31-8673-6fb042c91caf None admin] RBAC: Adding query filter params (name=service) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:01.117557 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8243141-9f73-4e31-8673-6fb042c91caf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:01.118940 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8243141-9f73-4e31-8673-6fb042c91caf None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:01.122218 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-7e33a782-4f17-4f4c-af95-9f56d7b015ae None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:01.123389 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-7e33a782-4f17-4f4c-af95-9f56d7b015ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:01.127373 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 183/376] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Oct 13 10:58:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:01.127584 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8243141-9f73-4e31-8673-6fb042c91caf None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:01.139459 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:01.165647 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:01.209967 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 194/377] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:58:01.209967 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e33a782-4f17-4f4c-af95-9f56d7b015ae None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:01.257255 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8243141-9f73-4e31-8673-6fb042c91caf None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:01.292723 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510dbe4b-2e93-4188-9901-ed0005090952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:01.294160 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510dbe4b-2e93-4188-9901-ed0005090952 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:01.294443 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510dbe4b-2e93-4188-9901-ed0005090952 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:01.294720 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510dbe4b-2e93-4188-9901-ed0005090952 None admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:01.295456 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510dbe4b-2e93-4188-9901-ed0005090952 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:01.295767 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510dbe4b-2e93-4188-9901-ed0005090952 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:01.297222 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510dbe4b-2e93-4188-9901-ed0005090952 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:01.326905 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e33a782-4f17-4f4c-af95-9f56d7b015ae None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:01.347129 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 184/378] 10.222.0.25 () {56 vars in 1133 bytes} [Thu Oct 13 10:58:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:01.347129 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510dbe4b-2e93-4188-9901-ed0005090952 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:01.375552 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd45b5c-19cf-4cad-9b03-6dedb884e7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:01.376472 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd45b5c-19cf-4cad-9b03-6dedb884e7ab None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:01.377143 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd45b5c-19cf-4cad-9b03-6dedb884e7ab None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:01.377557 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd45b5c-19cf-4cad-9b03-6dedb884e7ab None admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:01.378798 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd45b5c-19cf-4cad-9b03-6dedb884e7ab None admin] RBAC: Adding query filter params (name=service) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:01.380037 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd45b5c-19cf-4cad-9b03-6dedb884e7ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:01.382177 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd45b5c-19cf-4cad-9b03-6dedb884e7ab None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:01.395307 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 195/379] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Oct 13 10:58:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:01.396697 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd45b5c-19cf-4cad-9b03-6dedb884e7ab None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:01.430297 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:01.439410 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:01.468539 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510dbe4b-2e93-4188-9901-ed0005090952 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:01.512875 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2168fb1-0ca7-405c-a4b7-29293c6efd11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:01.513560 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2168fb1-0ca7-405c-a4b7-29293c6efd11 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:01.513851 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2168fb1-0ca7-405c-a4b7-29293c6efd11 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:01.514142 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2168fb1-0ca7-405c-a4b7-29293c6efd11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:01.521217 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd45b5c-19cf-4cad-9b03-6dedb884e7ab None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:01.525503 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2168fb1-0ca7-405c-a4b7-29293c6efd11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:01.527009 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2168fb1-0ca7-405c-a4b7-29293c6efd11 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:01.542573 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-e2168fb1-0ca7-405c-a4b7-29293c6efd11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:01.542573 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:01.542573 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:01.542573 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:01.542573 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:01.542573 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:01.542573 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:01.542573 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:01.542573 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:01.542573 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:01.542573 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:01.542573 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:01.542573 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:01.542573 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:01.542573 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:01.542573 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:01.543495 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:01.543495 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:01.543495 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:01.543495 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:01.543495 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:01.543495 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:01.543495 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:01.543495 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:01.543495 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:01.543495 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:01.543495 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:01.543495 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:01.543495 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:01.543495 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:01.543495 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:01.543495 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:01.543495 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:01.544344 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:01.544344 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:01.544344 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:01.544344 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 185/380] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:01.548857 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2168fb1-0ca7-405c-a4b7-29293c6efd11 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:01.559973 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a77446a-65b9-45ad-babd-d27f2821f464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:01.560927 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77446a-65b9-45ad-babd-d27f2821f464 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:01.561213 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77446a-65b9-45ad-babd-d27f2821f464 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:01.561641 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77446a-65b9-45ad-babd-d27f2821f464 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:01.572810 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a77446a-65b9-45ad-babd-d27f2821f464 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:01.574293 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a77446a-65b9-45ad-babd-d27f2821f464 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:01.588254 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-7a77446a-65b9-45ad-babd-d27f2821f464 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:01.588254 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:01.588254 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:01.588254 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:01.588254 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:01.588254 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:01.588254 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:01.588254 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:01.588254 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:01.588254 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:01.588254 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:01.588254 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:01.588254 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:01.588254 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:01.588254 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:01.588254 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:01.589148 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:01.589148 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:01.589148 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:01.589148 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:01.589148 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:01.589148 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:01.589148 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:01.589148 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:01.589148 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:01.589148 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:01.589148 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:01.589148 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:01.589148 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:01.589148 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:01.589148 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:01.589148 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:01.589148 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:01.590001 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:01.590001 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:01.590001 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:01.590001 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 196/381] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:01.590209 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a77446a-65b9-45ad-babd-d27f2821f464 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:01.654077 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2168fb1-0ca7-405c-a4b7-29293c6efd11 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:01.670136 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:01.677164 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:01.687783 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6865545-363a-49c5-806e-04345ce115a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:01.688413 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6865545-363a-49c5-806e-04345ce115a7 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:01.688690 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6865545-363a-49c5-806e-04345ce115a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:01.688963 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6865545-363a-49c5-806e-04345ce115a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:01.693183 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a77446a-65b9-45ad-babd-d27f2821f464 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:01.699799 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6865545-363a-49c5-806e-04345ce115a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:01.701261 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6865545-363a-49c5-806e-04345ce115a7 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:01.715870 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-b6865545-363a-49c5-806e-04345ce115a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:01.715870 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:01.715870 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:01.715870 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:01.715870 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:01.715870 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:01.715870 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:01.715870 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:01.715870 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:01.715870 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:01.715870 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:01.715870 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:01.715870 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:01.715870 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:01.715870 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:01.715870 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:01.716753 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:01.716753 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:01.716753 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:01.716753 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:01.716753 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:01.716753 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:01.716753 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:01.716753 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:01.716753 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:01.716753 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:01.716753 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:01.716753 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:01.716753 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:01.716753 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:01.716753 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:01.716753 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:01.716753 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:01.717598 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:01.717598 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:01.717598 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:01.717598 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 186/382] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:01.717811 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6865545-363a-49c5-806e-04345ce115a7 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:01.729906 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e7c487-741f-4425-8024-036c0ce80b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:01.730550 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e7c487-741f-4425-8024-036c0ce80b7d None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:01.730826 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e7c487-741f-4425-8024-036c0ce80b7d None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:01.731093 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e7c487-741f-4425-8024-036c0ce80b7d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:01.742258 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e7c487-741f-4425-8024-036c0ce80b7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:58:01.747553 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-a3e7c487-741f-4425-8024-036c0ce80b7d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 13 10:58:01.747553 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:01.747553 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:01.747553 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:01.747553 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:01.747553 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:01.747553 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:01.747553 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:01.747553 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:01.747553 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:01.747553 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:01.747553 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:01.747553 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:58:01.747553 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:58:01.747553 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:58:01.747553 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:58:01.748463 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:58:01.748463 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:58:01.748463 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:58:01.748463 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:58:01.748463 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:01.748463 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:01.748463 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:01.748463 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:01.748463 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:01.748463 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:01.748463 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:01.748463 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:01.748463 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:01.748463 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:01.748463 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:01.748463 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:01.749261 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:01.749261 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:01.749261 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:01.749261 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:01.749261 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:58:01.749261 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:58:01.749261 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:58:01.749261 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:58:01.749261 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:58:01.749261 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:58:01.749261 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 13 10:58:01.749261 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:01.749261 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 197/383] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Oct 13 10:58:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:01.750543 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e7c487-741f-4425-8024-036c0ce80b7d None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:01.817725 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6865545-363a-49c5-806e-04345ce115a7 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:01.845364 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e7c487-741f-4425-8024-036c0ce80b7d None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:01.849879 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c4538-d94d-42cb-bda5-6e3ce1821b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:01.850513 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c4538-d94d-42cb-bda5-6e3ce1821b62 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:01.850793 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c4538-d94d-42cb-bda5-6e3ce1821b62 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:01.851071 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c4538-d94d-42cb-bda5-6e3ce1821b62 None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:01.851717 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83c4538-d94d-42cb-bda5-6e3ce1821b62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:01.852027 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83c4538-d94d-42cb-bda5-6e3ce1821b62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:01.853395 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83c4538-d94d-42cb-bda5-6e3ce1821b62 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:01.865725 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 187/384] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:01.866917 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabbc07e-c233-4acb-b6fe-f64dccc62ccb None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:01.867198 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabbc07e-c233-4acb-b6fe-f64dccc62ccb None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:01.867470 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabbc07e-c233-4acb-b6fe-f64dccc62ccb None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:01.868648 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 188/385] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:58:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:01.869325 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabbc07e-c233-4acb-b6fe-f64dccc62ccb None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:01.883636 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17962c4-127b-4581-995f-ee5270d894c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:01.884237 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17962c4-127b-4581-995f-ee5270d894c0 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:01.884512 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17962c4-127b-4581-995f-ee5270d894c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:01.884784 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17962c4-127b-4581-995f-ee5270d894c0 None admin] PATH_INFO: `/v3/domains` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:01.885424 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17962c4-127b-4581-995f-ee5270d894c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:01.885726 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17962c4-127b-4581-995f-ee5270d894c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:01.887112 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17962c4-127b-4581-995f-ee5270d894c0 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:01.898835 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 198/386] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:01.899639 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17962c4-127b-4581-995f-ee5270d894c0 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:01.904209 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:01.908616 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:01.978077 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabbc07e-c233-4acb-b6fe-f64dccc62ccb None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:01.997266 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17962c4-127b-4581-995f-ee5270d894c0 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:02.011321 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9294481-7238-4ab7-bd43-a27577cf3c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:02.011985 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9294481-7238-4ab7-bd43-a27577cf3c13 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:02.012290 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9294481-7238-4ab7-bd43-a27577cf3c13 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:02.012566 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9294481-7238-4ab7-bd43-a27577cf3c13 None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:02.013200 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9294481-7238-4ab7-bd43-a27577cf3c13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:02.013508 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9294481-7238-4ab7-bd43-a27577cf3c13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:02.014924 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9294481-7238-4ab7-bd43-a27577cf3c13 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:02.026305 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 189/387] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:02.026917 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9294481-7238-4ab7-bd43-a27577cf3c13 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:02.033550 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb7a3a-66aa-4cfe-aad1-5c1e95b3c642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:02.034175 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb7a3a-66aa-4cfe-aad1-5c1e95b3c642 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:02.034456 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb7a3a-66aa-4cfe-aad1-5c1e95b3c642 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:02.034725 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb7a3a-66aa-4cfe-aad1-5c1e95b3c642 None admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:02.035459 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeb7a3a-66aa-4cfe-aad1-5c1e95b3c642 None admin] RBAC: Adding query filter params (name=service) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:02.035759 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeb7a3a-66aa-4cfe-aad1-5c1e95b3c642 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:02.037121 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeb7a3a-66aa-4cfe-aad1-5c1e95b3c642 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:02.044951 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 199/388] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Oct 13 10:58:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:02.046160 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b76ac7-3074-42ad-98d5-df1c9977c857 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:02.046394 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b76ac7-3074-42ad-98d5-df1c9977c857 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:02.046667 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b76ac7-3074-42ad-98d5-df1c9977c857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:02.064308 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-02b76ac7-3074-42ad-98d5-df1c9977c857 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:02.065497 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-02b76ac7-3074-42ad-98d5-df1c9977c857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:02.116119 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:02.122527 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:02.126435 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9294481-7238-4ab7-bd43-a27577cf3c13 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:02.131736 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 200/389] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:58:02.132529 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b76ac7-3074-42ad-98d5-df1c9977c857 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:02.162193 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae53208-3f65-4df0-8c57-786ca00ad331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:02.163041 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae53208-3f65-4df0-8c57-786ca00ad331 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:02.163326 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae53208-3f65-4df0-8c57-786ca00ad331 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:02.163597 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae53208-3f65-4df0-8c57-786ca00ad331 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:02.170944 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae53208-3f65-4df0-8c57-786ca00ad331 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:02.172383 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae53208-3f65-4df0-8c57-786ca00ad331 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:02.184067 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-8ae53208-3f65-4df0-8c57-786ca00ad331 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 13 10:58:02.184067 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:02.184067 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:02.184067 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:02.184067 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:02.184067 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:02.184067 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:02.184067 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:02.184067 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:02.184067 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:02.184067 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:02.184067 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:02.184067 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 10:58:02.184067 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 10:58:02.184067 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 10:58:02.184067 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 10:58:02.185098 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:02.185098 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:02.185098 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 10:58:02.185098 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:02.185098 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 10:58:02.185098 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:02.185098 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:02.185098 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:02.185098 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:02.185098 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:02.185098 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:02.185098 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:02.185098 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:02.185098 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:02.185098 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:02.185098 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:02.185098 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:02.185098 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:02.186121 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:02.186121 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:02.186121 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 10:58:02.186121 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 10:58:02.186121 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 10:58:02.186121 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 10:58:02.186121 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 10:58:02.186121 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 10:58:02.186121 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 13 10:58:02.186121 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:02.186121 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 190/390] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 10:58:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:02.190527 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae53208-3f65-4df0-8c57-786ca00ad331 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:02.236474 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b76ac7-3074-42ad-98d5-df1c9977c857 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:02.271882 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc414c27-2b2d-4b5f-b483-4177704f5f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:02.272500 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc414c27-2b2d-4b5f-b483-4177704f5f6c None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:02.272776 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc414c27-2b2d-4b5f-b483-4177704f5f6c None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:02.273045 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc414c27-2b2d-4b5f-b483-4177704f5f6c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:02.279608 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc414c27-2b2d-4b5f-b483-4177704f5f6c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:02.281017 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc414c27-2b2d-4b5f-b483-4177704f5f6c None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:02.292837 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae53208-3f65-4df0-8c57-786ca00ad331 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:02.293772 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-fc414c27-2b2d-4b5f-b483-4177704f5f6c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:58:02.293772 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:02.293772 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:02.293772 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:02.293772 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:02.293772 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:02.293772 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:02.293772 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:02.293772 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:02.293772 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:02.293772 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:02.293772 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:02.293772 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 10:58:02.293772 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 10:58:02.293772 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 10:58:02.294663 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 10:58:02.294663 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:02.294663 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:02.294663 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:02.294663 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:02.294663 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:02.294663 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:02.294663 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:02.294663 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:02.294663 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:02.294663 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:02.294663 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:02.294663 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:02.294663 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:02.294663 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:02.294663 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:02.294663 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:02.295503 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 10:58:02.295503 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 10:58:02.295503 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 10:58:02.295503 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 10:58:02.295503 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 10:58:02.295503 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 10:58:02.295503 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:58:02.295503 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:02.295503 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 201/391] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Oct 13 10:58:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:02.296472 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc414c27-2b2d-4b5f-b483-4177704f5f6c None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:02.331596 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e3c313-fc78-4a46-be4f-d01d126efa54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:02.332306 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3c313-fc78-4a46-be4f-d01d126efa54 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:02.332581 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3c313-fc78-4a46-be4f-d01d126efa54 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:02.332851 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3c313-fc78-4a46-be4f-d01d126efa54 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:02.340251 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e3c313-fc78-4a46-be4f-d01d126efa54 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:02.341678 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e3c313-fc78-4a46-be4f-d01d126efa54 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:02.353241 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-f9e3c313-fc78-4a46-be4f-d01d126efa54 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 13 10:58:02.353241 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:02.353241 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:02.353241 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:02.353241 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:02.353241 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:02.353241 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:02.353241 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:02.353241 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:02.353241 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:02.353241 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:02.353241 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:02.353241 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 10:58:02.353241 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 10:58:02.353241 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 10:58:02.353241 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 10:58:02.354141 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:02.354141 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:02.354141 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 10:58:02.354141 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:02.354141 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 10:58:02.354141 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:02.354141 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:02.354141 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:02.354141 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:02.354141 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:02.354141 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:02.354141 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:02.354141 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:02.354141 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:02.354141 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:02.354141 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:02.354141 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:02.354141 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:02.355029 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:02.355029 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:02.355029 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 10:58:02.355029 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 10:58:02.355029 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 10:58:02.355029 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 10:58:02.355029 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 10:58:02.355029 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 10:58:02.355029 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 13 10:58:02.355029 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:02.355029 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 191/392] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 10:58:02 2022] GET /identity/v3/users/glance => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:02.356141 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e3c313-fc78-4a46-be4f-d01d126efa54 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:02.356901 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:02.367902 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:02.405705 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc414c27-2b2d-4b5f-b483-4177704f5f6c None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:02.439237 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6560e9-a186-41ee-af20-64620db7097a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:02.439859 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6560e9-a186-41ee-af20-64620db7097a None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:02.440414 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6560e9-a186-41ee-af20-64620db7097a None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:02.440414 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6560e9-a186-41ee-af20-64620db7097a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:02.450588 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6560e9-a186-41ee-af20-64620db7097a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:02.452018 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6560e9-a186-41ee-af20-64620db7097a None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:02.454974 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e3c313-fc78-4a46-be4f-d01d126efa54 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:02.466198 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-ab6560e9-a186-41ee-af20-64620db7097a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:02.466198 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:02.466198 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:02.466198 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:02.466198 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:02.466198 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:02.466198 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:02.466198 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:02.466198 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:02.466198 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:02.466198 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:02.466198 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:02.466198 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:02.466198 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:02.466198 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:02.466198 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:02.467080 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:02.467080 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:02.467080 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:02.467080 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:02.467080 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:02.467080 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:02.467080 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:02.467080 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:02.467080 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:02.467080 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:02.467080 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:02.467080 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:02.467080 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:02.467080 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:02.467080 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:02.467080 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:02.467080 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:02.467907 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:02.467907 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:02.467907 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:02.467907 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 202/393] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:02.468115 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6560e9-a186-41ee-af20-64620db7097a None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:02.492476 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f5fd81-432d-4db3-98db-0393c1c63408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:02.493078 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5fd81-432d-4db3-98db-0393c1c63408 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:02.493353 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5fd81-432d-4db3-98db-0393c1c63408 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:02.493626 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5fd81-432d-4db3-98db-0393c1c63408 None admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:02.494370 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f5fd81-432d-4db3-98db-0393c1c63408 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:02.494700 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f5fd81-432d-4db3-98db-0393c1c63408 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:02.496151 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f5fd81-432d-4db3-98db-0393c1c63408 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:02.513323 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 192/394] 10.222.0.25 () {56 vars in 1137 bytes} [Thu Oct 13 10:58:02 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:02.514235 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f5fd81-432d-4db3-98db-0393c1c63408 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:02.569649 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6560e9-a186-41ee-af20-64620db7097a None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:02.577787 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:02.578212 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:02.602884 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65fb3d6-5bef-4e7a-aaa5-9b6b92296dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:02.603485 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65fb3d6-5bef-4e7a-aaa5-9b6b92296dc9 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:02.603764 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65fb3d6-5bef-4e7a-aaa5-9b6b92296dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:02.604045 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65fb3d6-5bef-4e7a-aaa5-9b6b92296dc9 None admin] PATH_INFO: `/v3/projects` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:02.604741 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65fb3d6-5bef-4e7a-aaa5-9b6b92296dc9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:02.605050 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65fb3d6-5bef-4e7a-aaa5-9b6b92296dc9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:02.606511 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65fb3d6-5bef-4e7a-aaa5-9b6b92296dc9 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:02.610181 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f5fd81-432d-4db3-98db-0393c1c63408 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:02.624381 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 203/395] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Oct 13 10:58:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:02.625118 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65fb3d6-5bef-4e7a-aaa5-9b6b92296dc9 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:02.643878 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98656909-52a4-4775-afbb-d7d2c6a68eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:02.644480 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98656909-52a4-4775-afbb-d7d2c6a68eb3 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:02.645263 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98656909-52a4-4775-afbb-d7d2c6a68eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:02.645536 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98656909-52a4-4775-afbb-d7d2c6a68eb3 None admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:02.646280 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98656909-52a4-4775-afbb-d7d2c6a68eb3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:02.646586 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98656909-52a4-4775-afbb-d7d2c6a68eb3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:02.648013 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98656909-52a4-4775-afbb-d7d2c6a68eb3 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:02.664560 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 193/396] 10.222.0.25 () {56 vars in 1137 bytes} [Thu Oct 13 10:58:02 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:02.665510 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98656909-52a4-4775-afbb-d7d2c6a68eb3 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:02.724082 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65fb3d6-5bef-4e7a-aaa5-9b6b92296dc9 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:02.756626 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cb69af-d33c-4ad4-a1bb-d8a85145e51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:02.757247 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb69af-d33c-4ad4-a1bb-d8a85145e51b None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:02.757525 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb69af-d33c-4ad4-a1bb-d8a85145e51b None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:02.757797 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb69af-d33c-4ad4-a1bb-d8a85145e51b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:02.759567 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98656909-52a4-4775-afbb-d7d2c6a68eb3 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:02.767402 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cb69af-d33c-4ad4-a1bb-d8a85145e51b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:02.768829 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cb69af-d33c-4ad4-a1bb-d8a85145e51b None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:02.783302 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-58cb69af-d33c-4ad4-a1bb-d8a85145e51b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:02.783302 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:02.783302 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:02.783302 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:02.783302 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:02.783302 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:02.783302 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:02.783302 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:02.783302 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:02.783302 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:02.783302 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:02.783302 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:02.783302 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:02.783302 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:02.783302 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:02.783302 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:02.784204 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:02.784204 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:02.784204 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:02.784204 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:02.784204 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:02.784204 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:02.784204 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:02.784204 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:02.784204 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:02.784204 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:02.784204 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:02.784204 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:02.784204 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:02.784204 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:02.784204 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:02.784204 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:02.784204 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:02.785050 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:02.785050 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:02.785050 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:02.785050 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 204/397] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:02.785831 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cb69af-d33c-4ad4-a1bb-d8a85145e51b None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:02.790842 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:02.800061 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babfc927-7660-4217-8244-41f9dde39e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:02.800665 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babfc927-7660-4217-8244-41f9dde39e5c None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:02.800939 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babfc927-7660-4217-8244-41f9dde39e5c None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:02.801214 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babfc927-7660-4217-8244-41f9dde39e5c None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:02.801845 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babfc927-7660-4217-8244-41f9dde39e5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:02.802183 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babfc927-7660-4217-8244-41f9dde39e5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:02.803602 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babfc927-7660-4217-8244-41f9dde39e5c None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:02.807112 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:02.814808 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 194/398] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:02.815724 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babfc927-7660-4217-8244-41f9dde39e5c None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:02.887526 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cb69af-d33c-4ad4-a1bb-d8a85145e51b None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:02.914309 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babfc927-7660-4217-8244-41f9dde39e5c None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:02.921018 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ab8ce1-8249-4d8d-8fe1-1f9192c793c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:02.921717 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ab8ce1-8249-4d8d-8fe1-1f9192c793c4 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:02.922023 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ab8ce1-8249-4d8d-8fe1-1f9192c793c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:02.922292 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ab8ce1-8249-4d8d-8fe1-1f9192c793c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:02.932648 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ab8ce1-8249-4d8d-8fe1-1f9192c793c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:02.934119 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ab8ce1-8249-4d8d-8fe1-1f9192c793c4 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:02.947646 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62f1aca-f478-45de-8be9-2dfe2b1ac18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:02.948291 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62f1aca-f478-45de-8be9-2dfe2b1ac18d None admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:02.948473 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-80ab8ce1-8249-4d8d-8fe1-1f9192c793c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:02.948473 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:02.948473 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:02.948473 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:02.948473 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:02.948473 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:02.948473 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:02.948473 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:02.948473 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:02.948473 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:02.948473 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:02.948473 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:02.948473 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:02.948473 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:02.948473 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:02.948473 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:02.949438 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:02.949438 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:02.949438 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:02.949438 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:02.949438 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:02.949438 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:02.949438 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:02.949438 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:02.949438 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:02.949438 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:02.949438 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:02.949438 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:02.949438 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:02.949438 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:02.949438 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:02.949438 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:02.949438 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:02.950317 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:02.950317 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:02.950317 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:02.950488 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62f1aca-f478-45de-8be9-2dfe2b1ac18d None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:02.950488 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62f1aca-f478-45de-8be9-2dfe2b1ac18d None admin] PATH_INFO: `/v3/projects/85bfac5f03e24fb3870a59a6b52dba6e/users/78384fbffdd346578855e7214b335d8e/roles/409a58470d23473abb676acf7c1095ae` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:02.950605 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 205/399] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:02.950605 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ab8ce1-8249-4d8d-8fe1-1f9192c793c4 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:02.967820 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62f1aca-f478-45de-8be9-2dfe2b1ac18d None admin] RBAC: Authorizing `identity:create_grant(project_id=85bfac5f03e24fb3870a59a6b52dba6e, user_id=78384fbffdd346578855e7214b335d8e, role_id=409a58470d23473abb676acf7c1095ae)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:02.969236 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62f1aca-f478-45de-8be9-2dfe2b1ac18d None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:02.981426 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 195/400] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Oct 13 10:58:02 2022] PUT /identity/v3/projects/85bfac5f03e24fb3870a59a6b52dba6e/users/78384fbffdd346578855e7214b335d8e/roles/409a58470d23473abb676acf7c1095ae => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 10:58:02.982239 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62f1aca-f478-45de-8be9-2dfe2b1ac18d None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:03.030727 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:03.036089 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:03.069966 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ab8ce1-8249-4d8d-8fe1-1f9192c793c4 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:03.106944 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8f3c1c-dc70-4fd4-974c-dbe845ec6f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:03.107631 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f3c1c-dc70-4fd4-974c-dbe845ec6f0e None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:03.107816 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62f1aca-f478-45de-8be9-2dfe2b1ac18d None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:03.107920 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f3c1c-dc70-4fd4-974c-dbe845ec6f0e None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:03.108165 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f3c1c-dc70-4fd4-974c-dbe845ec6f0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:03.120786 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8f3c1c-dc70-4fd4-974c-dbe845ec6f0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:03.122291 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8f3c1c-dc70-4fd4-974c-dbe845ec6f0e None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:03.138458 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-0f8f3c1c-dc70-4fd4-974c-dbe845ec6f0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:03.138458 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:03.138458 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:03.138458 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:03.138458 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:03.138458 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:03.138458 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:03.138458 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:03.138458 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:03.138458 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:03.138458 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:03.138458 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:03.138458 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:03.138458 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:03.138458 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:03.138458 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:03.139390 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:03.139390 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:03.139390 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:03.139390 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:03.139390 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:03.139390 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:03.139390 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:03.139390 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:03.139390 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:03.139390 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:03.139390 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:03.139390 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:03.139390 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:03.139390 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:03.139390 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:03.139390 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:03.139390 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:03.140219 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:03.140219 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:03.140219 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:03.140219 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 206/401] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:03.140429 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8f3c1c-dc70-4fd4-974c-dbe845ec6f0e None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:03.151165 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a7eba6-30a2-472a-952e-d894de3c734d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:03.151786 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a7eba6-30a2-472a-952e-d894de3c734d None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:03.152066 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a7eba6-30a2-472a-952e-d894de3c734d None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:03.152341 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a7eba6-30a2-472a-952e-d894de3c734d None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:03.152987 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a7eba6-30a2-472a-952e-d894de3c734d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:03.153294 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a7eba6-30a2-472a-952e-d894de3c734d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:03.154695 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a7eba6-30a2-472a-952e-d894de3c734d None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:03.167488 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 196/402] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:03.168691 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a7eba6-30a2-472a-952e-d894de3c734d None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:03.257150 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8f3c1c-dc70-4fd4-974c-dbe845ec6f0e None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:03.269041 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:03.276033 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a7eba6-30a2-472a-952e-d894de3c734d None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:03.286676 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:03.298842 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3aa512-3bd3-4408-8864-2ff0b47a83fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:03.299470 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3aa512-3bd3-4408-8864-2ff0b47a83fd None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:03.299811 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3aa512-3bd3-4408-8864-2ff0b47a83fd None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:03.300086 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3aa512-3bd3-4408-8864-2ff0b47a83fd None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:03.308228 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3aa512-3bd3-4408-8864-2ff0b47a83fd None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:03.309714 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3aa512-3bd3-4408-8864-2ff0b47a83fd None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:03.313081 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92cec69-738e-443e-8b09-ed8368ac57cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:03.313850 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92cec69-738e-443e-8b09-ed8368ac57cd None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:03.314328 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92cec69-738e-443e-8b09-ed8368ac57cd None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:03.314749 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92cec69-738e-443e-8b09-ed8368ac57cd None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:03.315526 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92cec69-738e-443e-8b09-ed8368ac57cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:03.315977 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92cec69-738e-443e-8b09-ed8368ac57cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:03.317467 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92cec69-738e-443e-8b09-ed8368ac57cd None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:03.322289 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-ab3aa512-3bd3-4408-8864-2ff0b47a83fd None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 13 10:58:03.322289 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:03.322289 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:03.322289 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:03.322289 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:03.322289 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:03.322289 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:03.322289 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:03.322289 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:03.322289 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:03.322289 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:03.322289 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:03.322289 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 10:58:03.322289 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 10:58:03.322289 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 10:58:03.322289 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 10:58:03.323358 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:03.323358 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:03.323358 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 10:58:03.323358 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:03.323358 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 10:58:03.323358 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:03.323358 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:03.323358 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:03.323358 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:03.323358 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:03.323358 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:03.323358 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:03.323358 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:03.323358 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:03.323358 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:03.323358 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:03.323358 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:03.323358 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:03.328952 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:03.328952 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:03.328952 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 10:58:03.328952 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 10:58:03.328952 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 10:58:03.328952 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 10:58:03.328952 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 10:58:03.328952 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 10:58:03.328952 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 13 10:58:03.328952 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:03.328952 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 207/403] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Oct 13 10:58:03 2022] GET /identity/v3/users/neutron => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:03.328952 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3aa512-3bd3-4408-8864-2ff0b47a83fd None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:03.338400 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 197/404] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:03.339544 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92cec69-738e-443e-8b09-ed8368ac57cd None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:03.434531 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3aa512-3bd3-4408-8864-2ff0b47a83fd None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:03.444006 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92cec69-738e-443e-8b09-ed8368ac57cd None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:03.471006 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd247b73-4f59-4a9b-bfe0-81954b923873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:03.471619 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd247b73-4f59-4a9b-bfe0-81954b923873 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:03.471899 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd247b73-4f59-4a9b-bfe0-81954b923873 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:03.472262 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd247b73-4f59-4a9b-bfe0-81954b923873 None admin] PATH_INFO: `/v3/domains` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:03.473395 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd247b73-4f59-4a9b-bfe0-81954b923873 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:03.473703 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd247b73-4f59-4a9b-bfe0-81954b923873 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:03.475163 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd247b73-4f59-4a9b-bfe0-81954b923873 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:03.483411 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a27ff9d-50f1-48cb-b01b-6d1653b11f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:03.484468 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a27ff9d-50f1-48cb-b01b-6d1653b11f3b None admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:03.484755 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a27ff9d-50f1-48cb-b01b-6d1653b11f3b None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:03.485028 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a27ff9d-50f1-48cb-b01b-6d1653b11f3b None admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:03.485678 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a27ff9d-50f1-48cb-b01b-6d1653b11f3b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:03.492089 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 208/405] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:03.492220 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a27ff9d-50f1-48cb-b01b-6d1653b11f3b None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:03.492296 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd247b73-4f59-4a9b-bfe0-81954b923873 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:03.510885 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 198/406] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Oct 13 10:58:03 2022] POST /identity/v3/users => generated 247 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 10:58:03.523901 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a27ff9d-50f1-48cb-b01b-6d1653b11f3b None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:03.544531 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:03.548355 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:03.611436 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd247b73-4f59-4a9b-bfe0-81954b923873 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:03.654902 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f777b-a9f9-4c0d-81c0-4106ac3ef113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:03.655986 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f777b-a9f9-4c0d-81c0-4106ac3ef113 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:03.656594 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f777b-a9f9-4c0d-81c0-4106ac3ef113 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:03.657105 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f777b-a9f9-4c0d-81c0-4106ac3ef113 None admin] PATH_INFO: `/v3/users` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:03.658226 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441f777b-a9f9-4c0d-81c0-4106ac3ef113 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:03.658753 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441f777b-a9f9-4c0d-81c0-4106ac3ef113 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:03.660806 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441f777b-a9f9-4c0d-81c0-4106ac3ef113 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:03.669916 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a27ff9d-50f1-48cb-b01b-6d1653b11f3b None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:03.703319 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 209/407] 10.222.0.25 () {56 vars in 1139 bytes} [Thu Oct 13 10:58:03 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:03.704474 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f777b-a9f9-4c0d-81c0-4106ac3ef113 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:03.714011 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbf915f-0ef9-4359-a03d-9a52662d7b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:03.714660 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf915f-0ef9-4359-a03d-9a52662d7b20 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:03.714940 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf915f-0ef9-4359-a03d-9a52662d7b20 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:03.715218 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf915f-0ef9-4359-a03d-9a52662d7b20 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:03.724142 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbf915f-0ef9-4359-a03d-9a52662d7b20 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:03.725780 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbf915f-0ef9-4359-a03d-9a52662d7b20 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:03.740869 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-dcbf915f-0ef9-4359-a03d-9a52662d7b20 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:58:03.740869 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:03.740869 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:03.740869 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:03.740869 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:03.740869 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:03.740869 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:03.740869 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:03.740869 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:03.740869 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:03.740869 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:03.740869 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:03.740869 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 10:58:03.740869 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 10:58:03.740869 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 10:58:03.741739 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 10:58:03.741739 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:03.741739 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:03.741739 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:03.741739 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:03.741739 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:03.741739 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:03.741739 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:03.741739 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:03.741739 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:03.741739 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:03.741739 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:03.741739 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:03.741739 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:03.741739 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:03.741739 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:03.741739 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:03.742616 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 10:58:03.742616 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 10:58:03.742616 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 10:58:03.742616 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 10:58:03.742616 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 10:58:03.742616 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 10:58:03.742616 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:58:03.742616 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:03.742616 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 199/408] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Oct 13 10:58:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:03.742616 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbf915f-0ef9-4359-a03d-9a52662d7b20 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:03.833852 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f777b-a9f9-4c0d-81c0-4106ac3ef113 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:03.836046 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:03.839372 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:03.874696 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbf915f-0ef9-4359-a03d-9a52662d7b20 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:03.886889 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a1bcbe-31b0-483c-85de-55ee2ecf551e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:03.887847 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1bcbe-31b0-483c-85de-55ee2ecf551e None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:03.888381 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1bcbe-31b0-483c-85de-55ee2ecf551e None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:03.888667 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1bcbe-31b0-483c-85de-55ee2ecf551e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:03.897411 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a1bcbe-31b0-483c-85de-55ee2ecf551e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:03.899718 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a1bcbe-31b0-483c-85de-55ee2ecf551e None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:03.912755 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb626a0-a667-420f-b1c2-59265d955562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:03.913661 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb626a0-a667-420f-b1c2-59265d955562 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:03.914170 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb626a0-a667-420f-b1c2-59265d955562 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:03.914379 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-94a1bcbe-31b0-483c-85de-55ee2ecf551e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:58:03.914379 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:03.914379 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:03.914379 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:03.914379 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:03.914379 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:03.914379 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:03.914379 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:03.914379 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:03.914379 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:03.914379 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:03.914379 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:03.914379 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 10:58:03.914379 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 10:58:03.914379 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 10:58:03.915268 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 10:58:03.915268 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:03.915268 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:03.915268 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:03.915268 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:03.915268 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:03.915268 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:03.915268 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:03.915268 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:03.915268 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:03.915268 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:03.915268 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:03.915268 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:03.915268 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:03.915268 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:03.915268 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:03.915268 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:03.916107 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 10:58:03.916107 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 10:58:03.916107 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 10:58:03.916107 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 10:58:03.916107 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 10:58:03.916107 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 10:58:03.916107 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:58:03.916107 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:03.916107 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 210/409] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Oct 13 10:58:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:03.917050 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a1bcbe-31b0-483c-85de-55ee2ecf551e None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:03.917539 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb626a0-a667-420f-b1c2-59265d955562 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:03.931255 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb626a0-a667-420f-b1c2-59265d955562 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:03.933027 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb626a0-a667-420f-b1c2-59265d955562 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:03.948452 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-bfb626a0-a667-420f-b1c2-59265d955562 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:03.948452 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:03.948452 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:03.948452 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:03.948452 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:03.948452 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:03.948452 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:03.948452 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:03.948452 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:03.948452 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:03.948452 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:03.948452 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:03.948452 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:03.948452 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:03.948452 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:03.948452 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:03.949353 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:03.949353 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:03.949353 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:03.949353 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:03.949353 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:03.949353 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:03.949353 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:03.949353 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:03.949353 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:03.949353 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:03.949353 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:03.949353 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:03.949353 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:03.949353 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:03.949353 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:03.949353 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:03.949353 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:03.950204 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:03.950204 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:03.950204 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:03.956810 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 200/410] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:03.958484 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb626a0-a667-420f-b1c2-59265d955562 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:04.041123 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a1bcbe-31b0-483c-85de-55ee2ecf551e None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:04.063987 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb626a0-a667-420f-b1c2-59265d955562 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:04.087238 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d20de50-0b3e-47e3-ba58-e1c47bbc216c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:04.088017 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20de50-0b3e-47e3-ba58-e1c47bbc216c None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:04.088300 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20de50-0b3e-47e3-ba58-e1c47bbc216c None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:04.088575 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20de50-0b3e-47e3-ba58-e1c47bbc216c None admin] PATH_INFO: `/v3/projects` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:04.089249 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:04.089373 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d20de50-0b3e-47e3-ba58-e1c47bbc216c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:04.089566 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d20de50-0b3e-47e3-ba58-e1c47bbc216c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:04.092118 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d20de50-0b3e-47e3-ba58-e1c47bbc216c None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:04.108206 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 211/411] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Oct 13 10:58:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:04.109422 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d20de50-0b3e-47e3-ba58-e1c47bbc216c None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:04.114176 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b87967-27fa-4af3-aef4-3a34005a641b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:04.115015 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b87967-27fa-4af3-aef4-3a34005a641b None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:04.115490 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b87967-27fa-4af3-aef4-3a34005a641b None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:04.115956 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b87967-27fa-4af3-aef4-3a34005a641b None admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:04.116880 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b87967-27fa-4af3-aef4-3a34005a641b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:04.117392 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b87967-27fa-4af3-aef4-3a34005a641b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:04.119059 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b87967-27fa-4af3-aef4-3a34005a641b None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:04.137451 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 201/412] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Oct 13 10:58:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:04.138590 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b87967-27fa-4af3-aef4-3a34005a641b None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:04.141058 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:04.230338 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d20de50-0b3e-47e3-ba58-e1c47bbc216c None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:04.258240 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b87967-27fa-4af3-aef4-3a34005a641b None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:04.266352 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3f0034-f1ba-419a-978c-570559b5c86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:04.267274 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f0034-f1ba-419a-978c-570559b5c86a None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:04.267803 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f0034-f1ba-419a-978c-570559b5c86a None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:04.268291 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f0034-f1ba-419a-978c-570559b5c86a None admin] PATH_INFO: `/v3/domains` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:04.269186 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3f0034-f1ba-419a-978c-570559b5c86a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:04.270326 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3f0034-f1ba-419a-978c-570559b5c86a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:04.272039 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3f0034-f1ba-419a-978c-570559b5c86a None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:04.289511 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 212/413] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:04.290847 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3f0034-f1ba-419a-978c-570559b5c86a None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:04.298122 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87f1ec5-fb1f-41c5-a4e1-1e80967168b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:04.298795 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f1ec5-fb1f-41c5-a4e1-1e80967168b6 None admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:04.299076 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f1ec5-fb1f-41c5-a4e1-1e80967168b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:04.299353 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f1ec5-fb1f-41c5-a4e1-1e80967168b6 None admin] PATH_INFO: `/v3/projects/85bfac5f03e24fb3870a59a6b52dba6e/users/35f4c2fc51f54f0e977648b13efaed1a/roles/409a58470d23473abb676acf7c1095ae` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:04.318446 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87f1ec5-fb1f-41c5-a4e1-1e80967168b6 None admin] RBAC: Authorizing `identity:create_grant(project_id=85bfac5f03e24fb3870a59a6b52dba6e, user_id=35f4c2fc51f54f0e977648b13efaed1a, role_id=409a58470d23473abb676acf7c1095ae)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:04.320456 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87f1ec5-fb1f-41c5-a4e1-1e80967168b6 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:04.342079 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 202/414] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Oct 13 10:58:04 2022] PUT /identity/v3/projects/85bfac5f03e24fb3870a59a6b52dba6e/users/35f4c2fc51f54f0e977648b13efaed1a/roles/409a58470d23473abb676acf7c1095ae => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 10:58:04.344424 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87f1ec5-fb1f-41c5-a4e1-1e80967168b6 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:04.423811 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:04.443173 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:04.483554 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3f0034-f1ba-419a-978c-570559b5c86a None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:04.539477 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b10d94-c7af-4094-8477-e6d61ad40896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:04.540197 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b10d94-c7af-4094-8477-e6d61ad40896 None admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:04.540482 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b10d94-c7af-4094-8477-e6d61ad40896 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:04.540756 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b10d94-c7af-4094-8477-e6d61ad40896 None admin] PATH_INFO: `/v3/projects/85bfac5f03e24fb3870a59a6b52dba6e/users/399f7d3700a24cb486e56b409a6e5429/roles/409a58470d23473abb676acf7c1095ae` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:04.565742 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b10d94-c7af-4094-8477-e6d61ad40896 None admin] RBAC: Authorizing `identity:create_grant(project_id=85bfac5f03e24fb3870a59a6b52dba6e, user_id=399f7d3700a24cb486e56b409a6e5429, role_id=409a58470d23473abb676acf7c1095ae)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:04.569171 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b10d94-c7af-4094-8477-e6d61ad40896 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:04.573916 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87f1ec5-fb1f-41c5-a4e1-1e80967168b6 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:04.587757 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 213/415] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Oct 13 10:58:04 2022] PUT /identity/v3/projects/85bfac5f03e24fb3870a59a6b52dba6e/users/399f7d3700a24cb486e56b409a6e5429/roles/409a58470d23473abb676acf7c1095ae => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 10:58:04.623037 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ace217-b640-4258-9301-fe2331f95f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:04.623743 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ace217-b640-4258-9301-fe2331f95f78 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:04.624024 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ace217-b640-4258-9301-fe2331f95f78 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:04.624299 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ace217-b640-4258-9301-fe2331f95f78 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:04.633196 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ace217-b640-4258-9301-fe2331f95f78 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:04.634878 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ace217-b640-4258-9301-fe2331f95f78 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:04.647725 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-c6ace217-b640-4258-9301-fe2331f95f78 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:58:04.647725 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:04.647725 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:04.647725 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:04.647725 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:04.647725 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:04.647725 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:04.647725 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:04.647725 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:04.647725 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:04.647725 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:04.647725 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:04.647725 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 10:58:04.647725 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 10:58:04.647725 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 10:58:04.648607 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 10:58:04.648607 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:04.648607 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:04.648607 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:04.648607 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:04.648607 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:04.648607 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:04.648607 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:04.648607 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:04.648607 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:04.648607 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:04.648607 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:04.648607 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:04.648607 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:04.648607 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:04.648607 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:04.648607 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:04.649446 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 10:58:04.649446 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 10:58:04.649446 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 10:58:04.649446 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 10:58:04.649446 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 10:58:04.649446 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 10:58:04.649446 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:58:04.649446 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:04.649446 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 203/416] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Oct 13 10:58:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:04.654824 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b10d94-c7af-4094-8477-e6d61ad40896 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:04.777103 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b10d94-c7af-4094-8477-e6d61ad40896 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:04.820857 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:04.826350 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b63930b-0889-4433-9dd5-0ea952ca58e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:04.827479 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63930b-0889-4433-9dd5-0ea952ca58e0 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:04.828462 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63930b-0889-4433-9dd5-0ea952ca58e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:04.829016 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63930b-0889-4433-9dd5-0ea952ca58e0 None admin] PATH_INFO: `/v3/projects` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:04.830371 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b63930b-0889-4433-9dd5-0ea952ca58e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:04.831005 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b63930b-0889-4433-9dd5-0ea952ca58e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:04.833198 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b63930b-0889-4433-9dd5-0ea952ca58e0 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:04.848625 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 214/417] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Oct 13 10:58:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:04.854425 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ace217-b640-4258-9301-fe2331f95f78 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:04.955510 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:04.962999 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ace217-b640-4258-9301-fe2331f95f78 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:05.003547 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4ffb3f-28be-4d63-9942-ed540db16b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:05.004760 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ffb3f-28be-4d63-9942-ed540db16b22 None admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:05.005040 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ffb3f-28be-4d63-9942-ed540db16b22 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:05.005322 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ffb3f-28be-4d63-9942-ed540db16b22 None admin] PATH_INFO: `/v3/projects/85bfac5f03e24fb3870a59a6b52dba6e/users/085e8bffed444287bc5f805461c3fb55/roles/409a58470d23473abb676acf7c1095ae` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:05.025052 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4ffb3f-28be-4d63-9942-ed540db16b22 None admin] RBAC: Authorizing `identity:create_grant(project_id=85bfac5f03e24fb3870a59a6b52dba6e, user_id=085e8bffed444287bc5f805461c3fb55, role_id=409a58470d23473abb676acf7c1095ae)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:05.026549 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4ffb3f-28be-4d63-9942-ed540db16b22 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:05.044938 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 204/418] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Oct 13 10:58:04 2022] PUT /identity/v3/projects/85bfac5f03e24fb3870a59a6b52dba6e/users/085e8bffed444287bc5f805461c3fb55/roles/409a58470d23473abb676acf7c1095ae => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 10:58:05.326581 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f47187-f462-4df9-8a1f-2c27173722de None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:05.326765 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f47187-f462-4df9-8a1f-2c27173722de None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:05.327051 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f47187-f462-4df9-8a1f-2c27173722de None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:05.328636 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 215/419] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:58:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:05.334734 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76bd34e-94f8-4b33-9413-476199030c30 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:05.335023 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76bd34e-94f8-4b33-9413-476199030c30 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:05.335302 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76bd34e-94f8-4b33-9413-476199030c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:05.354385 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-e76bd34e-94f8-4b33-9413-476199030c30 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:05.355588 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-e76bd34e-94f8-4b33-9413-476199030c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:05.426410 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 205/420] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 13 10:58:05.696586 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f47187-f462-4df9-8a1f-2c27173722de None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:05.835391 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f47187-f462-4df9-8a1f-2c27173722de None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:05.874139 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e10994-8afd-4576-8b55-535cdadd9bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:05.874833 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e10994-8afd-4576-8b55-535cdadd9bf9 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:05.875111 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e10994-8afd-4576-8b55-535cdadd9bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:05.875421 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e10994-8afd-4576-8b55-535cdadd9bf9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:05.894682 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e10994-8afd-4576-8b55-535cdadd9bf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:58:05.899698 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-67e10994-8afd-4576-8b55-535cdadd9bf9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 13 10:58:05.899698 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:05.899698 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:05.899698 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:05.899698 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:05.899698 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:05.899698 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:05.899698 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:05.899698 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:05.899698 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:05.899698 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:05.899698 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:05.899698 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:58:05.899698 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:58:05.899698 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:58:05.899698 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:58:05.900596 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:58:05.900596 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:58:05.900596 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:58:05.900596 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:58:05.900596 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:05.900596 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:05.900596 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:05.900596 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:05.900596 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:05.900596 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:05.900596 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:05.900596 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:05.900596 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:05.900596 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:05.900596 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:05.900596 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:05.901823 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:05.901823 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:05.901823 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:05.901823 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:05.901823 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:58:05.901823 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:58:05.901823 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:58:05.901823 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:58:05.901823 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:58:05.901823 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:58:05.901823 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 13 10:58:05.901823 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:05.901823 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 216/421] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Oct 13 10:58:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:05.907179 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76bd34e-94f8-4b33-9413-476199030c30 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:05.971300 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fac336-5545-4a81-9532-5afcb36ebd8c None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:05.971480 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fac336-5545-4a81-9532-5afcb36ebd8c None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:05.971764 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fac336-5545-4a81-9532-5afcb36ebd8c None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:05.973665 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 217/422] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:58:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 10:58:05.984560 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182609df-b31f-486f-96b9-f68223882fee None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:05.984849 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182609df-b31f-486f-96b9-f68223882fee None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:05.985129 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182609df-b31f-486f-96b9-f68223882fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:06.017633 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:06.021996 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-182609df-b31f-486f-96b9-f68223882fee None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:06.021996 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-182609df-b31f-486f-96b9-f68223882fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:06.067182 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76bd34e-94f8-4b33-9413-476199030c30 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:06.102311 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:06.127220 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 218/423] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 13 10:58:06.139536 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5db2159-1d56-401a-be1c-8a153a71dea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:06.140153 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db2159-1d56-401a-be1c-8a153a71dea7 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:06.140429 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db2159-1d56-401a-be1c-8a153a71dea7 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:06.140698 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db2159-1d56-401a-be1c-8a153a71dea7 None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:06.141362 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5db2159-1d56-401a-be1c-8a153a71dea7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:06.141664 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5db2159-1d56-401a-be1c-8a153a71dea7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:06.143057 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5db2159-1d56-401a-be1c-8a153a71dea7 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:06.160827 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 206/424] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Oct 13 10:58:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:06.166366 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182609df-b31f-486f-96b9-f68223882fee None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:06.311029 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182609df-b31f-486f-96b9-f68223882fee None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:06.363021 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d858cb8-0082-4f3e-88ee-b093fb7abbba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:06.364179 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d858cb8-0082-4f3e-88ee-b093fb7abbba None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:06.364460 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d858cb8-0082-4f3e-88ee-b093fb7abbba None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:06.364732 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d858cb8-0082-4f3e-88ee-b093fb7abbba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:06.382953 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d858cb8-0082-4f3e-88ee-b093fb7abbba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:06.384428 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d858cb8-0082-4f3e-88ee-b093fb7abbba None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:06.402571 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-8d858cb8-0082-4f3e-88ee-b093fb7abbba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:06.402571 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:06.402571 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:06.402571 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:06.402571 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:06.402571 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:06.402571 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:06.402571 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:06.402571 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:06.402571 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:06.402571 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:06.402571 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:06.402571 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:06.402571 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:06.402571 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:06.402571 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:06.403489 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:06.403489 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:06.403489 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:06.403489 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:06.403489 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:06.403489 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:06.403489 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:06.403489 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:06.403489 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:06.403489 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:06.403489 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:06.403489 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:06.403489 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:06.403489 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:06.403489 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:06.403489 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:06.403489 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:06.404309 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:06.404309 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:06.404309 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:06.404309 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 219/425] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:06.410252 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5db2159-1d56-401a-be1c-8a153a71dea7 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:06.410382 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d858cb8-0082-4f3e-88ee-b093fb7abbba None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:06.471324 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:06.590985 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5db2159-1d56-401a-be1c-8a153a71dea7 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:06.597436 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d858cb8-0082-4f3e-88ee-b093fb7abbba None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:06.642195 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7825ae7a-a3f1-4269-a1cf-ca32c65c00a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:06.642829 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7825ae7a-a3f1-4269-a1cf-ca32c65c00a1 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:06.643110 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7825ae7a-a3f1-4269-a1cf-ca32c65c00a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:06.643452 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7825ae7a-a3f1-4269-a1cf-ca32c65c00a1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:06.646158 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:06.655429 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7825ae7a-a3f1-4269-a1cf-ca32c65c00a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:58:06.661346 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-7825ae7a-a3f1-4269-a1cf-ca32c65c00a1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 13 10:58:06.661346 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:06.661346 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:06.661346 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:06.661346 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:06.661346 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:06.661346 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:06.661346 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:06.661346 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:06.661346 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:06.661346 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:06.661346 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:06.661346 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:58:06.661346 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:58:06.661346 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:58:06.661346 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:58:06.662249 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:58:06.662249 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:58:06.662249 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:58:06.662249 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:58:06.662249 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:06.662249 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:06.662249 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:06.662249 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:06.662249 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:06.662249 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:06.662249 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:06.662249 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:06.662249 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:06.662249 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:06.662249 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:06.662249 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:06.663028 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:06.663028 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:06.663028 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:06.663028 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:06.663028 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:58:06.663028 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:58:06.663028 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:58:06.663028 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:58:06.663028 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:58:06.663028 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:58:06.663028 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 13 10:58:06.663028 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:06.663028 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 207/426] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Oct 13 10:58:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:06.668888 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7825ae7a-a3f1-4269-a1cf-ca32c65c00a1 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:06.683536 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08616b9a-046b-49ec-8dd7-d3ad765bf03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:06.684432 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08616b9a-046b-49ec-8dd7-d3ad765bf03f None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:06.684908 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08616b9a-046b-49ec-8dd7-d3ad765bf03f None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:06.685415 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08616b9a-046b-49ec-8dd7-d3ad765bf03f None admin] PATH_INFO: `/v3/domains` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:06.686291 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08616b9a-046b-49ec-8dd7-d3ad765bf03f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:06.686791 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08616b9a-046b-49ec-8dd7-d3ad765bf03f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:06.688329 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08616b9a-046b-49ec-8dd7-d3ad765bf03f None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:06.714559 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 220/427] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:58:06.716661 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08616b9a-046b-49ec-8dd7-d3ad765bf03f None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:06.813143 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7825ae7a-a3f1-4269-a1cf-ca32c65c00a1 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:06.852514 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85e2bbf-39ce-45db-be61-a745c5ae9ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:06.854068 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e2bbf-39ce-45db-be61-a745c5ae9ebf None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:06.854739 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e2bbf-39ce-45db-be61-a745c5ae9ebf None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:06.856224 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e2bbf-39ce-45db-be61-a745c5ae9ebf None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:06.857095 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85e2bbf-39ce-45db-be61-a745c5ae9ebf None admin] RBAC: Adding query filter params (name=service) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:06.858268 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85e2bbf-39ce-45db-be61-a745c5ae9ebf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:06.862117 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85e2bbf-39ce-45db-be61-a745c5ae9ebf None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:06.878658 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 208/428] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Oct 13 10:58:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:06.886950 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85e2bbf-39ce-45db-be61-a745c5ae9ebf None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:06.909424 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:06.918711 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08616b9a-046b-49ec-8dd7-d3ad765bf03f None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:06.960241 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c1a2e9-f8ec-491f-8189-5cf85f48f568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:06.961230 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1a2e9-f8ec-491f-8189-5cf85f48f568 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:06.962381 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1a2e9-f8ec-491f-8189-5cf85f48f568 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:06.962888 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1a2e9-f8ec-491f-8189-5cf85f48f568 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:06.975721 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c1a2e9-f8ec-491f-8189-5cf85f48f568 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:06.981485 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c1a2e9-f8ec-491f-8189-5cf85f48f568 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:07.002759 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-a6c1a2e9-f8ec-491f-8189-5cf85f48f568 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 13 10:58:07.002759 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:07.002759 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:07.002759 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:07.002759 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:07.002759 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:07.002759 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:07.002759 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:07.002759 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:07.002759 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:07.002759 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:07.002759 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:07.002759 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 10:58:07.002759 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 10:58:07.002759 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 10:58:07.002759 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 10:58:07.003714 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:07.003714 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:07.003714 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 10:58:07.003714 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:07.003714 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 10:58:07.003714 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:07.003714 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:07.003714 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:07.003714 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:07.003714 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:07.003714 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:07.003714 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:07.003714 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:07.003714 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:07.003714 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:07.003714 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:07.003714 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:07.003714 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:07.004722 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:07.004722 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:07.004722 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 10:58:07.004722 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 10:58:07.004722 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 10:58:07.004722 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 10:58:07.004722 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 10:58:07.004722 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 10:58:07.004722 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 13 10:58:07.004722 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:07.012124 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 221/429] 10.222.0.25 () {56 vars in 1093 bytes} [Thu Oct 13 10:58:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 10:58:07.019307 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:07.021603 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c1a2e9-f8ec-491f-8189-5cf85f48f568 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:07.075266 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85e2bbf-39ce-45db-be61-a745c5ae9ebf None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:07.118918 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dc4814-f0fa-42c9-a9dc-3a3dd7e87717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:07.119929 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc4814-f0fa-42c9-a9dc-3a3dd7e87717 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:07.120682 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc4814-f0fa-42c9-a9dc-3a3dd7e87717 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:07.121105 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc4814-f0fa-42c9-a9dc-3a3dd7e87717 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:07.134210 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dc4814-f0fa-42c9-a9dc-3a3dd7e87717 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:07.136554 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dc4814-f0fa-42c9-a9dc-3a3dd7e87717 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:07.148578 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c1a2e9-f8ec-491f-8189-5cf85f48f568 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:07.154936 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-f1dc4814-f0fa-42c9-a9dc-3a3dd7e87717 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:07.154936 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:07.154936 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:07.154936 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:07.154936 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:07.154936 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:07.154936 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:07.154936 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:07.154936 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:07.154936 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:07.154936 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:07.154936 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:07.154936 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:07.154936 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:07.154936 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:07.154936 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:07.155825 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:07.155825 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:07.155825 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:07.155825 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:07.155825 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:07.155825 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:07.155825 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:07.155825 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:07.155825 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:07.155825 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:07.155825 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:07.155825 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:07.155825 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:07.155825 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:07.155825 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:07.155825 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:07.155825 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:07.156636 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:07.156636 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:07.156636 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:07.163761 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 209/430] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:07.163761 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3cdc9-6d63-41eb-8ad8-20aeee05a216 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:07.163761 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3cdc9-6d63-41eb-8ad8-20aeee05a216 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:07.163761 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3cdc9-6d63-41eb-8ad8-20aeee05a216 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:07.165125 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 210/431] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:58:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:07.165988 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba3cdc9-6d63-41eb-8ad8-20aeee05a216 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:07.197347 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93255676-6896-43be-bf19-2d9cbc4ce190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:07.198423 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93255676-6896-43be-bf19-2d9cbc4ce190 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:07.198711 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93255676-6896-43be-bf19-2d9cbc4ce190 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:07.198985 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93255676-6896-43be-bf19-2d9cbc4ce190 None admin] PATH_INFO: `/v3/users` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:07.199779 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93255676-6896-43be-bf19-2d9cbc4ce190 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:07.200282 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93255676-6896-43be-bf19-2d9cbc4ce190 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:07.202022 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93255676-6896-43be-bf19-2d9cbc4ce190 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:07.225820 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 222/432] 10.222.0.25 () {56 vars in 1133 bytes} [Thu Oct 13 10:58:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:07.227156 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0597831-2519-4c09-a07e-315d55d04c8b None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:07.227804 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0597831-2519-4c09-a07e-315d55d04c8b None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:07.228081 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0597831-2519-4c09-a07e-315d55d04c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:07.252586 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-a0597831-2519-4c09-a07e-315d55d04c8b None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:07.253852 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-a0597831-2519-4c09-a07e-315d55d04c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:07.264005 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:07.304397 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba3cdc9-6d63-41eb-8ad8-20aeee05a216 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:07.315119 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:07.346119 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 223/433] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:58:07.346119 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0597831-2519-4c09-a07e-315d55d04c8b None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:07.350423 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d53519d-fbb9-454e-834d-6b1c3a8e746d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:07.351047 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d53519d-fbb9-454e-834d-6b1c3a8e746d None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:07.351324 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d53519d-fbb9-454e-834d-6b1c3a8e746d None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:07.351649 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d53519d-fbb9-454e-834d-6b1c3a8e746d None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:07.352313 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d53519d-fbb9-454e-834d-6b1c3a8e746d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:07.354511 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d53519d-fbb9-454e-834d-6b1c3a8e746d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:07.357204 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d53519d-fbb9-454e-834d-6b1c3a8e746d None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:07.383021 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 211/434] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:07.390021 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d53519d-fbb9-454e-834d-6b1c3a8e746d None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:07.511394 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d53519d-fbb9-454e-834d-6b1c3a8e746d None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:07.521673 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0597831-2519-4c09-a07e-315d55d04c8b None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:07.553071 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a39e983-2b91-41d5-8b85-c4447384042b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:07.553699 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39e983-2b91-41d5-8b85-c4447384042b None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:07.553999 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39e983-2b91-41d5-8b85-c4447384042b None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:07.554294 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39e983-2b91-41d5-8b85-c4447384042b None admin] PATH_INFO: `/v3/users/swift` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:07.561498 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a39e983-2b91-41d5-8b85-c4447384042b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:07.562869 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e192a05e-4358-47ae-9e20-6dc8b858bda2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:07.563013 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a39e983-2b91-41d5-8b85-c4447384042b None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:07.564063 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192a05e-4358-47ae-9e20-6dc8b858bda2 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:07.564784 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192a05e-4358-47ae-9e20-6dc8b858bda2 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:07.565267 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192a05e-4358-47ae-9e20-6dc8b858bda2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:07.575882 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-7a39e983-2b91-41d5-8b85-c4447384042b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 13 10:58:07.575882 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:07.575882 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:07.575882 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:07.575882 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:07.575882 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:07.575882 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:07.575882 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:07.575882 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:07.575882 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:07.575882 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:07.575882 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:07.575882 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 10:58:07.575882 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 10:58:07.575882 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 10:58:07.575882 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 10:58:07.576798 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:07.576798 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:07.576798 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 10:58:07.576798 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:07.576798 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 10:58:07.576798 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:07.576798 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:07.576798 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:07.576798 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:07.576798 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:07.576798 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:07.576798 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:07.576798 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:07.576798 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:07.576798 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:07.576798 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:07.576798 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:07.576798 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:07.577666 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:07.577666 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:07.577666 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 10:58:07.577666 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 10:58:07.577666 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 10:58:07.577666 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 10:58:07.577666 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 10:58:07.577666 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 10:58:07.577666 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 13 10:58:07.577666 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:07.577666 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 212/435] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Oct 13 10:58:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 10:58:07.579062 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c82cb-e968-4a83-80b8-eabe49435d25 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:07.579405 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c82cb-e968-4a83-80b8-eabe49435d25 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:07.579750 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c82cb-e968-4a83-80b8-eabe49435d25 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:07.582925 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:07.585402 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 213/436] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:58:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:07.586466 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29c82cb-e968-4a83-80b8-eabe49435d25 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:07.622447 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:07.670525 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e192a05e-4358-47ae-9e20-6dc8b858bda2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:07.673125 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e192a05e-4358-47ae-9e20-6dc8b858bda2 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:07.704757 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29c82cb-e968-4a83-80b8-eabe49435d25 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:07.739059 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed5415-f617-49e7-810d-b95242e94f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:07.739667 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed5415-f617-49e7-810d-b95242e94f9e None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:07.739948 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed5415-f617-49e7-810d-b95242e94f9e None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:07.740228 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed5415-f617-49e7-810d-b95242e94f9e None admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:07.741119 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ed5415-f617-49e7-810d-b95242e94f9e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:07.741658 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ed5415-f617-49e7-810d-b95242e94f9e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:07.744117 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ed5415-f617-49e7-810d-b95242e94f9e None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:07.762755 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 214/437] 10.222.0.25 () {56 vars in 1135 bytes} [Thu Oct 13 10:58:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:07.764015 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e3094-dfe5-481c-8479-be7dfead91df None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:07.764304 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e3094-dfe5-481c-8479-be7dfead91df None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:07.764576 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e3094-dfe5-481c-8479-be7dfead91df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:07.781320 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-1f6e3094-dfe5-481c-8479-be7dfead91df None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:07.782549 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-1f6e3094-dfe5-481c-8479-be7dfead91df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:07.787308 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 224/438] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Oct 13 10:58:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 13 10:58:07.787308 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e192a05e-4358-47ae-9e20-6dc8b858bda2 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:07.827422 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:07.850986 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 215/439] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:58:07.852292 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b184e2c-d920-4d03-8826-8c076fd12743 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:07.852573 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b184e2c-d920-4d03-8826-8c076fd12743 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:07.852853 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b184e2c-d920-4d03-8826-8c076fd12743 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:07.854230 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 216/440] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:58:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:07.854835 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b184e2c-d920-4d03-8826-8c076fd12743 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:07.887771 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:07.893188 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e192a05e-4358-47ae-9e20-6dc8b858bda2 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:07.930473 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c04692f-5031-4a34-b773-ff4d71f6f3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:07.931029 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04692f-5031-4a34-b773-ff4d71f6f3c5 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:07.931309 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04692f-5031-4a34-b773-ff4d71f6f3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:07.931582 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04692f-5031-4a34-b773-ff4d71f6f3c5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:07.942192 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c04692f-5031-4a34-b773-ff4d71f6f3c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:58:07.947249 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-6c04692f-5031-4a34-b773-ff4d71f6f3c5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 13 10:58:07.947249 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:07.947249 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:07.947249 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:07.947249 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:07.947249 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:07.947249 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:07.947249 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:07.947249 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:07.947249 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:07.947249 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:07.947249 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:07.947249 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:58:07.947249 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:58:07.947249 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:58:07.947249 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:58:07.948315 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:58:07.948315 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:58:07.948315 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:58:07.948315 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:58:07.948315 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:07.948315 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:07.948315 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:07.948315 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:07.948315 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:07.948315 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:07.948315 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:07.948315 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:07.948315 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:07.948315 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:07.948315 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:07.948315 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:07.949104 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:07.949104 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:07.949104 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:07.949104 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:07.949104 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:58:07.949104 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:58:07.949104 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:58:07.949104 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:58:07.949104 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:58:07.949104 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:58:07.949104 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 13 10:58:07.949104 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:07.949104 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 225/441] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Oct 13 10:58:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:07.949104 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c04692f-5031-4a34-b773-ff4d71f6f3c5 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:07.991423 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b184e2c-d920-4d03-8826-8c076fd12743 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:08.024886 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f1f644-c75a-4148-88c6-09cfb3c19deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:08.025603 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1f644-c75a-4148-88c6-09cfb3c19deb None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:08.025850 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1f644-c75a-4148-88c6-09cfb3c19deb None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:08.026088 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1f644-c75a-4148-88c6-09cfb3c19deb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:08.036707 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f1f644-c75a-4148-88c6-09cfb3c19deb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:08.038159 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f1f644-c75a-4148-88c6-09cfb3c19deb None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:08.053890 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-13f1f644-c75a-4148-88c6-09cfb3c19deb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:08.053890 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:08.053890 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:08.053890 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:08.053890 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:08.053890 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:08.053890 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:08.053890 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:08.053890 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:08.053890 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:08.053890 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:08.053890 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:08.053890 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:08.053890 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:08.053890 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:08.053890 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:08.054835 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:08.054835 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:08.054835 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:08.054835 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:08.054835 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:08.054835 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:08.054835 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:08.054835 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:08.054835 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:08.054835 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:08.054835 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:08.054835 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:08.054835 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:08.054835 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:08.054835 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:08.054835 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:08.054835 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:08.055673 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:08.055673 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:08.055673 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:08.055673 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 217/442] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:08.056332 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026bca8c-7011-45c6-a09c-99e1f4d4dc19 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:08.056497 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026bca8c-7011-45c6-a09c-99e1f4d4dc19 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:08.056764 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026bca8c-7011-45c6-a09c-99e1f4d4dc19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:08.063332 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c04692f-5031-4a34-b773-ff4d71f6f3c5 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:08.064935 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:08.075724 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-026bca8c-7011-45c6-a09c-99e1f4d4dc19 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:08.076898 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-026bca8c-7011-45c6-a09c-99e1f4d4dc19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:08.100612 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57081fc-7d7e-48e1-8688-836d9e4fc785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:08.101239 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57081fc-7d7e-48e1-8688-836d9e4fc785 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:08.101520 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57081fc-7d7e-48e1-8688-836d9e4fc785 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:08.101794 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57081fc-7d7e-48e1-8688-836d9e4fc785 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:08.112468 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57081fc-7d7e-48e1-8688-836d9e4fc785 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:08.113970 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57081fc-7d7e-48e1-8688-836d9e4fc785 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:08.129368 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-d57081fc-7d7e-48e1-8688-836d9e4fc785 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:08.129368 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:08.129368 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:08.129368 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:08.129368 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:08.129368 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:08.129368 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:08.129368 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:08.129368 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:08.129368 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:08.129368 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:08.129368 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:08.129368 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:08.129368 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:08.129368 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:08.129368 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:08.130322 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:08.130322 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:08.130322 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:08.130322 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:08.130322 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:08.130322 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:08.130322 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:08.130322 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:08.130322 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:08.130322 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:08.130322 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:08.130322 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:08.130322 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:08.130322 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:08.130322 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:08.130322 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:08.130322 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:08.131160 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:08.131160 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:08.131160 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:08.131160 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 226/443] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:08.131846 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57081fc-7d7e-48e1-8688-836d9e4fc785 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:08.144198 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:08.154076 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 218/444] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:58:08.155806 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026bca8c-7011-45c6-a09c-99e1f4d4dc19 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:08.229680 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57081fc-7d7e-48e1-8688-836d9e4fc785 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:08.259740 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026bca8c-7011-45c6-a09c-99e1f4d4dc19 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:08.263944 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d711d3-695e-4849-a862-83b3a473c196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:08.264551 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d711d3-695e-4849-a862-83b3a473c196 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:08.264830 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d711d3-695e-4849-a862-83b3a473c196 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:08.265104 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d711d3-695e-4849-a862-83b3a473c196 None admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:08.265761 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d711d3-695e-4849-a862-83b3a473c196 None admin] RBAC: Adding query filter params (name=service) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:08.266095 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d711d3-695e-4849-a862-83b3a473c196 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:08.267456 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d711d3-695e-4849-a862-83b3a473c196 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:08.275776 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 227/445] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Oct 13 10:58:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:08.276450 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d711d3-695e-4849-a862-83b3a473c196 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:08.299324 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:08.305994 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a159624f-fa86-49cf-ad65-26edaef6041a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:08.306610 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159624f-fa86-49cf-ad65-26edaef6041a None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:08.306888 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159624f-fa86-49cf-ad65-26edaef6041a None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:08.307160 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159624f-fa86-49cf-ad65-26edaef6041a None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:08.307801 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a159624f-fa86-49cf-ad65-26edaef6041a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:08.308104 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a159624f-fa86-49cf-ad65-26edaef6041a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:08.309475 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a159624f-fa86-49cf-ad65-26edaef6041a None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:08.325457 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 219/446] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:08.325457 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a159624f-fa86-49cf-ad65-26edaef6041a None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:08.382637 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:08.392304 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d711d3-695e-4849-a862-83b3a473c196 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:08.424777 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a159624f-fa86-49cf-ad65-26edaef6041a None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:08.427915 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99a4b81-d790-4c6f-b057-a1bfcfea218c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:08.428563 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a4b81-d790-4c6f-b057-a1bfcfea218c None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:08.428841 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a4b81-d790-4c6f-b057-a1bfcfea218c None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:08.429110 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a4b81-d790-4c6f-b057-a1bfcfea218c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:08.439265 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99a4b81-d790-4c6f-b057-a1bfcfea218c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:58:08.444483 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-b99a4b81-d790-4c6f-b057-a1bfcfea218c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 13 10:58:08.444483 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:08.444483 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:08.444483 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:08.444483 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:08.444483 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:08.444483 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:08.444483 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:08.444483 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:08.444483 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:08.444483 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:08.444483 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:08.444483 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:58:08.444483 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:58:08.444483 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:58:08.444483 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:58:08.445378 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:58:08.445378 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:58:08.445378 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:58:08.445378 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:58:08.445378 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:08.445378 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:08.445378 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:08.445378 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:08.445378 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:08.445378 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:08.445378 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:08.445378 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:08.445378 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:08.445378 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:08.445378 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:08.445378 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:08.446199 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:08.446199 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:08.446199 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:08.446199 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:08.446199 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:58:08.446199 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:58:08.446199 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:58:08.446199 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:58:08.446199 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:58:08.446199 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:58:08.446199 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 13 10:58:08.446199 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:08.446199 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 228/447] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Oct 13 10:58:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:08.446875 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99a4b81-d790-4c6f-b057-a1bfcfea218c None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:08.460062 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da428f58-a3cf-4df0-a0f0-4f7f3bb933ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:08.460664 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da428f58-a3cf-4df0-a0f0-4f7f3bb933ff None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:08.460935 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da428f58-a3cf-4df0-a0f0-4f7f3bb933ff None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:08.461211 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da428f58-a3cf-4df0-a0f0-4f7f3bb933ff None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:08.461863 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da428f58-a3cf-4df0-a0f0-4f7f3bb933ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:08.462181 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da428f58-a3cf-4df0-a0f0-4f7f3bb933ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:08.463566 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da428f58-a3cf-4df0-a0f0-4f7f3bb933ff None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:08.475355 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 220/448] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:08.476129 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da428f58-a3cf-4df0-a0f0-4f7f3bb933ff None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:08.523034 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:08.545849 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99a4b81-d790-4c6f-b057-a1bfcfea218c None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:08.571872 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da428f58-a3cf-4df0-a0f0-4f7f3bb933ff None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:08.578011 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f56e6f-b3c4-4013-980b-53ed99298c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:08.578629 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f56e6f-b3c4-4013-980b-53ed99298c6c None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:08.578933 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f56e6f-b3c4-4013-980b-53ed99298c6c None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:08.579203 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f56e6f-b3c4-4013-980b-53ed99298c6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:08.589868 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f56e6f-b3c4-4013-980b-53ed99298c6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:08.591217 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:08.591350 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f56e6f-b3c4-4013-980b-53ed99298c6c None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:08.605181 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-84f56e6f-b3c4-4013-980b-53ed99298c6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:08.605181 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:08.605181 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:08.605181 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:08.605181 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:08.605181 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:08.605181 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:08.605181 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:08.605181 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:08.605181 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:08.605181 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:08.605181 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:08.605181 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:08.605181 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:08.605181 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:08.605181 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:08.606117 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:08.606117 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:08.606117 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:08.606117 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:08.606117 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:08.606117 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:08.606117 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:08.606117 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:08.606117 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:08.606117 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:08.606117 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:08.606117 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:08.606117 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:08.606117 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:08.606117 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:08.606117 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:08.606117 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:08.606954 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:08.606954 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:08.606954 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:08.607113 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd49eff1-4c1e-4fa2-9302-85c3e0fd40af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:08.607113 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49eff1-4c1e-4fa2-9302-85c3e0fd40af None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:08.607113 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49eff1-4c1e-4fa2-9302-85c3e0fd40af None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:08.607113 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49eff1-4c1e-4fa2-9302-85c3e0fd40af None admin] PATH_INFO: `/v3/projects/service` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:08.610075 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 229/449] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:08.611050 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f56e6f-b3c4-4013-980b-53ed99298c6c None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:08.614237 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd49eff1-4c1e-4fa2-9302-85c3e0fd40af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:08.615661 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd49eff1-4c1e-4fa2-9302-85c3e0fd40af None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:08.627610 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-cd49eff1-4c1e-4fa2-9302-85c3e0fd40af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:58:08.627610 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:08.627610 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:08.627610 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:08.627610 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:08.627610 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:08.627610 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:08.627610 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:08.627610 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:08.627610 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:08.627610 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:08.627610 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:08.627610 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 10:58:08.627610 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 10:58:08.627610 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 10:58:08.628585 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 10:58:08.628585 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:08.628585 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:08.628585 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:08.628585 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:08.628585 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:08.628585 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:08.628585 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:08.628585 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:08.628585 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:08.628585 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:08.628585 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:08.628585 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:08.628585 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:08.628585 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:08.628585 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:08.628585 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:08.629494 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 10:58:08.629494 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 10:58:08.629494 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 10:58:08.629494 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 10:58:08.629494 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 10:58:08.629494 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 10:58:08.629494 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:58:08.629494 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:08.629494 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 221/450] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Oct 13 10:58:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:08.629972 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd49eff1-4c1e-4fa2-9302-85c3e0fd40af None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:08.709092 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f56e6f-b3c4-4013-980b-53ed99298c6c None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:08.725639 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd49eff1-4c1e-4fa2-9302-85c3e0fd40af None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:08.734080 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:08.742641 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dc0358-d4b4-4d7e-9b3a-3d6e6e22b721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:08.743262 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc0358-d4b4-4d7e-9b3a-3d6e6e22b721 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:08.743544 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc0358-d4b4-4d7e-9b3a-3d6e6e22b721 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:08.743819 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc0358-d4b4-4d7e-9b3a-3d6e6e22b721 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:08.753655 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dc0358-d4b4-4d7e-9b3a-3d6e6e22b721 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:58:08.758116 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f578b51c-4646-4c1c-a667-a251c11883a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:08.758702 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f578b51c-4646-4c1c-a667-a251c11883a0 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:08.758922 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-06dc0358-d4b4-4d7e-9b3a-3d6e6e22b721 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 13 10:58:08.758922 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:08.758922 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:08.758922 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:08.758922 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:08.758922 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:08.758922 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:08.758922 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:08.758922 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:08.758922 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:08.758922 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:08.758922 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:08.758922 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:58:08.758922 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:58:08.758922 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:58:08.758922 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:58:08.759878 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:58:08.759878 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:58:08.759878 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:58:08.759878 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:58:08.759878 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:08.759878 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:08.759878 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:08.759878 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:08.759878 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:08.759878 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:08.759878 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:08.759878 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:08.759878 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:08.759878 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:08.759878 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:08.759878 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:08.760690 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:08.760690 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:08.760690 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:08.760690 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:08.760690 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:58:08.760690 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:58:08.760690 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:58:08.760690 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:58:08.760690 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:58:08.760690 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:58:08.760690 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 13 10:58:08.760690 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:08.761288 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f578b51c-4646-4c1c-a667-a251c11883a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:08.761288 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f578b51c-4646-4c1c-a667-a251c11883a0 None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:08.761288 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f578b51c-4646-4c1c-a667-a251c11883a0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:08.761452 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 230/451] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Oct 13 10:58:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:08.761515 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f578b51c-4646-4c1c-a667-a251c11883a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:08.761587 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dc0358-d4b4-4d7e-9b3a-3d6e6e22b721 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:08.761654 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f578b51c-4646-4c1c-a667-a251c11883a0 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:08.770147 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 222/452] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Oct 13 10:58:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:08.770918 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f578b51c-4646-4c1c-a667-a251c11883a0 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:08.811252 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:08.858315 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dc0358-d4b4-4d7e-9b3a-3d6e6e22b721 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:08.867718 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f578b51c-4646-4c1c-a667-a251c11883a0 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:08.896958 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb3a041-05d2-4a4d-8c74-cf0d11238350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:08.897581 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3a041-05d2-4a4d-8c74-cf0d11238350 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:08.897857 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3a041-05d2-4a4d-8c74-cf0d11238350 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:08.898172 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3a041-05d2-4a4d-8c74-cf0d11238350 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:08.900384 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08193d3-532e-4980-8629-4f6d9906c991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:08.900982 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08193d3-532e-4980-8629-4f6d9906c991 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:08.901257 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08193d3-532e-4980-8629-4f6d9906c991 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:08.901530 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08193d3-532e-4980-8629-4f6d9906c991 None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:08.902198 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08193d3-532e-4980-8629-4f6d9906c991 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:08.902501 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08193d3-532e-4980-8629-4f6d9906c991 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:08.903854 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08193d3-532e-4980-8629-4f6d9906c991 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:08.904657 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb3a041-05d2-4a4d-8c74-cf0d11238350 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:08.906091 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb3a041-05d2-4a4d-8c74-cf0d11238350 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:08.915626 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 223/453] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:08.916401 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08193d3-532e-4980-8629-4f6d9906c991 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:08.917505 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-fbb3a041-05d2-4a4d-8c74-cf0d11238350 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:58:08.917505 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:08.917505 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:08.917505 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:08.917505 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:08.917505 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:08.917505 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:08.917505 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:08.917505 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:08.917505 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:08.917505 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:08.917505 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:08.917505 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 10:58:08.917505 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 10:58:08.917505 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 10:58:08.918359 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 10:58:08.918359 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:08.918359 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:08.918359 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:08.918359 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:08.918359 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:08.918359 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:08.918359 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:08.918359 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:08.918359 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:08.918359 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:08.918359 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:08.918359 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:08.918359 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:08.918359 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:08.918359 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:08.918359 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:08.919209 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 10:58:08.919209 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 10:58:08.919209 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 10:58:08.919209 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 10:58:08.919209 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 10:58:08.919209 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 10:58:08.919209 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:58:08.919209 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:08.919209 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 231/454] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Oct 13 10:58:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:08.921081 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb3a041-05d2-4a4d-8c74-cf0d11238350 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:08.969052 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:09.016474 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08193d3-532e-4980-8629-4f6d9906c991 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:09.017972 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:09.019056 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb3a041-05d2-4a4d-8c74-cf0d11238350 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:09.049692 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399eaaca-1b52-4b4a-8193-b2e3eb456ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:09.050317 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399eaaca-1b52-4b4a-8193-b2e3eb456ae8 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:09.050612 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399eaaca-1b52-4b4a-8193-b2e3eb456ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:09.050939 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399eaaca-1b52-4b4a-8193-b2e3eb456ae8 None admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:09.051121 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ef3289-acd7-4826-ac7b-7b9768ff5e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:09.051614 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399eaaca-1b52-4b4a-8193-b2e3eb456ae8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:09.051713 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef3289-acd7-4826-ac7b-7b9768ff5e3a None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:09.051917 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399eaaca-1b52-4b4a-8193-b2e3eb456ae8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:09.052003 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef3289-acd7-4826-ac7b-7b9768ff5e3a None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:09.052237 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef3289-acd7-4826-ac7b-7b9768ff5e3a None admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:09.052894 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ef3289-acd7-4826-ac7b-7b9768ff5e3a None admin] RBAC: Adding query filter params (name=service) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:09.053200 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ef3289-acd7-4826-ac7b-7b9768ff5e3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:09.053348 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399eaaca-1b52-4b4a-8193-b2e3eb456ae8 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:09.054580 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ef3289-acd7-4826-ac7b-7b9768ff5e3a None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:09.062431 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 232/455] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Oct 13 10:58:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:09.063062 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ef3289-acd7-4826-ac7b-7b9768ff5e3a None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:09.069783 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 224/456] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Oct 13 10:58:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:09.069783 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399eaaca-1b52-4b4a-8193-b2e3eb456ae8 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:09.161441 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399eaaca-1b52-4b4a-8193-b2e3eb456ae8 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:09.165688 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ef3289-acd7-4826-ac7b-7b9768ff5e3a None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:09.176196 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:09.194895 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd397b7-9fbb-4981-9bc4-56d32bd0e84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:09.195511 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd397b7-9fbb-4981-9bc4-56d32bd0e84f None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:09.195782 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd397b7-9fbb-4981-9bc4-56d32bd0e84f None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:09.196049 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd397b7-9fbb-4981-9bc4-56d32bd0e84f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:09.199709 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076699d9-00fc-42f4-94c9-05f5ec268404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:09.200321 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076699d9-00fc-42f4-94c9-05f5ec268404 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:09.200596 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076699d9-00fc-42f4-94c9-05f5ec268404 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:09.200863 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076699d9-00fc-42f4-94c9-05f5ec268404 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:09.203218 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd397b7-9fbb-4981-9bc4-56d32bd0e84f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:09.204646 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd397b7-9fbb-4981-9bc4-56d32bd0e84f None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:09.211544 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076699d9-00fc-42f4-94c9-05f5ec268404 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:09.212950 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076699d9-00fc-42f4-94c9-05f5ec268404 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:09.215949 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-1dd397b7-9fbb-4981-9bc4-56d32bd0e84f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 13 10:58:09.215949 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:09.215949 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:09.215949 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:09.215949 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:09.215949 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:09.215949 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:09.215949 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:09.215949 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:09.215949 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:09.215949 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:09.215949 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:09.215949 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 10:58:09.215949 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 10:58:09.215949 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 10:58:09.215949 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 10:58:09.216993 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:09.216993 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:09.216993 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 10:58:09.216993 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:09.216993 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 10:58:09.216993 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:09.216993 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:09.216993 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:09.216993 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:09.216993 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:09.216993 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:09.216993 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:09.216993 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:09.216993 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:09.216993 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:09.216993 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:09.216993 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:09.216993 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:09.218096 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:09.218096 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:09.218096 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 10:58:09.218096 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 10:58:09.218096 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 10:58:09.218096 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 10:58:09.218096 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 10:58:09.218096 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 10:58:09.218096 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 13 10:58:09.218096 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:09.218096 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 225/457] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 10:58:09 2022] GET /identity/v3/users/cinder => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:09.218096 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd397b7-9fbb-4981-9bc4-56d32bd0e84f None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:09.227083 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-076699d9-00fc-42f4-94c9-05f5ec268404 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:09.227083 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:09.227083 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:09.227083 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:09.227083 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:09.227083 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:09.227083 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:09.227083 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:09.227083 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:09.227083 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:09.227083 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:09.227083 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:09.227083 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:09.227083 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:09.227083 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:09.227083 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:09.228069 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:09.228069 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:09.228069 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:09.228069 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:09.228069 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:09.228069 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:09.228069 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:09.228069 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:09.228069 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:09.228069 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:09.228069 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:09.228069 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:09.228069 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:09.228069 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:09.228069 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:09.228069 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:09.228069 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:09.229628 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:09.229628 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:09.229628 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:09.229628 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 233/458] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:09.229628 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076699d9-00fc-42f4-94c9-05f5ec268404 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:09.244642 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:09.316776 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd397b7-9fbb-4981-9bc4-56d32bd0e84f None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:09.329453 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076699d9-00fc-42f4-94c9-05f5ec268404 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:09.349977 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc0164-17f1-48a3-930d-35a904da7fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:09.350574 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc0164-17f1-48a3-930d-35a904da7fc6 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:09.350850 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc0164-17f1-48a3-930d-35a904da7fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:09.351121 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc0164-17f1-48a3-930d-35a904da7fc6 None admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:09.351801 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bc0164-17f1-48a3-930d-35a904da7fc6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:09.352105 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bc0164-17f1-48a3-930d-35a904da7fc6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:09.353511 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bc0164-17f1-48a3-930d-35a904da7fc6 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:09.362600 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6634107d-44dc-42ef-9ddb-e40720ac64a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:09.363237 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634107d-44dc-42ef-9ddb-e40720ac64a1 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:09.363517 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634107d-44dc-42ef-9ddb-e40720ac64a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:09.363788 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634107d-44dc-42ef-9ddb-e40720ac64a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:09.365087 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 226/459] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Oct 13 10:58:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:09.365832 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc0164-17f1-48a3-930d-35a904da7fc6 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:09.374338 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6634107d-44dc-42ef-9ddb-e40720ac64a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:09.375788 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6634107d-44dc-42ef-9ddb-e40720ac64a1 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:09.389670 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-6634107d-44dc-42ef-9ddb-e40720ac64a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:09.389670 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:09.389670 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:09.389670 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:09.389670 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:09.389670 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:09.389670 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:09.389670 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:09.389670 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:09.389670 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:09.389670 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:09.389670 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:09.389670 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:09.389670 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:09.389670 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:09.389670 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:09.390589 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:09.390589 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:09.390589 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:09.390589 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:09.390589 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:09.390589 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:09.390589 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:09.390589 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:09.390589 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:09.390589 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:09.390589 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:09.390589 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:09.390589 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:09.390589 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:09.390589 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:09.390589 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:09.390589 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:09.391600 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:09.391600 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:09.391600 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:09.391600 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 234/460] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:09.392202 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6634107d-44dc-42ef-9ddb-e40720ac64a1 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:09.407430 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:09.445959 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:09.464221 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc0164-17f1-48a3-930d-35a904da7fc6 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:09.492486 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6634107d-44dc-42ef-9ddb-e40720ac64a1 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:09.500429 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab38a431-b862-41d9-941e-dcd38ceda590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:09.501186 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab38a431-b862-41d9-941e-dcd38ceda590 None admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:09.501356 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab38a431-b862-41d9-941e-dcd38ceda590 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:09.501719 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab38a431-b862-41d9-941e-dcd38ceda590 None admin] PATH_INFO: `/v3/projects/85bfac5f03e24fb3870a59a6b52dba6e/users/e24c779d0a604ef28dfc1235ee76a711/roles/409a58470d23473abb676acf7c1095ae` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:09.516755 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab38a431-b862-41d9-941e-dcd38ceda590 None admin] RBAC: Authorizing `identity:create_grant(project_id=85bfac5f03e24fb3870a59a6b52dba6e, user_id=e24c779d0a604ef28dfc1235ee76a711, role_id=409a58470d23473abb676acf7c1095ae)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:09.518212 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab38a431-b862-41d9-941e-dcd38ceda590 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:09.527867 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ea60b-07ac-4e56-bfb4-98eb29aae315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:09.528462 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ea60b-07ac-4e56-bfb4-98eb29aae315 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:09.528745 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ea60b-07ac-4e56-bfb4-98eb29aae315 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:09.529013 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ea60b-07ac-4e56-bfb4-98eb29aae315 None admin] PATH_INFO: `/v3/users` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:09.529725 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3ea60b-07ac-4e56-bfb4-98eb29aae315 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:09.538026 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 227/461] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Oct 13 10:58:09 2022] PUT /identity/v3/projects/85bfac5f03e24fb3870a59a6b52dba6e/users/e24c779d0a604ef28dfc1235ee76a711/roles/409a58470d23473abb676acf7c1095ae => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 10:58:09.538248 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3ea60b-07ac-4e56-bfb4-98eb29aae315 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:09.538370 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab38a431-b862-41d9-941e-dcd38ceda590 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:09.538455 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3ea60b-07ac-4e56-bfb4-98eb29aae315 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:09.551048 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 235/462] 10.222.0.25 () {56 vars in 1137 bytes} [Thu Oct 13 10:58:09 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:09.551930 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ea60b-07ac-4e56-bfb4-98eb29aae315 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:09.633357 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:09.654703 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab38a431-b862-41d9-941e-dcd38ceda590 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:09.666914 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ea60b-07ac-4e56-bfb4-98eb29aae315 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:09.695312 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:09.702752 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a2cd9c-ace4-4bd6-b795-a2293796269a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:09.703623 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a2cd9c-ace4-4bd6-b795-a2293796269a None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:09.703910 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a2cd9c-ace4-4bd6-b795-a2293796269a None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:09.704092 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a2cd9c-ace4-4bd6-b795-a2293796269a None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:09.704363 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc41a3a-ca51-413a-a0ac-ee725172d045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:09.704744 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a2cd9c-ace4-4bd6-b795-a2293796269a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:09.705709 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc41a3a-ca51-413a-a0ac-ee725172d045 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:09.705826 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a2cd9c-ace4-4bd6-b795-a2293796269a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:09.705898 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc41a3a-ca51-413a-a0ac-ee725172d045 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:09.705898 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc41a3a-ca51-413a-a0ac-ee725172d045 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:09.706303 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc41a3a-ca51-413a-a0ac-ee725172d045 None admin] RBAC: Adding query filter params (role.id=409a58470d23473abb676acf7c1095ae, scope.project.id=85bfac5f03e24fb3870a59a6b52dba6e, user.id=78384fbffdd346578855e7214b335d8e) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:09.708718 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc41a3a-ca51-413a-a0ac-ee725172d045 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:09.708845 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a2cd9c-ace4-4bd6-b795-a2293796269a None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:09.708920 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc41a3a-ca51-413a-a0ac-ee725172d045 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:09.714663 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 236/463] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Oct 13 10:58:09 2022] GET /identity/v3/role_assignments?user.id=78384fbffdd346578855e7214b335d8e&scope.project.id=85bfac5f03e24fb3870a59a6b52dba6e&role.id=409a58470d23473abb676acf7c1095ae => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:09.715340 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc41a3a-ca51-413a-a0ac-ee725172d045 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:09.728732 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 228/464] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:09.729632 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a2cd9c-ace4-4bd6-b795-a2293796269a None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:09.858357 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a2cd9c-ace4-4bd6-b795-a2293796269a None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:09.858690 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc41a3a-ca51-413a-a0ac-ee725172d045 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:09.902117 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d3b9c9-9148-4a30-8803-0ba93efe1117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:09.902824 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3b9c9-9148-4a30-8803-0ba93efe1117 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:09.903169 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3b9c9-9148-4a30-8803-0ba93efe1117 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:09.903509 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3b9c9-9148-4a30-8803-0ba93efe1117 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:09.908631 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95791687-2406-4e4a-9401-df2dfb673dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:09.909374 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95791687-2406-4e4a-9401-df2dfb673dd4 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:09.909743 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95791687-2406-4e4a-9401-df2dfb673dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:09.910234 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95791687-2406-4e4a-9401-df2dfb673dd4 None admin] PATH_INFO: `/v3/domains` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:09.910971 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95791687-2406-4e4a-9401-df2dfb673dd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:09.911359 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95791687-2406-4e4a-9401-df2dfb673dd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:09.912819 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95791687-2406-4e4a-9401-df2dfb673dd4 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:09.917018 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:09.929886 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 237/465] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:09.932679 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95791687-2406-4e4a-9401-df2dfb673dd4 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:09.973358 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:09.987205 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d3b9c9-9148-4a30-8803-0ba93efe1117 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:09.989212 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d3b9c9-9148-4a30-8803-0ba93efe1117 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:10.062210 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95791687-2406-4e4a-9401-df2dfb673dd4 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:10.093287 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 229/466] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Oct 13 10:58:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 13 10:58:10.094855 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d3b9c9-9148-4a30-8803-0ba93efe1117 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:10.112685 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aa647e-73ae-4eeb-93bc-c06d6978a6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:10.113844 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa647e-73ae-4eeb-93bc-c06d6978a6a1 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:10.114146 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa647e-73ae-4eeb-93bc-c06d6978a6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:10.114410 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa647e-73ae-4eeb-93bc-c06d6978a6a1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:10.121617 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aa647e-73ae-4eeb-93bc-c06d6978a6a1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:10.123110 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aa647e-73ae-4eeb-93bc-c06d6978a6a1 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:10.136415 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-45aa647e-73ae-4eeb-93bc-c06d6978a6a1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 13 10:58:10.136415 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:10.136415 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:10.136415 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:10.136415 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:10.136415 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:10.136415 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:10.136415 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:10.136415 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:10.136415 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:10.136415 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:10.136415 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:10.136415 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 10:58:10.136415 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 10:58:10.136415 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 10:58:10.136415 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 10:58:10.137538 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:10.137538 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:10.137538 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 10:58:10.137538 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:10.137538 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 10:58:10.137538 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:10.137538 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:10.137538 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:10.137538 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:10.137538 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:10.137538 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:10.137538 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:10.137538 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:10.137538 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:10.137538 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:10.137538 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:10.137538 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:10.137538 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:10.138816 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:10.138816 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:10.138816 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 10:58:10.138816 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 10:58:10.138816 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 10:58:10.138816 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 10:58:10.138816 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 10:58:10.138816 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 10:58:10.138816 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 13 10:58:10.138816 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:10.138816 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 238/467] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 10:58:09 2022] GET /identity/v3/users/glance => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:10.140200 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aa647e-73ae-4eeb-93bc-c06d6978a6a1 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:10.202395 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:10.215862 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:10.229680 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d3b9c9-9148-4a30-8803-0ba93efe1117 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:10.245254 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aa647e-73ae-4eeb-93bc-c06d6978a6a1 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:10.281429 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760288a8-6a65-4440-87ff-45904e9db111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:10.282117 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760288a8-6a65-4440-87ff-45904e9db111 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:10.282392 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760288a8-6a65-4440-87ff-45904e9db111 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:10.282662 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760288a8-6a65-4440-87ff-45904e9db111 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:10.286727 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66bed65-a5bd-41c1-919f-8eb1540ff1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:10.287672 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66bed65-a5bd-41c1-919f-8eb1540ff1d5 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:10.288151 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66bed65-a5bd-41c1-919f-8eb1540ff1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:10.288619 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66bed65-a5bd-41c1-919f-8eb1540ff1d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:10.290692 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760288a8-6a65-4440-87ff-45904e9db111 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:10.292127 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760288a8-6a65-4440-87ff-45904e9db111 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:10.302555 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66bed65-a5bd-41c1-919f-8eb1540ff1d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:10.304256 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66bed65-a5bd-41c1-919f-8eb1540ff1d5 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:10.304653 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-760288a8-6a65-4440-87ff-45904e9db111 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 13 10:58:10.304653 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:10.304653 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:10.304653 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:10.304653 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:10.304653 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:10.304653 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:10.304653 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:10.304653 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:10.304653 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:10.304653 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:10.304653 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:10.304653 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 10:58:10.304653 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 10:58:10.304653 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 10:58:10.304653 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 10:58:10.305522 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:10.305522 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:10.305522 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 10:58:10.305522 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:10.305522 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 10:58:10.305522 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:10.305522 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:10.305522 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:10.305522 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:10.305522 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:10.305522 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:10.305522 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:10.305522 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:10.305522 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:10.305522 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:10.305522 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:10.305522 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:10.305522 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:10.307039 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:10.307039 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:10.307039 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 10:58:10.307039 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 10:58:10.307039 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 10:58:10.307039 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 10:58:10.307039 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 10:58:10.307039 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 10:58:10.307039 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 13 10:58:10.307039 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:10.307039 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 230/468] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Oct 13 10:58:10 2022] GET /identity/v3/users/neutron => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:10.307039 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760288a8-6a65-4440-87ff-45904e9db111 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:10.328077 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-f66bed65-a5bd-41c1-919f-8eb1540ff1d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:10.328077 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:10.328077 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:10.328077 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:10.328077 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:10.328077 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:10.328077 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:10.328077 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:10.328077 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:10.328077 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:10.328077 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:10.328077 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:10.328077 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:10.328077 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:10.328077 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:10.328077 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:10.329039 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:10.329039 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:10.329039 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:10.329039 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:10.329039 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:10.329039 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:10.329039 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:10.329039 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:10.329039 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:10.329039 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:10.329039 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:10.329039 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:10.329039 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:10.329039 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:10.329039 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:10.329039 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:10.329039 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:10.329875 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:10.329875 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:10.329875 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:10.336488 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 239/469] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:10.336488 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66bed65-a5bd-41c1-919f-8eb1540ff1d5 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:10.433192 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760288a8-6a65-4440-87ff-45904e9db111 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:10.437915 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66bed65-a5bd-41c1-919f-8eb1540ff1d5 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:10.448928 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:10.476021 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b582a6-5c0e-42d1-a23e-18a1aa47ef0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:10.477026 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b582a6-5c0e-42d1-a23e-18a1aa47ef0e None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:10.477451 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b582a6-5c0e-42d1-a23e-18a1aa47ef0e None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:10.477605 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bacd24-5fdb-45e0-bac7-9e16fa6287a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:10.478050 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b582a6-5c0e-42d1-a23e-18a1aa47ef0e None admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:10.478451 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bacd24-5fdb-45e0-bac7-9e16fa6287a4 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:10.478865 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bacd24-5fdb-45e0-bac7-9e16fa6287a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:10.479236 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b582a6-5c0e-42d1-a23e-18a1aa47ef0e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:10.479344 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bacd24-5fdb-45e0-bac7-9e16fa6287a4 None admin] PATH_INFO: `/v3/users` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:10.479766 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b582a6-5c0e-42d1-a23e-18a1aa47ef0e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:10.480240 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bacd24-5fdb-45e0-bac7-9e16fa6287a4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:10.480635 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bacd24-5fdb-45e0-bac7-9e16fa6287a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:10.481662 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b582a6-5c0e-42d1-a23e-18a1aa47ef0e None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:10.482299 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bacd24-5fdb-45e0-bac7-9e16fa6287a4 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:10.501171 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 240/470] 10.222.0.25 () {56 vars in 1139 bytes} [Thu Oct 13 10:58:10 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:10.501765 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 231/471] 10.222.0.25 () {56 vars in 1137 bytes} [Thu Oct 13 10:58:10 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:10.502368 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bacd24-5fdb-45e0-bac7-9e16fa6287a4 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:10.511406 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b582a6-5c0e-42d1-a23e-18a1aa47ef0e None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:10.524660 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:10.603908 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bacd24-5fdb-45e0-bac7-9e16fa6287a4 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:10.616252 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b582a6-5c0e-42d1-a23e-18a1aa47ef0e None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:10.638553 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b08a141-0e9e-4d1c-8ecc-92878f224952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:10.639151 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b08a141-0e9e-4d1c-8ecc-92878f224952 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:10.639432 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b08a141-0e9e-4d1c-8ecc-92878f224952 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:10.639698 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b08a141-0e9e-4d1c-8ecc-92878f224952 None admin] PATH_INFO: `/v3/domains` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:10.640391 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b08a141-0e9e-4d1c-8ecc-92878f224952 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:10.640693 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b08a141-0e9e-4d1c-8ecc-92878f224952 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:10.642065 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b08a141-0e9e-4d1c-8ecc-92878f224952 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:10.652583 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fbcd68-9c81-45d0-a5a0-db88bb430e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:10.653309 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fbcd68-9c81-45d0-a5a0-db88bb430e09 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:10.653797 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 241/472] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:10.653929 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fbcd68-9c81-45d0-a5a0-db88bb430e09 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:10.654160 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fbcd68-9c81-45d0-a5a0-db88bb430e09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:10.654413 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b08a141-0e9e-4d1c-8ecc-92878f224952 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:10.683210 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:10.730298 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fbcd68-9c81-45d0-a5a0-db88bb430e09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:10.732097 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fbcd68-9c81-45d0-a5a0-db88bb430e09 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:10.744765 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:10.760091 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b08a141-0e9e-4d1c-8ecc-92878f224952 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:10.794092 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41682485-b090-45fd-b1fd-7067ea96196e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:10.794726 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41682485-b090-45fd-b1fd-7067ea96196e None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:10.794995 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41682485-b090-45fd-b1fd-7067ea96196e None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:10.795266 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41682485-b090-45fd-b1fd-7067ea96196e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:10.846258 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 232/473] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Oct 13 10:58:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 13 10:58:10.847538 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fbcd68-9c81-45d0-a5a0-db88bb430e09 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:10.865119 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41682485-b090-45fd-b1fd-7067ea96196e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:10.866632 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41682485-b090-45fd-b1fd-7067ea96196e None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:10.894223 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:10.967308 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fbcd68-9c81-45d0-a5a0-db88bb430e09 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:10.972716 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 242/474] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Oct 13 10:58:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 13 10:58:10.972716 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41682485-b090-45fd-b1fd-7067ea96196e None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:10.984200 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:11.014377 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a7ccde-3227-4cde-ac98-1fd7e5e8b485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:11.015448 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7ccde-3227-4cde-ac98-1fd7e5e8b485 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:11.015918 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7ccde-3227-4cde-ac98-1fd7e5e8b485 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:11.016475 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7ccde-3227-4cde-ac98-1fd7e5e8b485 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:11.024317 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a7ccde-3227-4cde-ac98-1fd7e5e8b485 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:11.026211 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a7ccde-3227-4cde-ac98-1fd7e5e8b485 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:11.038869 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-17a7ccde-3227-4cde-ac98-1fd7e5e8b485 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:58:11.038869 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:11.038869 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:11.038869 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:11.038869 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:11.038869 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:11.038869 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:11.038869 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:11.038869 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:11.038869 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:11.038869 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:11.038869 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:11.038869 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 10:58:11.038869 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 10:58:11.038869 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 10:58:11.039696 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 10:58:11.039696 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:11.039696 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:11.039696 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:11.039696 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:11.039696 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:11.039696 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:11.039696 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:11.039696 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:11.039696 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:11.039696 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:11.039696 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:11.039696 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:11.039696 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:11.039696 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:11.039696 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:11.039696 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:11.040526 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 10:58:11.040526 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 10:58:11.040526 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 10:58:11.040526 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 10:58:11.040526 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 10:58:11.040526 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 10:58:11.040526 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:58:11.040526 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:11.042983 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 233/475] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Oct 13 10:58:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:11.044064 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a7ccde-3227-4cde-ac98-1fd7e5e8b485 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:11.071110 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41682485-b090-45fd-b1fd-7067ea96196e None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:11.096839 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:11.106524 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a3b4da-c077-444f-8578-4bdd7226590a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:11.107402 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3b4da-c077-444f-8578-4bdd7226590a None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:11.107402 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3b4da-c077-444f-8578-4bdd7226590a None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:11.107678 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3b4da-c077-444f-8578-4bdd7226590a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:11.118168 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a3b4da-c077-444f-8578-4bdd7226590a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:11.119607 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a3b4da-c077-444f-8578-4bdd7226590a None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:11.134729 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-65a3b4da-c077-444f-8578-4bdd7226590a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:11.134729 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:11.134729 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:11.134729 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:11.134729 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:11.134729 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:11.134729 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:11.134729 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:11.134729 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:11.134729 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:11.134729 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:11.134729 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:11.134729 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:11.134729 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:11.134729 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:11.134729 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:11.135614 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:11.135614 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:11.135614 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:11.135614 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:11.135614 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:11.135614 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:11.135614 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:11.135614 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:11.135614 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:11.135614 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:11.135614 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:11.135614 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:11.135614 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:11.135614 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:11.135614 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:11.135614 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:11.135614 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:11.136436 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:11.136436 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:11.136436 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:11.140527 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 243/476] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:11.141493 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a3b4da-c077-444f-8578-4bdd7226590a None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:11.157114 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a7ccde-3227-4cde-ac98-1fd7e5e8b485 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:11.194121 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5a590a-86b4-42a5-a29a-e6d1f8c5d630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:11.194995 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a590a-86b4-42a5-a29a-e6d1f8c5d630 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:11.195465 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a590a-86b4-42a5-a29a-e6d1f8c5d630 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:11.195975 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a590a-86b4-42a5-a29a-e6d1f8c5d630 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:11.207148 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5a590a-86b4-42a5-a29a-e6d1f8c5d630 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:11.208887 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5a590a-86b4-42a5-a29a-e6d1f8c5d630 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:11.225029 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-ce5a590a-86b4-42a5-a29a-e6d1f8c5d630 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:11.225029 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:11.225029 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:11.225029 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:11.225029 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:11.225029 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:11.225029 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:11.225029 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:11.225029 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:11.225029 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:11.225029 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:11.225029 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:11.225029 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:11.225029 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:11.225029 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:11.225029 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:11.225925 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:11.225925 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:11.225925 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:11.225925 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:11.225925 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:11.225925 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:11.225925 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:11.225925 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:11.225925 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:11.225925 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:11.225925 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:11.225925 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:11.225925 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:11.225925 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:11.225925 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:11.225925 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:11.225925 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:11.226762 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:11.226762 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:11.226762 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:11.233237 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 234/477] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:11.234536 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5a590a-86b4-42a5-a29a-e6d1f8c5d630 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:11.244198 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a3b4da-c077-444f-8578-4bdd7226590a None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:11.261506 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:11.278343 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f6c020-bb0f-48fc-965f-a60f6a0ecff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:11.279071 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f6c020-bb0f-48fc-965f-a60f6a0ecff3 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:11.279459 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f6c020-bb0f-48fc-965f-a60f6a0ecff3 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:11.279801 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f6c020-bb0f-48fc-965f-a60f6a0ecff3 None admin] PATH_INFO: `/v3/projects` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:11.280667 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f6c020-bb0f-48fc-965f-a60f6a0ecff3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:11.280909 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f6c020-bb0f-48fc-965f-a60f6a0ecff3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:11.282433 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f6c020-bb0f-48fc-965f-a60f6a0ecff3 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:11.295438 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 244/478] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Oct 13 10:58:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:11.296465 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f6c020-bb0f-48fc-965f-a60f6a0ecff3 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:11.336584 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:11.349237 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5a590a-86b4-42a5-a29a-e6d1f8c5d630 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:11.386592 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e755573a-45bd-4d7b-ac05-c9873b9e5f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:11.387489 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e755573a-45bd-4d7b-ac05-c9873b9e5f57 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:11.387965 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e755573a-45bd-4d7b-ac05-c9873b9e5f57 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:11.388427 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e755573a-45bd-4d7b-ac05-c9873b9e5f57 None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:11.389372 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e755573a-45bd-4d7b-ac05-c9873b9e5f57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:11.390068 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e755573a-45bd-4d7b-ac05-c9873b9e5f57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:11.391613 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e755573a-45bd-4d7b-ac05-c9873b9e5f57 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:11.398521 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f6c020-bb0f-48fc-965f-a60f6a0ecff3 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:11.405349 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 235/479] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:11.406477 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e755573a-45bd-4d7b-ac05-c9873b9e5f57 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:11.439275 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b836b-76d1-4129-b241-daa7fdbcf040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:11.439880 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b836b-76d1-4129-b241-daa7fdbcf040 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:11.440157 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b836b-76d1-4129-b241-daa7fdbcf040 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:11.440430 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b836b-76d1-4129-b241-daa7fdbcf040 None admin] PATH_INFO: `/v3/domains` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:11.441166 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9b836b-76d1-4129-b241-daa7fdbcf040 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:11.441474 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9b836b-76d1-4129-b241-daa7fdbcf040 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:11.442938 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9b836b-76d1-4129-b241-daa7fdbcf040 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:11.459973 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 245/480] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:11.461050 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b836b-76d1-4129-b241-daa7fdbcf040 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:11.498734 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:11.521785 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e755573a-45bd-4d7b-ac05-c9873b9e5f57 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:11.559237 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4a5fd1-5e12-43f8-bd55-9953857f1864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:11.560203 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a5fd1-5e12-43f8-bd55-9953857f1864 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:11.560922 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:11.561184 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a5fd1-5e12-43f8-bd55-9953857f1864 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:11.562353 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a5fd1-5e12-43f8-bd55-9953857f1864 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:11.563542 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4a5fd1-5e12-43f8-bd55-9953857f1864 None admin] RBAC: Adding query filter params (role.id=409a58470d23473abb676acf7c1095ae, scope.project.id=85bfac5f03e24fb3870a59a6b52dba6e, user.id=35f4c2fc51f54f0e977648b13efaed1a) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:11.564130 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4a5fd1-5e12-43f8-bd55-9953857f1864 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:11.565101 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b836b-76d1-4129-b241-daa7fdbcf040 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:11.566527 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4a5fd1-5e12-43f8-bd55-9953857f1864 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:11.573770 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 236/481] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Oct 13 10:58:11 2022] GET /identity/v3/role_assignments?user.id=35f4c2fc51f54f0e977648b13efaed1a&scope.project.id=85bfac5f03e24fb3870a59a6b52dba6e&role.id=409a58470d23473abb676acf7c1095ae => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:11.574903 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4a5fd1-5e12-43f8-bd55-9953857f1864 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:11.604107 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2233f45a-a858-499d-a6d3-f858dbf5a17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:11.605064 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2233f45a-a858-499d-a6d3-f858dbf5a17b None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:11.605261 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2233f45a-a858-499d-a6d3-f858dbf5a17b None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:11.605624 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2233f45a-a858-499d-a6d3-f858dbf5a17b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:11.614702 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2233f45a-a858-499d-a6d3-f858dbf5a17b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:11.616360 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2233f45a-a858-499d-a6d3-f858dbf5a17b None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:11.628520 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-2233f45a-a858-499d-a6d3-f858dbf5a17b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:58:11.628520 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:11.628520 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:11.628520 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:11.628520 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:11.628520 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:11.628520 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:11.628520 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:11.628520 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:11.628520 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:11.628520 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:11.628520 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:11.628520 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 10:58:11.628520 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 10:58:11.628520 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 10:58:11.630036 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 10:58:11.630036 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:11.630036 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:11.630036 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:11.630036 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:11.630036 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:11.630036 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:11.630036 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:11.630036 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:11.630036 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:11.630036 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:11.630036 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:11.630036 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:11.630036 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:11.630036 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:11.630036 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:11.630036 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:11.630930 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 10:58:11.630930 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 10:58:11.630930 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 10:58:11.630930 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 10:58:11.630930 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 10:58:11.630930 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 10:58:11.630930 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:58:11.630930 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:11.630930 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 246/482] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Oct 13 10:58:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:11.636471 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2233f45a-a858-499d-a6d3-f858dbf5a17b None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:11.694794 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4a5fd1-5e12-43f8-bd55-9953857f1864 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:11.733262 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054d13d1-44fb-45e9-8dbb-6a45fdc72862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:11.734248 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d13d1-44fb-45e9-8dbb-6a45fdc72862 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:11.734752 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d13d1-44fb-45e9-8dbb-6a45fdc72862 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:11.735232 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d13d1-44fb-45e9-8dbb-6a45fdc72862 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:11.743201 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2233f45a-a858-499d-a6d3-f858dbf5a17b None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:11.744336 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054d13d1-44fb-45e9-8dbb-6a45fdc72862 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:11.746258 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054d13d1-44fb-45e9-8dbb-6a45fdc72862 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:11.759351 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-054d13d1-44fb-45e9-8dbb-6a45fdc72862 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:58:11.759351 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:11.759351 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:11.759351 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:11.759351 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:11.759351 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:11.759351 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:11.759351 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:11.759351 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:11.759351 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:11.759351 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:11.759351 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:11.759351 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 10:58:11.759351 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 10:58:11.759351 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 10:58:11.760208 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 10:58:11.760208 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:11.760208 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:11.760208 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:11.760208 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:11.760208 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:11.760208 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:11.760208 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:11.760208 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:11.760208 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:11.760208 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:11.760208 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:11.760208 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:11.760208 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:11.760208 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:11.760208 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:11.760208 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:11.761023 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 10:58:11.761023 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 10:58:11.761023 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 10:58:11.761023 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 10:58:11.761023 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 10:58:11.761023 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 10:58:11.761023 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:58:11.761023 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:11.763552 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 237/483] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Oct 13 10:58:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:11.775064 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054d13d1-44fb-45e9-8dbb-6a45fdc72862 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:11.786658 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:11.818936 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d47c80-c4ea-4a31-a7a8-54e0f710c761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:11.822386 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d47c80-c4ea-4a31-a7a8-54e0f710c761 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:11.822997 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d47c80-c4ea-4a31-a7a8-54e0f710c761 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:11.825168 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d47c80-c4ea-4a31-a7a8-54e0f710c761 None admin] PATH_INFO: `/v3/projects` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:11.826370 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d47c80-c4ea-4a31-a7a8-54e0f710c761 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:11.826926 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d47c80-c4ea-4a31-a7a8-54e0f710c761 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:11.830083 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d47c80-c4ea-4a31-a7a8-54e0f710c761 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:11.865238 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 247/484] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Oct 13 10:58:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:11.871375 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d47c80-c4ea-4a31-a7a8-54e0f710c761 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:11.899523 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:11.958349 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054d13d1-44fb-45e9-8dbb-6a45fdc72862 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:11.993760 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941c5b9c-3958-44bc-8237-c3e6db7a9114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:11.994415 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c5b9c-3958-44bc-8237-c3e6db7a9114 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:11.994691 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c5b9c-3958-44bc-8237-c3e6db7a9114 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:11.994961 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c5b9c-3958-44bc-8237-c3e6db7a9114 None admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:11.995650 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941c5b9c-3958-44bc-8237-c3e6db7a9114 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:11.995953 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941c5b9c-3958-44bc-8237-c3e6db7a9114 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:11.997454 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941c5b9c-3958-44bc-8237-c3e6db7a9114 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:11.999944 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d47c80-c4ea-4a31-a7a8-54e0f710c761 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:12.012922 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 238/485] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Oct 13 10:58:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:12.014192 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3d3f5-68ad-41c4-9b63-30ad16e0149d None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:12.014475 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3d3f5-68ad-41c4-9b63-30ad16e0149d None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:12.014746 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3d3f5-68ad-41c4-9b63-30ad16e0149d None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:12.020705 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 239/486] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:58:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:12.020705 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5934f228-a940-4fb8-b7b1-b859d62372b9 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:12.020705 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5934f228-a940-4fb8-b7b1-b859d62372b9 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:12.020705 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5934f228-a940-4fb8-b7b1-b859d62372b9 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:12.020705 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 240/487] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:58:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:12.020705 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5934f228-a940-4fb8-b7b1-b859d62372b9 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:12.043516 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ececcf-37cf-48f5-a222-9ee91f053348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:12.044123 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ececcf-37cf-48f5-a222-9ee91f053348 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:12.044400 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ececcf-37cf-48f5-a222-9ee91f053348 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:12.044695 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ececcf-37cf-48f5-a222-9ee91f053348 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:12.045423 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ececcf-37cf-48f5-a222-9ee91f053348 None admin] RBAC: Adding query filter params (role.id=409a58470d23473abb676acf7c1095ae, scope.project.id=85bfac5f03e24fb3870a59a6b52dba6e, user.id=085e8bffed444287bc5f805461c3fb55) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:12.045722 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ececcf-37cf-48f5-a222-9ee91f053348 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:12.047173 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ececcf-37cf-48f5-a222-9ee91f053348 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:12.053071 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 248/488] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Oct 13 10:58:11 2022] GET /identity/v3/role_assignments?user.id=085e8bffed444287bc5f805461c3fb55&scope.project.id=85bfac5f03e24fb3870a59a6b52dba6e&role.id=409a58470d23473abb676acf7c1095ae => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:58:12.054323 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b736b8ca-ab04-4925-9dfd-39b4df136ded None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:12.054534 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b736b8ca-ab04-4925-9dfd-39b4df136ded None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:12.054785 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b736b8ca-ab04-4925-9dfd-39b4df136ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:12.078685 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-b736b8ca-ab04-4925-9dfd-39b4df136ded None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:12.080255 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-b736b8ca-ab04-4925-9dfd-39b4df136ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:12.099130 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:12.146085 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5934f228-a940-4fb8-b7b1-b859d62372b9 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:12.178495 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 249/489] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:58:12.179953 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea3f94-461f-4a98-9645-b023d90f6eb2 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:12.180267 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea3f94-461f-4a98-9645-b023d90f6eb2 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:12.180631 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea3f94-461f-4a98-9645-b023d90f6eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:12.193444 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522852ed-990c-48be-87f6-97cbc300ae2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:12.194824 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522852ed-990c-48be-87f6-97cbc300ae2e None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:12.196891 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522852ed-990c-48be-87f6-97cbc300ae2e None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:12.197414 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522852ed-990c-48be-87f6-97cbc300ae2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:12.198413 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522852ed-990c-48be-87f6-97cbc300ae2e None admin] RBAC: Adding query filter params (role.id=409a58470d23473abb676acf7c1095ae, scope.project.id=85bfac5f03e24fb3870a59a6b52dba6e, user.id=399f7d3700a24cb486e56b409a6e5429) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:12.199178 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522852ed-990c-48be-87f6-97cbc300ae2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:12.201544 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522852ed-990c-48be-87f6-97cbc300ae2e None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:12.214772 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 241/490] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Oct 13 10:58:12 2022] GET /identity/v3/role_assignments?user.id=399f7d3700a24cb486e56b409a6e5429&scope.project.id=85bfac5f03e24fb3870a59a6b52dba6e&role.id=409a58470d23473abb676acf7c1095ae => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:12.230006 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-e4ea3f94-461f-4a98-9645-b023d90f6eb2 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:12.231689 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-e4ea3f94-461f-4a98-9645-b023d90f6eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:12.242996 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:12.321923 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 250/491] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:58:12.502822 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522852ed-990c-48be-87f6-97cbc300ae2e None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:12.608861 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522852ed-990c-48be-87f6-97cbc300ae2e None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:12.621972 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ea3f94-461f-4a98-9645-b023d90f6eb2 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:12.648313 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:12.657992 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b0a421-e5af-4bad-9705-88cb3391c47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:12.658631 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b0a421-e5af-4bad-9705-88cb3391c47c None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:12.658905 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b0a421-e5af-4bad-9705-88cb3391c47c None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:12.659172 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b0a421-e5af-4bad-9705-88cb3391c47c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:12.672431 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b0a421-e5af-4bad-9705-88cb3391c47c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:58:12.679690 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-08b0a421-e5af-4bad-9705-88cb3391c47c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 10:58:12.679690 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:12.679690 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:12.679690 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:12.679690 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:12.679690 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:12.679690 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:12.679690 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:12.679690 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:12.679690 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:12.679690 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:12.679690 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:12.679690 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:58:12.679690 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:58:12.679690 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:58:12.679690 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:58:12.680597 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:58:12.680597 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:58:12.680597 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:58:12.680597 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:58:12.680597 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:12.680597 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:12.680597 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:12.680597 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:12.680597 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:12.680597 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:12.680597 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:12.680597 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:12.680597 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:12.680597 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:12.680597 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:12.680597 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:12.681521 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:12.681521 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:12.681521 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:12.681521 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:12.681521 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:58:12.681521 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:58:12.681521 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:58:12.681521 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:58:12.681521 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:58:12.681521 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:58:12.681521 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 10:58:12.681521 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:12.681521 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 242/492] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Oct 13 10:58:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:12.687190 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b0a421-e5af-4bad-9705-88cb3391c47c None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:12.749231 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ea3f94-461f-4a98-9645-b023d90f6eb2 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:12.789666 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88829094-ef6d-47ac-ad16-c1cdd44780b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:12.790397 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88829094-ef6d-47ac-ad16-c1cdd44780b3 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:12.790674 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88829094-ef6d-47ac-ad16-c1cdd44780b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:12.790962 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88829094-ef6d-47ac-ad16-c1cdd44780b3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:12.801363 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88829094-ef6d-47ac-ad16-c1cdd44780b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:58:12.806372 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-88829094-ef6d-47ac-ad16-c1cdd44780b3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 13 10:58:12.806372 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:12.806372 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:12.806372 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:12.806372 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:12.806372 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:12.806372 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:12.806372 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:12.806372 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:12.806372 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:12.806372 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:12.806372 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:12.806372 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:58:12.806372 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:58:12.806372 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:58:12.806372 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:58:12.807289 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:58:12.807289 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:58:12.807289 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:58:12.807289 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:58:12.807289 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:12.807289 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:12.807289 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:12.807289 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:12.807289 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:12.807289 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:12.807289 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:12.807289 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:12.807289 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:12.807289 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:12.807289 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:12.807289 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:12.809198 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:12.809198 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:12.809198 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:12.809198 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:12.809198 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:58:12.809198 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:58:12.809198 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:58:12.809198 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:58:12.809198 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:58:12.809198 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:58:12.809198 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 13 10:58:12.809198 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:12.809198 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 251/493] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Oct 13 10:58:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:12.813329 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88829094-ef6d-47ac-ad16-c1cdd44780b3 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:12.821182 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b0a421-e5af-4bad-9705-88cb3391c47c None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:12.823361 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:12.877438 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a3db4e-305c-4d62-8167-daa5cccd0b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:12.877984 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3db4e-305c-4d62-8167-daa5cccd0b1f None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:12.878268 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3db4e-305c-4d62-8167-daa5cccd0b1f None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:12.878544 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3db4e-305c-4d62-8167-daa5cccd0b1f None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:12.879746 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a3db4e-305c-4d62-8167-daa5cccd0b1f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:12.880053 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a3db4e-305c-4d62-8167-daa5cccd0b1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:12.881448 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a3db4e-305c-4d62-8167-daa5cccd0b1f None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:12.904866 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 243/494] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 10:58:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:58:12.910622 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a3db4e-305c-4d62-8167-daa5cccd0b1f None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:12.966913 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88829094-ef6d-47ac-ad16-c1cdd44780b3 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:13.011153 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:13.037922 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f34309d-9916-4c25-bea2-718865a84731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:13.038554 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f34309d-9916-4c25-bea2-718865a84731 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:13.038833 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f34309d-9916-4c25-bea2-718865a84731 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:13.039108 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f34309d-9916-4c25-bea2-718865a84731 None admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:13.039782 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f34309d-9916-4c25-bea2-718865a84731 None admin] RBAC: Adding query filter params (name=service) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:13.040085 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f34309d-9916-4c25-bea2-718865a84731 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:13.041466 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f34309d-9916-4c25-bea2-718865a84731 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:13.065855 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 252/495] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Oct 13 10:58:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:58:13.070525 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f34309d-9916-4c25-bea2-718865a84731 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:13.092327 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a3db4e-305c-4d62-8167-daa5cccd0b1f None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:13.135917 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50d6cf1-ec65-4a6d-85fa-813f38040eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:13.136479 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d6cf1-ec65-4a6d-85fa-813f38040eb2 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:13.136753 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d6cf1-ec65-4a6d-85fa-813f38040eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:13.137024 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d6cf1-ec65-4a6d-85fa-813f38040eb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:13.155056 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50d6cf1-ec65-4a6d-85fa-813f38040eb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:13.156569 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50d6cf1-ec65-4a6d-85fa-813f38040eb2 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:13.171462 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-f50d6cf1-ec65-4a6d-85fa-813f38040eb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:13.171462 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:13.171462 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:13.171462 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:13.171462 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:13.171462 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:13.171462 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:13.171462 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:13.171462 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:13.171462 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:13.171462 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:13.171462 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:13.171462 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:13.171462 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:13.171462 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:13.171462 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:13.172472 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:13.172472 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:13.172472 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:13.172472 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:13.172472 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:13.172472 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:13.172472 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:13.172472 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:13.172472 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:13.172472 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:13.172472 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:13.172472 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:13.172472 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:13.172472 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:13.172472 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:13.172472 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:13.172472 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:13.173386 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:13.173386 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:13.173386 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:13.173386 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 244/496] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:13.183031 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50d6cf1-ec65-4a6d-85fa-813f38040eb2 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:13.243225 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:13.292476 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50d6cf1-ec65-4a6d-85fa-813f38040eb2 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:13.314314 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:13.331032 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5077b3d9-cde6-4e3c-a7f2-8187ac23fbb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:13.332537 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5077b3d9-cde6-4e3c-a7f2-8187ac23fbb6 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:13.333009 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5077b3d9-cde6-4e3c-a7f2-8187ac23fbb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:13.333421 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5077b3d9-cde6-4e3c-a7f2-8187ac23fbb6 None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:13.334233 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5077b3d9-cde6-4e3c-a7f2-8187ac23fbb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:13.334700 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5077b3d9-cde6-4e3c-a7f2-8187ac23fbb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:13.336252 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5077b3d9-cde6-4e3c-a7f2-8187ac23fbb6 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:13.349704 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 245/497] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:13.356020 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5077b3d9-cde6-4e3c-a7f2-8187ac23fbb6 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:13.396031 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f34309d-9916-4c25-bea2-718865a84731 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:13.462102 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5077b3d9-cde6-4e3c-a7f2-8187ac23fbb6 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:13.474639 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73bd6f4-cb0c-48d7-a5ff-d5a4946844e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:13.475288 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73bd6f4-cb0c-48d7-a5ff-d5a4946844e6 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:13.475573 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73bd6f4-cb0c-48d7-a5ff-d5a4946844e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:13.475849 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73bd6f4-cb0c-48d7-a5ff-d5a4946844e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:13.493529 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73bd6f4-cb0c-48d7-a5ff-d5a4946844e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:13.494996 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73bd6f4-cb0c-48d7-a5ff-d5a4946844e6 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:13.502925 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a14b0-4b7b-4012-8094-c065777cdd14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:13.507507 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a14b0-4b7b-4012-8094-c065777cdd14 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:13.507962 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a14b0-4b7b-4012-8094-c065777cdd14 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:13.508461 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a14b0-4b7b-4012-8094-c065777cdd14 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:13.520344 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-f73bd6f4-cb0c-48d7-a5ff-d5a4946844e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:13.520344 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:13.520344 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:13.520344 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:13.520344 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:13.520344 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:13.520344 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:13.520344 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:13.520344 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:13.520344 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:13.520344 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:13.520344 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:13.520344 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:13.520344 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:13.520344 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:13.520344 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:13.521468 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:13.521468 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:13.521468 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:13.521468 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:13.521468 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:13.521468 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:13.521468 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:13.521468 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:13.521468 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:13.521468 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:13.521468 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:13.521468 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:13.521468 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:13.521468 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:13.521468 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:13.521468 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:13.521468 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:13.522646 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:13.522646 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:13.522646 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:13.524340 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 253/498] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 454 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:13.530285 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4a14b0-4b7b-4012-8094-c065777cdd14 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:13.530990 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73bd6f4-cb0c-48d7-a5ff-d5a4946844e6 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:13.531763 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4a14b0-4b7b-4012-8094-c065777cdd14 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:13.557996 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-2d4a14b0-4b7b-4012-8094-c065777cdd14 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 13 10:58:13.557996 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:13.557996 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:13.557996 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:13.557996 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:13.557996 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:13.557996 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:13.557996 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:13.557996 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:13.557996 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:13.557996 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:13.557996 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:13.557996 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 10:58:13.557996 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 10:58:13.557996 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 10:58:13.557996 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 10:58:13.559189 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:13.559189 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:13.559189 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 10:58:13.559189 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:13.559189 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 10:58:13.559189 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:13.559189 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:13.559189 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:13.559189 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:13.559189 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:13.559189 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:13.559189 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:13.559189 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:13.559189 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:13.559189 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:13.559189 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:13.559189 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:13.559189 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:13.560128 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:13.560128 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:13.560128 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 10:58:13.560128 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 10:58:13.560128 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 10:58:13.560128 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 10:58:13.560128 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 10:58:13.560128 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 10:58:13.560128 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 13 10:58:13.560128 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:13.560128 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 246/499] 10.222.0.25 () {56 vars in 1093 bytes} [Thu Oct 13 10:58:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 10:58:13.561219 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a14b0-4b7b-4012-8094-c065777cdd14 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:13.594296 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:13.683299 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73bd6f4-cb0c-48d7-a5ff-d5a4946844e6 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:13.702974 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:13.717725 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b32f2a-58d3-45a0-b83e-ed775434e2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:13.718367 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b32f2a-58d3-45a0-b83e-ed775434e2ea None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:13.718647 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b32f2a-58d3-45a0-b83e-ed775434e2ea None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:13.718917 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b32f2a-58d3-45a0-b83e-ed775434e2ea None admin] PATH_INFO: `/v3/domains` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:13.719559 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b32f2a-58d3-45a0-b83e-ed775434e2ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:13.719861 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b32f2a-58d3-45a0-b83e-ed775434e2ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:13.721211 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b32f2a-58d3-45a0-b83e-ed775434e2ea None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:13.733359 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 254/500] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:13.739938 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b32f2a-58d3-45a0-b83e-ed775434e2ea None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:13.788933 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a14b0-4b7b-4012-8094-c065777cdd14 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:13.850950 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b32f2a-58d3-45a0-b83e-ed775434e2ea None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:13.876184 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5de55-ef80-4460-93b2-5e4d35f60702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:13.877840 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5de55-ef80-4460-93b2-5e4d35f60702 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:13.878459 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5de55-ef80-4460-93b2-5e4d35f60702 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:13.879473 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5de55-ef80-4460-93b2-5e4d35f60702 None admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:13.880427 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec5de55-ef80-4460-93b2-5e4d35f60702 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:13.880947 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec5de55-ef80-4460-93b2-5e4d35f60702 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:13.882678 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec5de55-ef80-4460-93b2-5e4d35f60702 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:13.914507 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c8c251-879e-4a39-a898-7df75a895bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:13.915518 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8c251-879e-4a39-a898-7df75a895bf0 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:13.915993 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8c251-879e-4a39-a898-7df75a895bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:13.916458 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8c251-879e-4a39-a898-7df75a895bf0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:13.923502 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 247/501] 10.222.0.25 () {56 vars in 1133 bytes} [Thu Oct 13 10:58:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:58:13.929748 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5de55-ef80-4460-93b2-5e4d35f60702 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:13.931111 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c8c251-879e-4a39-a898-7df75a895bf0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:13.933115 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c8c251-879e-4a39-a898-7df75a895bf0 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:13.963540 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-16c8c251-879e-4a39-a898-7df75a895bf0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 13 10:58:13.963540 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:13.963540 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:13.963540 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:13.963540 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:13.963540 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:13.963540 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:13.963540 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:13.963540 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:13.963540 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:13.963540 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:13.963540 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:13.963540 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 10:58:13.963540 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 10:58:13.963540 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 10:58:13.963540 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 10:58:13.964565 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:13.964565 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:13.964565 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 10:58:13.964565 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:13.964565 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 10:58:13.964565 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:13.964565 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:13.964565 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:13.964565 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:13.964565 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:13.964565 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:13.964565 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:13.964565 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:13.964565 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:13.964565 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:13.964565 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:13.964565 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:13.964565 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:13.965491 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:13.965491 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:13.965491 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 10:58:13.965491 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 10:58:13.965491 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 10:58:13.965491 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 10:58:13.965491 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 10:58:13.965491 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 10:58:13.965491 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 13 10:58:13.965491 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:13.965491 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 255/502] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Oct 13 10:58:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 10:58:13.974942 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c8c251-879e-4a39-a898-7df75a895bf0 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:14.032943 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:14.037790 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:14.059146 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5de55-ef80-4460-93b2-5e4d35f60702 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:14.094806 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895d7af9-3a6c-426c-873b-d7ae39da8db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:14.095785 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d7af9-3a6c-426c-873b-d7ae39da8db3 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:14.096285 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d7af9-3a6c-426c-873b-d7ae39da8db3 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:14.096780 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d7af9-3a6c-426c-873b-d7ae39da8db3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:14.120331 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895d7af9-3a6c-426c-873b-d7ae39da8db3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:14.123011 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895d7af9-3a6c-426c-873b-d7ae39da8db3 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:14.148168 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c8c251-879e-4a39-a898-7df75a895bf0 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:14.150608 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-895d7af9-3a6c-426c-873b-d7ae39da8db3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:14.150608 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:14.150608 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:14.150608 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:14.150608 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:14.150608 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:14.150608 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:14.150608 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:14.150608 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:14.150608 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:14.150608 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:14.150608 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:14.150608 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:14.150608 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:14.150608 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:14.150608 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:14.151503 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:14.151503 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:14.151503 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:14.151503 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:14.151503 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:14.151503 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:14.151503 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:14.151503 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:14.151503 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:14.151503 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:14.151503 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:14.151503 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:14.151503 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:14.151503 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:14.151503 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:14.151503 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:14.151503 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:14.152452 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:14.152452 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:14.152452 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:14.152452 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 248/503] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 10:58:14.157316 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895d7af9-3a6c-426c-873b-d7ae39da8db3 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:14.215382 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2465b9e5-b3a9-44c9-884f-a585701d2a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:14.217085 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2465b9e5-b3a9-44c9-884f-a585701d2a40 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:14.217749 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2465b9e5-b3a9-44c9-884f-a585701d2a40 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:14.218764 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2465b9e5-b3a9-44c9-884f-a585701d2a40 None admin] PATH_INFO: `/v3/users` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:14.220860 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2465b9e5-b3a9-44c9-884f-a585701d2a40 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:14.221437 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2465b9e5-b3a9-44c9-884f-a585701d2a40 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:14.225962 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2465b9e5-b3a9-44c9-884f-a585701d2a40 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:14.262681 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 256/504] 10.222.0.25 () {56 vars in 1135 bytes} [Thu Oct 13 10:58:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:14.270963 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2465b9e5-b3a9-44c9-884f-a585701d2a40 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:14.362678 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895d7af9-3a6c-426c-873b-d7ae39da8db3 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:14.404754 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfb6b6a-1516-4893-9c87-63c78a6402ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:14.405364 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfb6b6a-1516-4893-9c87-63c78a6402ff None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:14.405802 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfb6b6a-1516-4893-9c87-63c78a6402ff None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:14.406125 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfb6b6a-1516-4893-9c87-63c78a6402ff None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:14.407233 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfb6b6a-1516-4893-9c87-63c78a6402ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:14.407671 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfb6b6a-1516-4893-9c87-63c78a6402ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:14.408552 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:14.409031 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfb6b6a-1516-4893-9c87-63c78a6402ff None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:14.411305 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:14.419528 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2465b9e5-b3a9-44c9-884f-a585701d2a40 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:14.430039 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 249/505] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:58:14.431385 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a4faa-f701-4ff1-8a5d-b9098378b82d None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:14.431661 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a4faa-f701-4ff1-8a5d-b9098378b82d None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:14.431927 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a4faa-f701-4ff1-8a5d-b9098378b82d None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:14.435524 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 250/506] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:58:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:14.437541 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8a4faa-f701-4ff1-8a5d-b9098378b82d None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:14.474402 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12e8f67-96ae-4541-8860-3d81059c8756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:14.475588 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e8f67-96ae-4541-8860-3d81059c8756 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:14.475885 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e8f67-96ae-4541-8860-3d81059c8756 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:14.476165 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e8f67-96ae-4541-8860-3d81059c8756 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:14.571676 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8a4faa-f701-4ff1-8a5d-b9098378b82d None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:14.571904 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12e8f67-96ae-4541-8860-3d81059c8756 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:14.573452 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12e8f67-96ae-4541-8860-3d81059c8756 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:14.607258 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c10ee7d-3177-49c9-8920-5a165bd20523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:14.607890 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10ee7d-3177-49c9-8920-5a165bd20523 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:14.608169 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10ee7d-3177-49c9-8920-5a165bd20523 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:14.608447 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10ee7d-3177-49c9-8920-5a165bd20523 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:14.615421 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c10ee7d-3177-49c9-8920-5a165bd20523 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:14.616868 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c10ee7d-3177-49c9-8920-5a165bd20523 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:14.628156 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-0c10ee7d-3177-49c9-8920-5a165bd20523 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:58:14.628156 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:14.628156 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:14.628156 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:14.628156 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:14.628156 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:14.628156 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:14.628156 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:14.628156 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:14.628156 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:14.628156 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:14.628156 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:14.628156 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 10:58:14.628156 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 10:58:14.628156 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 10:58:14.629020 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 10:58:14.629020 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:14.629020 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:14.629020 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:14.629020 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:14.629020 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:14.629020 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:14.629020 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:14.629020 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:14.629020 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:14.629020 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:14.629020 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:14.629020 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:14.629020 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:14.629020 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:14.629020 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:14.629020 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:14.629885 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 10:58:14.629885 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 10:58:14.629885 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 10:58:14.629885 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 10:58:14.629885 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 10:58:14.629885 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 10:58:14.629885 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:58:14.629885 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:14.629885 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 251/507] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Oct 13 10:58:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:14.630792 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23930ac-afd4-4b2f-8cb1-c95eb428c128 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:14.630792 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23930ac-afd4-4b2f-8cb1-c95eb428c128 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:14.631069 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23930ac-afd4-4b2f-8cb1-c95eb428c128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:14.649726 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-f23930ac-afd4-4b2f-8cb1-c95eb428c128 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:14.650946 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-f23930ac-afd4-4b2f-8cb1-c95eb428c128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:14.675581 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:14.688846 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 257/508] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Oct 13 10:58:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 13 10:58:14.688846 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d508bf9e-f7c1-4af6-b3e1-c152f4630574 None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:14.688846 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d508bf9e-f7c1-4af6-b3e1-c152f4630574 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:14.688846 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d508bf9e-f7c1-4af6-b3e1-c152f4630574 None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:14.688846 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 258/509] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:58:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:14.688846 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d508bf9e-f7c1-4af6-b3e1-c152f4630574 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:14.707374 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:14.725725 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 252/510] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:58:14.726398 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23930ac-afd4-4b2f-8cb1-c95eb428c128 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:14.822189 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d508bf9e-f7c1-4af6-b3e1-c152f4630574 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:14.830215 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23930ac-afd4-4b2f-8cb1-c95eb428c128 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:14.864303 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f820c16-52ec-4cf5-8280-980188c25346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:14.864932 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f820c16-52ec-4cf5-8280-980188c25346 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:14.865213 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f820c16-52ec-4cf5-8280-980188c25346 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:14.865541 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f820c16-52ec-4cf5-8280-980188c25346 None admin] PATH_INFO: `/v3/projects` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:14.866505 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f820c16-52ec-4cf5-8280-980188c25346 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:14.866957 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f820c16-52ec-4cf5-8280-980188c25346 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:14.868587 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f820c16-52ec-4cf5-8280-980188c25346 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:14.881342 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506fd376-4a78-4822-8eb4-1ae38feb8006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:14.882087 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 259/511] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Oct 13 10:58:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:14.882801 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506fd376-4a78-4822-8eb4-1ae38feb8006 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:14.883197 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2fae75-3127-46e4-a018-fadd7e49a4ab None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:14.883501 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506fd376-4a78-4822-8eb4-1ae38feb8006 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:14.883615 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2fae75-3127-46e4-a018-fadd7e49a4ab None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:14.883782 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2fae75-3127-46e4-a018-fadd7e49a4ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:14.884231 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506fd376-4a78-4822-8eb4-1ae38feb8006 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:14.897604 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506fd376-4a78-4822-8eb4-1ae38feb8006 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:14.899346 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506fd376-4a78-4822-8eb4-1ae38feb8006 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:14.907633 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-2e2fae75-3127-46e4-a018-fadd7e49a4ab None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:14.908538 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-2e2fae75-3127-46e4-a018-fadd7e49a4ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:14.917919 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-506fd376-4a78-4822-8eb4-1ae38feb8006 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:14.917919 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:14.917919 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:14.917919 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:14.917919 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:14.917919 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:14.917919 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:14.917919 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:14.917919 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:14.917919 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:14.917919 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:14.917919 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:14.917919 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:14.917919 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:14.917919 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:14.917919 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:14.918869 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:14.918869 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:14.918869 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:14.918869 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:14.918869 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:14.918869 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:14.918869 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:14.918869 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:14.918869 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:14.918869 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:14.918869 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:14.918869 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:14.918869 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:14.918869 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:14.918869 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:14.918869 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:14.918869 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:14.919720 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:14.919720 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:14.919720 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:14.926887 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 253/512] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:14.926887 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506fd376-4a78-4822-8eb4-1ae38feb8006 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:14.968955 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:14.970807 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:14.989867 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 260/513] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:58:14.995101 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2fae75-3127-46e4-a018-fadd7e49a4ab None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:15.039124 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506fd376-4a78-4822-8eb4-1ae38feb8006 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:15.075720 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839428b0-830b-4f67-90f0-377d7d548fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:15.076370 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839428b0-830b-4f67-90f0-377d7d548fea None admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:15.076645 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839428b0-830b-4f67-90f0-377d7d548fea None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:15.077240 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839428b0-830b-4f67-90f0-377d7d548fea None admin] PATH_INFO: `/v3/projects/85bfac5f03e24fb3870a59a6b52dba6e/users/78384fbffdd346578855e7214b335d8e/roles/ea564961b1db4eb4a1d4d880964611b2` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:15.078825 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839428b0-830b-4f67-90f0-377d7d548fea None admin] RBAC: Authorizing `identity:create_grant(project_id=85bfac5f03e24fb3870a59a6b52dba6e, user_id=78384fbffdd346578855e7214b335d8e, role_id=ea564961b1db4eb4a1d4d880964611b2)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:15.080236 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839428b0-830b-4f67-90f0-377d7d548fea None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:15.096978 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 254/514] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Oct 13 10:58:14 2022] PUT /identity/v3/projects/85bfac5f03e24fb3870a59a6b52dba6e/users/78384fbffdd346578855e7214b335d8e/roles/ea564961b1db4eb4a1d4d880964611b2 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 10:58:15.099072 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3846c-5ac6-4e4d-97d4-5e29a55d1bca None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:15.099563 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3846c-5ac6-4e4d-97d4-5e29a55d1bca None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:15.100066 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3846c-5ac6-4e4d-97d4-5e29a55d1bca None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:15.101574 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 255/515] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:58:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:15.102580 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e3846c-5ac6-4e4d-97d4-5e29a55d1bca None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:15.111602 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2fae75-3127-46e4-a018-fadd7e49a4ab None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:15.150996 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1474d5d-fd58-43d1-b1da-302ae03bbc45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:15.151624 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1474d5d-fd58-43d1-b1da-302ae03bbc45 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:15.151901 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1474d5d-fd58-43d1-b1da-302ae03bbc45 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:15.152170 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1474d5d-fd58-43d1-b1da-302ae03bbc45 None admin] PATH_INFO: `/v3/domains` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:15.152958 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1474d5d-fd58-43d1-b1da-302ae03bbc45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:15.153273 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1474d5d-fd58-43d1-b1da-302ae03bbc45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:15.154684 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1474d5d-fd58-43d1-b1da-302ae03bbc45 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:15.167850 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 261/516] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:15.169350 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45aa4ef-a9d5-4c02-9d0d-01d04c2be538 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:15.169639 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45aa4ef-a9d5-4c02-9d0d-01d04c2be538 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:15.169911 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45aa4ef-a9d5-4c02-9d0d-01d04c2be538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:15.192267 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-e45aa4ef-a9d5-4c02-9d0d-01d04c2be538 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:15.193929 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-e45aa4ef-a9d5-4c02-9d0d-01d04c2be538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:15.229667 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:15.241414 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e3846c-5ac6-4e4d-97d4-5e29a55d1bca None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:15.243688 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:15.279010 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 262/517] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:58:15.280459 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45aa4ef-a9d5-4c02-9d0d-01d04c2be538 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:15.296445 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ce4d8c-671a-41a0-ad10-3744542a52f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:15.297476 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce4d8c-671a-41a0-ad10-3744542a52f1 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:15.297757 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce4d8c-671a-41a0-ad10-3744542a52f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:15.298738 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce4d8c-671a-41a0-ad10-3744542a52f1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:15.298940 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ce4d8c-671a-41a0-ad10-3744542a52f1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:15.301314 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ce4d8c-671a-41a0-ad10-3744542a52f1 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:15.313680 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-b7ce4d8c-671a-41a0-ad10-3744542a52f1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 13 10:58:15.313680 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:15.313680 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 10:58:15.313680 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 10:58:15.313680 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 10:58:15.313680 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 10:58:15.313680 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 10:58:15.313680 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:15.313680 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 13 10:58:15.313680 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:15.313680 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 10:58:15.313680 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:15.313680 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:15.313680 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:15.313680 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:15.313680 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:15.313680 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:15.314719 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:15.314719 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:15.314719 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:15.314719 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:15.314719 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:15.314719 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:15.314719 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 10:58:15.314719 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 10:58:15.314719 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 10:58:15.314719 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 10:58:15.314719 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:15.314719 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:15.314719 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:15.314719 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:15.314719 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:15.314719 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:15.315565 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:15.315565 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:15.315565 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:15.315565 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:15.315565 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:15.315565 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:15.315565 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:15.315565 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:15.315565 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:15.315565 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:15.315565 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 10:58:15.315565 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:15.315565 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 13 10:58:15.315565 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:15.315565 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 256/518] 10.222.0.25 () {56 vars in 1129 bytes} [Thu Oct 13 10:58:15 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:15.316444 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ce4d8c-671a-41a0-ad10-3744542a52f1 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:15.392323 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45aa4ef-a9d5-4c02-9d0d-01d04c2be538 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:15.420246 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ce4d8c-671a-41a0-ad10-3744542a52f1 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:15.432181 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687fc693-35d0-4574-9d1b-cc70e131417a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:15.433411 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687fc693-35d0-4574-9d1b-cc70e131417a None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:15.434097 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687fc693-35d0-4574-9d1b-cc70e131417a None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:15.434705 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687fc693-35d0-4574-9d1b-cc70e131417a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:15.443536 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687fc693-35d0-4574-9d1b-cc70e131417a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:15.445654 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687fc693-35d0-4574-9d1b-cc70e131417a None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:15.456421 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2556fa6-da5b-4486-8739-018d75fda861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:15.457602 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2556fa6-da5b-4486-8739-018d75fda861 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:15.457930 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2556fa6-da5b-4486-8739-018d75fda861 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:15.458260 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2556fa6-da5b-4486-8739-018d75fda861 None admin] PATH_INFO: `/v3/services/network` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:15.458895 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2556fa6-da5b-4486-8739-018d75fda861 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:15.460255 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2556fa6-da5b-4486-8739-018d75fda861 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:15.461661 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-687fc693-35d0-4574-9d1b-cc70e131417a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:58:15.461661 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:15.461661 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:15.461661 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:15.461661 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:15.461661 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:15.461661 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:15.461661 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:15.461661 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:15.461661 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:15.461661 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:15.461661 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:15.461661 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 10:58:15.461661 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 10:58:15.461661 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 10:58:15.462548 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 10:58:15.462548 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:15.462548 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:15.462548 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:15.462548 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:15.462548 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:15.462548 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:15.462548 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:15.462548 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:15.462548 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:15.462548 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:15.462548 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:15.462548 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:15.462548 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:15.462548 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:15.462548 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:15.462548 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:15.463434 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 10:58:15.463434 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 10:58:15.463434 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 10:58:15.463434 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 10:58:15.463434 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 10:58:15.463434 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 10:58:15.463434 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:58:15.463434 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:15.463853 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 263/519] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Oct 13 10:58:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:15.464510 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687fc693-35d0-4574-9d1b-cc70e131417a None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:15.474051 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-d2556fa6-da5b-4486-8739-018d75fda861 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 13 10:58:15.474051 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:15.474051 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 10:58:15.474051 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 10:58:15.474051 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 10:58:15.474051 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 10:58:15.474051 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 10:58:15.474051 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:15.474051 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 13 10:58:15.474051 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:15.474051 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 10:58:15.474051 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:15.474051 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:15.474051 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:15.474051 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:15.474051 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:15.474051 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:15.475083 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:15.475083 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:15.475083 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:15.475083 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:15.475083 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:15.475083 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:15.475083 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 10:58:15.475083 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 10:58:15.475083 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 10:58:15.475083 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 10:58:15.475083 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:15.475083 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:15.475083 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:15.475083 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:15.475083 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:15.475083 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:15.475933 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:15.475933 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:15.475933 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:15.475933 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:15.475933 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:15.475933 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:15.475933 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:15.475933 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:15.475933 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:15.475933 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:15.475933 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 10:58:15.475933 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:15.475933 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 13 10:58:15.475933 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:15.475933 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 257/520] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Oct 13 10:58:15 2022] GET /identity/v3/services/network => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:15.476736 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2556fa6-da5b-4486-8739-018d75fda861 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:15.507383 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:15.516808 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:15.595653 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2556fa6-da5b-4486-8739-018d75fda861 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:15.600061 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687fc693-35d0-4574-9d1b-cc70e131417a None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:15.633189 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d5f6e-60fb-4b78-98ad-bce5add2d6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:15.633796 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d5f6e-60fb-4b78-98ad-bce5add2d6a1 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:15.634102 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d5f6e-60fb-4b78-98ad-bce5add2d6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:15.634285 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628a0eb4-d81f-452b-bf7a-48e0762367bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:15.634419 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d5f6e-60fb-4b78-98ad-bce5add2d6a1 None admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:15.634879 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a0eb4-d81f-452b-bf7a-48e0762367bd None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:15.635039 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51d5f6e-60fb-4b78-98ad-bce5add2d6a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:15.635190 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a0eb4-d81f-452b-bf7a-48e0762367bd None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:15.635348 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51d5f6e-60fb-4b78-98ad-bce5add2d6a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:15.635439 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a0eb4-d81f-452b-bf7a-48e0762367bd None admin] PATH_INFO: `/v3/services` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:15.636032 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628a0eb4-d81f-452b-bf7a-48e0762367bd None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:15.636333 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628a0eb4-d81f-452b-bf7a-48e0762367bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:15.636760 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51d5f6e-60fb-4b78-98ad-bce5add2d6a1 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:15.637667 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628a0eb4-d81f-452b-bf7a-48e0762367bd None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:15.642070 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 264/521] 10.222.0.25 () {56 vars in 1124 bytes} [Thu Oct 13 10:58:15 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:15.647629 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628a0eb4-d81f-452b-bf7a-48e0762367bd None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:15.654127 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 258/522] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Oct 13 10:58:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:15.654127 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d5f6e-60fb-4b78-98ad-bce5add2d6a1 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:15.737825 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:15.750072 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:15.755062 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628a0eb4-d81f-452b-bf7a-48e0762367bd None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:15.755404 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d5f6e-60fb-4b78-98ad-bce5add2d6a1 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:15.789910 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08969527-bcf4-4bfe-988d-ef6f33edf9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:15.790359 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fa2df2-2542-4b09-a810-0556006b98f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:15.790508 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08969527-bcf4-4bfe-988d-ef6f33edf9fb None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:15.790735 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08969527-bcf4-4bfe-988d-ef6f33edf9fb None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:15.790986 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa2df2-2542-4b09-a810-0556006b98f1 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:15.791093 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08969527-bcf4-4bfe-988d-ef6f33edf9fb None admin] PATH_INFO: `/v3/services` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:15.791268 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa2df2-2542-4b09-a810-0556006b98f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:15.791541 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa2df2-2542-4b09-a810-0556006b98f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:15.791645 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08969527-bcf4-4bfe-988d-ef6f33edf9fb None admin] RBAC: Adding query filter params (name=network) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:15.791910 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08969527-bcf4-4bfe-988d-ef6f33edf9fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:15.793324 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08969527-bcf4-4bfe-988d-ef6f33edf9fb None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:15.798066 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 265/523] 10.222.0.25 () {56 vars in 1112 bytes} [Thu Oct 13 10:58:15 2022] GET /identity/v3/services?name=network => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:15.798942 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08969527-bcf4-4bfe-988d-ef6f33edf9fb None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:15.806268 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fa2df2-2542-4b09-a810-0556006b98f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:15.807706 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fa2df2-2542-4b09-a810-0556006b98f1 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:15.822783 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-e8fa2df2-2542-4b09-a810-0556006b98f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:15.822783 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:15.822783 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:15.822783 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:15.822783 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:15.822783 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:15.822783 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:15.822783 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:15.822783 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:15.822783 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:15.822783 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:15.822783 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:15.822783 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:15.822783 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:15.822783 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:15.822783 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:15.823759 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:15.823759 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:15.823759 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:15.823759 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:15.823759 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:15.823759 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:15.823759 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:15.823759 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:15.823759 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:15.823759 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:15.823759 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:15.823759 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:15.823759 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:15.823759 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:15.823759 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:15.823759 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:15.823759 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:15.824619 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:15.824619 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:15.824619 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:15.826282 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 259/524] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:15.827669 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fa2df2-2542-4b09-a810-0556006b98f1 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:15.913709 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08969527-bcf4-4bfe-988d-ef6f33edf9fb None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:15.941311 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fa2df2-2542-4b09-a810-0556006b98f1 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:15.951058 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4921442e-0a64-4725-a6c0-717d6fa1a63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:15.951984 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4921442e-0a64-4725-a6c0-717d6fa1a63d None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:15.952416 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4921442e-0a64-4725-a6c0-717d6fa1a63d None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:15.952690 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4921442e-0a64-4725-a6c0-717d6fa1a63d None admin] PATH_INFO: `/v3/services` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:15.953322 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4921442e-0a64-4725-a6c0-717d6fa1a63d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:15.953708 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4921442e-0a64-4725-a6c0-717d6fa1a63d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:15.955009 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4921442e-0a64-4725-a6c0-717d6fa1a63d None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:15.961096 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 266/525] 10.222.0.25 () {56 vars in 1124 bytes} [Thu Oct 13 10:58:15 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:15.961881 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4921442e-0a64-4725-a6c0-717d6fa1a63d None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:15.987238 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca550bb-db88-4a63-a4ed-baa184912cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:15.988791 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca550bb-db88-4a63-a4ed-baa184912cec None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:15.989332 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca550bb-db88-4a63-a4ed-baa184912cec None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:15.989917 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca550bb-db88-4a63-a4ed-baa184912cec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:15.990911 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca550bb-db88-4a63-a4ed-baa184912cec None admin] RBAC: Adding query filter params (role.id=409a58470d23473abb676acf7c1095ae, scope.project.id=85bfac5f03e24fb3870a59a6b52dba6e, user.id=e24c779d0a604ef28dfc1235ee76a711) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:15.991484 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca550bb-db88-4a63-a4ed-baa184912cec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:15.993395 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca550bb-db88-4a63-a4ed-baa184912cec None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:15.997659 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:16.004709 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:16.011181 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 260/526] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Oct 13 10:58:15 2022] GET /identity/v3/role_assignments?user.id=e24c779d0a604ef28dfc1235ee76a711&scope.project.id=85bfac5f03e24fb3870a59a6b52dba6e&role.id=409a58470d23473abb676acf7c1095ae => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:16.011181 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca550bb-db88-4a63-a4ed-baa184912cec None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:16.168648 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4921442e-0a64-4725-a6c0-717d6fa1a63d None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:16.211412 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca550bb-db88-4a63-a4ed-baa184912cec None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:16.215438 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638b8776-f6c5-4ae8-84e8-6aeb7a48f1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:16.216058 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b8776-f6c5-4ae8-84e8-6aeb7a48f1c9 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:16.216337 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b8776-f6c5-4ae8-84e8-6aeb7a48f1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:16.216605 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b8776-f6c5-4ae8-84e8-6aeb7a48f1c9 None admin] PATH_INFO: `/v3/services` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:16.217239 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638b8776-f6c5-4ae8-84e8-6aeb7a48f1c9 None admin] RBAC: Adding query filter params (type=network) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:16.217538 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638b8776-f6c5-4ae8-84e8-6aeb7a48f1c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:16.219521 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638b8776-f6c5-4ae8-84e8-6aeb7a48f1c9 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:16.224998 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 267/527] 10.222.0.25 () {56 vars in 1112 bytes} [Thu Oct 13 10:58:15 2022] GET /identity/v3/services?type=network => generated 124 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:16.252311 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0061e5-fe38-4c7e-8f37-657b0df488db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:16.252941 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0061e5-fe38-4c7e-8f37-657b0df488db None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:16.253218 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0061e5-fe38-4c7e-8f37-657b0df488db None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:16.253588 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0061e5-fe38-4c7e-8f37-657b0df488db None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:16.254300 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0061e5-fe38-4c7e-8f37-657b0df488db None admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:16.254607 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0061e5-fe38-4c7e-8f37-657b0df488db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:16.256123 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0061e5-fe38-4c7e-8f37-657b0df488db None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:16.270588 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 261/528] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:16.275606 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638b8776-f6c5-4ae8-84e8-6aeb7a48f1c9 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:16.383541 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:16.394695 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638b8776-f6c5-4ae8-84e8-6aeb7a48f1c9 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:16.431153 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fa114e-de72-4742-ba06-6eca4e4b0ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:16.431744 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa114e-de72-4742-ba06-6eca4e4b0ecc None admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:16.432025 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa114e-de72-4742-ba06-6eca4e4b0ecc None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:16.432294 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa114e-de72-4742-ba06-6eca4e4b0ecc None admin] PATH_INFO: `/v3/users` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:16.432951 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fa114e-de72-4742-ba06-6eca4e4b0ecc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:16.434409 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fa114e-de72-4742-ba06-6eca4e4b0ecc None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:16.461867 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 268/529] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Oct 13 10:58:16 2022] POST /identity/v3/users => generated 254 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 10:58:17.483521 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a51aa07-cd01-475f-8182-48f3c224cef6 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:17.484083 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a51aa07-cd01-475f-8182-48f3c224cef6 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:17.484083 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a51aa07-cd01-475f-8182-48f3c224cef6 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:17.485757 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 262/530] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:58:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:17.508962 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8173af5-24b6-4c33-9a4d-42302c853545 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:17.509485 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8173af5-24b6-4c33-9a4d-42302c853545 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:17.514266 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8173af5-24b6-4c33-9a4d-42302c853545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:17.533461 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-c8173af5-24b6-4c33-9a4d-42302c853545 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:17.534695 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-c8173af5-24b6-4c33-9a4d-42302c853545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:17.604376 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 269/531] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:58:18.021748 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a51aa07-cd01-475f-8182-48f3c224cef6 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:18.091370 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:18.150681 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a51aa07-cd01-475f-8182-48f3c224cef6 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:18.198618 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f011e715-54c5-4c72-9436-174550a84105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:18.199601 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011e715-54c5-4c72-9436-174550a84105 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:18.200105 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011e715-54c5-4c72-9436-174550a84105 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:18.200603 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011e715-54c5-4c72-9436-174550a84105 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:18.214769 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f011e715-54c5-4c72-9436-174550a84105 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:58:18.219911 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-f011e715-54c5-4c72-9436-174550a84105 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 10:58:18.219911 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:18.219911 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:18.219911 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:18.219911 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:18.219911 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:18.219911 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:18.219911 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:18.219911 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:18.219911 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:18.219911 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:18.219911 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:18.219911 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:58:18.219911 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:58:18.219911 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:58:18.219911 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:58:18.220851 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:58:18.220851 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:58:18.220851 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:58:18.220851 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:58:18.220851 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:18.220851 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:18.220851 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:18.220851 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:18.220851 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:18.220851 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:18.220851 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:18.220851 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:18.220851 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:18.220851 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:18.220851 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:18.220851 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:18.221692 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:18.221692 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:18.221692 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:18.221692 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:18.221692 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:58:18.221692 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:58:18.221692 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:58:18.221692 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:58:18.221692 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:58:18.221692 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:58:18.221692 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 10:58:18.221692 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:18.224142 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 263/532] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Oct 13 10:58:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:18.230094 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8173af5-24b6-4c33-9a4d-42302c853545 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:18.348891 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:18.377646 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8173af5-24b6-4c33-9a4d-42302c853545 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:18.425024 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454a76c7-0726-4982-a9fd-4ea1ebaf9195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:18.426281 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a76c7-0726-4982-a9fd-4ea1ebaf9195 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:18.426562 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a76c7-0726-4982-a9fd-4ea1ebaf9195 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:18.426831 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a76c7-0726-4982-a9fd-4ea1ebaf9195 None admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:18.427504 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454a76c7-0726-4982-a9fd-4ea1ebaf9195 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:18.427805 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454a76c7-0726-4982-a9fd-4ea1ebaf9195 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:18.429265 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454a76c7-0726-4982-a9fd-4ea1ebaf9195 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:18.442060 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 270/533] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 10:58:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:18.443853 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f011e715-54c5-4c72-9436-174550a84105 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:18.605563 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f011e715-54c5-4c72-9436-174550a84105 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:18.634123 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:18.638420 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f8de4b-d20e-4f8f-b087-96aaaec026ce None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:18.638880 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f8de4b-d20e-4f8f-b087-96aaaec026ce None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:18.638958 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f8de4b-d20e-4f8f-b087-96aaaec026ce None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:18.641375 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 271/534] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:58:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:18.651266 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b172641-40f5-45ff-9164-395911d1a415 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:18.651548 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b172641-40f5-45ff-9164-395911d1a415 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:18.651828 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b172641-40f5-45ff-9164-395911d1a415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:18.653314 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7848da-131d-445a-92f6-7058d38fab46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:18.654200 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7848da-131d-445a-92f6-7058d38fab46 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:18.654701 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7848da-131d-445a-92f6-7058d38fab46 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:18.655193 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7848da-131d-445a-92f6-7058d38fab46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:18.666992 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7848da-131d-445a-92f6-7058d38fab46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:18.668686 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7848da-131d-445a-92f6-7058d38fab46 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:18.683876 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-0b7848da-131d-445a-92f6-7058d38fab46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:18.683876 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:18.683876 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:18.683876 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:18.683876 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:18.683876 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:18.683876 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:18.683876 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:18.683876 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:18.683876 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:18.683876 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:18.683876 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:18.683876 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:18.683876 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:18.683876 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:18.683876 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:18.684845 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:18.684845 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:18.684845 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:18.684845 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:18.684845 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:18.684845 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:18.684845 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:18.684845 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:18.684845 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:18.684845 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:18.684845 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:18.684845 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:18.684845 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:18.684845 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:18.684845 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:18.684845 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:18.684845 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:18.685785 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:18.685785 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:18.685785 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:18.687117 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-1b172641-40f5-45ff-9164-395911d1a415 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:18.688262 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 264/535] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:18.688447 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-1b172641-40f5-45ff-9164-395911d1a415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:18.694493 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7848da-131d-445a-92f6-7058d38fab46 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:18.792157 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 272/536] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:58:18.823214 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa43a4a-42b6-4e32-8bda-f99e1576f368 None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:18.823539 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa43a4a-42b6-4e32-8bda-f99e1576f368 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:18.823759 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa43a4a-42b6-4e32-8bda-f99e1576f368 None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:18.825356 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 273/537] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:58:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:18.830272 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b80f0b-3270-49b9-b1b8-af8c87557f59 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:18.830562 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b80f0b-3270-49b9-b1b8-af8c87557f59 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:18.830833 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b80f0b-3270-49b9-b1b8-af8c87557f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:18.863209 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-a7b80f0b-3270-49b9-b1b8-af8c87557f59 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:18.865342 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-a7b80f0b-3270-49b9-b1b8-af8c87557f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:18.873187 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7848da-131d-445a-92f6-7058d38fab46 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:18.929243 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667033d6-b812-4f84-b005-fea07ceb3bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:18.929851 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667033d6-b812-4f84-b005-fea07ceb3bab None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:18.930155 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667033d6-b812-4f84-b005-fea07ceb3bab None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:18.930433 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667033d6-b812-4f84-b005-fea07ceb3bab None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:18.931070 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667033d6-b812-4f84-b005-fea07ceb3bab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:18.931374 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667033d6-b812-4f84-b005-fea07ceb3bab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:18.932736 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667033d6-b812-4f84-b005-fea07ceb3bab None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:18.955807 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 265/538] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:18.966950 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667033d6-b812-4f84-b005-fea07ceb3bab None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:18.976607 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:18.988352 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 274/539] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:58:19.007584 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:19.090670 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667033d6-b812-4f84-b005-fea07ceb3bab None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:19.130696 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931f7d12-4f11-48dc-a269-fb0c88de4866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:19.131600 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f7d12-4f11-48dc-a269-fb0c88de4866 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:19.132021 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f7d12-4f11-48dc-a269-fb0c88de4866 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:19.132436 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f7d12-4f11-48dc-a269-fb0c88de4866 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:19.145726 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931f7d12-4f11-48dc-a269-fb0c88de4866 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:19.147457 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931f7d12-4f11-48dc-a269-fb0c88de4866 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:19.161922 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-931f7d12-4f11-48dc-a269-fb0c88de4866 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 13 10:58:19.161922 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:19.161922 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:19.161922 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:19.161922 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:19.161922 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:19.161922 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:19.161922 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:19.161922 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:19.161922 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:19.161922 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:19.161922 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:19.161922 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 10:58:19.161922 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 10:58:19.161922 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 10:58:19.161922 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 10:58:19.163050 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:19.163050 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:19.163050 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 10:58:19.163050 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:19.163050 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 10:58:19.163050 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:19.163050 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:19.163050 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:19.163050 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:19.163050 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:19.163050 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:19.163050 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:19.163050 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:19.163050 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:19.163050 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:19.163050 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:19.163050 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:19.163050 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:19.164219 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:19.164219 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:19.164219 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 10:58:19.164219 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 10:58:19.164219 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 10:58:19.164219 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 10:58:19.164219 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 10:58:19.164219 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 10:58:19.164219 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 13 10:58:19.164219 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:19.166349 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 266/540] 10.222.0.25 () {56 vars in 1093 bytes} [Thu Oct 13 10:58:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:19.172105 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b80f0b-3270-49b9-b1b8-af8c87557f59 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:19.183891 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931f7d12-4f11-48dc-a269-fb0c88de4866 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:19.325522 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:19.334997 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b80f0b-3270-49b9-b1b8-af8c87557f59 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:19.335867 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931f7d12-4f11-48dc-a269-fb0c88de4866 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:19.369869 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a309755e-f596-4b1d-8e5c-e7b7d519bc2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:19.370515 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a309755e-f596-4b1d-8e5c-e7b7d519bc2a None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:19.370800 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a309755e-f596-4b1d-8e5c-e7b7d519bc2a None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:19.371079 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a309755e-f596-4b1d-8e5c-e7b7d519bc2a None admin] PATH_INFO: `/v3/users` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:19.371803 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a309755e-f596-4b1d-8e5c-e7b7d519bc2a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:19.372117 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a309755e-f596-4b1d-8e5c-e7b7d519bc2a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:19.373546 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a309755e-f596-4b1d-8e5c-e7b7d519bc2a None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:19.378420 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124494d9-ca78-489b-8029-b375d6730cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:19.379195 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124494d9-ca78-489b-8029-b375d6730cb4 None admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:19.379618 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124494d9-ca78-489b-8029-b375d6730cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:19.380281 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124494d9-ca78-489b-8029-b375d6730cb4 None admin] PATH_INFO: `/v3/services` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:19.381080 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124494d9-ca78-489b-8029-b375d6730cb4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:19.383572 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124494d9-ca78-489b-8029-b375d6730cb4 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:19.390854 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 275/541] 10.222.0.25 () {56 vars in 1133 bytes} [Thu Oct 13 10:58:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:19.391746 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a309755e-f596-4b1d-8e5c-e7b7d519bc2a None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:19.407104 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 267/542] 10.222.0.25 () {60 vars in 1141 bytes} [Thu Oct 13 10:58:19 2022] POST /identity/v3/services => generated 251 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 10:58:19.408645 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a90da1-ab39-4f2c-8941-14a36658f0f1 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:19.408931 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a90da1-ab39-4f2c-8941-14a36658f0f1 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:19.409271 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a90da1-ab39-4f2c-8941-14a36658f0f1 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:19.411963 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 268/543] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:58:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:19.412915 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a90da1-ab39-4f2c-8941-14a36658f0f1 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:19.468171 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:19.532443 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a309755e-f596-4b1d-8e5c-e7b7d519bc2a None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:19.565414 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a90da1-ab39-4f2c-8941-14a36658f0f1 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:19.574242 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18289872-da07-433e-9e64-0b30af21861b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:19.574890 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18289872-da07-433e-9e64-0b30af21861b None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:19.575170 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18289872-da07-433e-9e64-0b30af21861b None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:19.575438 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18289872-da07-433e-9e64-0b30af21861b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:19.586680 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18289872-da07-433e-9e64-0b30af21861b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:58:19.591428 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-18289872-da07-433e-9e64-0b30af21861b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 10:58:19.591428 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:19.591428 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:19.591428 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:19.591428 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:19.591428 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:19.591428 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:19.591428 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:19.591428 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:19.591428 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:19.591428 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:19.591428 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:19.591428 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:58:19.591428 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:58:19.591428 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:58:19.591428 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:58:19.592343 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:58:19.592343 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:58:19.592343 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:58:19.592343 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:58:19.592343 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:19.592343 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:19.592343 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:19.592343 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:19.592343 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:19.592343 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:19.592343 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:19.592343 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:19.592343 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:19.592343 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:19.592343 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:19.592343 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:19.593200 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:19.593200 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:19.593200 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:19.593200 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:19.593200 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:58:19.593200 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:58:19.593200 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:58:19.593200 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:58:19.593200 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:58:19.593200 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:58:19.593200 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 10:58:19.593200 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:19.593200 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 276/544] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Oct 13 10:58:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:19.593883 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66abecc-07e9-4a28-a9f1-000441922a6a None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:19.593980 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66abecc-07e9-4a28-a9f1-000441922a6a None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:19.594968 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66abecc-07e9-4a28-a9f1-000441922a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:19.614266 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-b66abecc-07e9-4a28-a9f1-000441922a6a None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:19.614447 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1372dd8b-f7a2-4634-8e46-83c3763fc846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:19.615033 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372dd8b-f7a2-4634-8e46-83c3763fc846 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:19.615314 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372dd8b-f7a2-4634-8e46-83c3763fc846 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:19.615473 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-b66abecc-07e9-4a28-a9f1-000441922a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:19.615630 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372dd8b-f7a2-4634-8e46-83c3763fc846 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:19.634411 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:19.688173 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1372dd8b-f7a2-4634-8e46-83c3763fc846 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:19.689621 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1372dd8b-f7a2-4634-8e46-83c3763fc846 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:19.690507 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 277/545] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:19 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:58:19.691636 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ef758-f870-42be-ab92-4bce8aef639f None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:19.691929 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ef758-f870-42be-ab92-4bce8aef639f None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:19.692205 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ef758-f870-42be-ab92-4bce8aef639f None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:19.697296 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 278/546] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:58:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:19.697296 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0ef758-f870-42be-ab92-4bce8aef639f None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:19.762348 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:19.809568 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 269/547] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Oct 13 10:58:19 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 13 10:58:19.811295 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383412ca-bfab-4416-bdd7-9a7f17899e00 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:19.811677 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383412ca-bfab-4416-bdd7-9a7f17899e00 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:19.812035 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383412ca-bfab-4416-bdd7-9a7f17899e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:19.826789 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0ef758-f870-42be-ab92-4bce8aef639f None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:19.835418 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-383412ca-bfab-4416-bdd7-9a7f17899e00 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:19.836793 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-383412ca-bfab-4416-bdd7-9a7f17899e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:19.863744 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bbd3b4-5f02-4a22-ac0a-0816eb906f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:19.864678 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bbd3b4-5f02-4a22-ac0a-0816eb906f73 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:19.865134 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bbd3b4-5f02-4a22-ac0a-0816eb906f73 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:19.865578 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bbd3b4-5f02-4a22-ac0a-0816eb906f73 None admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:19.866553 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bbd3b4-5f02-4a22-ac0a-0816eb906f73 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:19.867111 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bbd3b4-5f02-4a22-ac0a-0816eb906f73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:19.868692 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bbd3b4-5f02-4a22-ac0a-0816eb906f73 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:19.882711 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 279/548] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 10:58:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:19.884611 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bbd3b4-5f02-4a22-ac0a-0816eb906f73 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:19.890718 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:19.921089 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 270/549] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:19 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:58:19.922261 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383412ca-bfab-4416-bdd7-9a7f17899e00 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:20.010437 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bbd3b4-5f02-4a22-ac0a-0816eb906f73 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:20.022661 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:20.046510 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383412ca-bfab-4416-bdd7-9a7f17899e00 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:20.056724 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43d809a-2ca9-481f-aae6-f47c86a7cc03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:20.057348 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d809a-2ca9-481f-aae6-f47c86a7cc03 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:20.057625 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d809a-2ca9-481f-aae6-f47c86a7cc03 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:20.057894 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d809a-2ca9-481f-aae6-f47c86a7cc03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:20.069245 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43d809a-2ca9-481f-aae6-f47c86a7cc03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:20.070684 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43d809a-2ca9-481f-aae6-f47c86a7cc03 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:20.084789 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-a43d809a-2ca9-481f-aae6-f47c86a7cc03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:20.084789 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:20.084789 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:20.084789 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:20.084789 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:20.084789 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:20.084789 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:20.084789 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:20.084789 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:20.084789 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:20.084789 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:20.084789 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:20.084789 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:20.084789 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:20.084789 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:20.084789 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:20.085715 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:20.085715 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:20.085715 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:20.085715 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:20.085715 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:20.085715 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:20.085715 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:20.085715 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:20.085715 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:20.085715 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:20.085715 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:20.085715 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:20.085715 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:20.085715 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:20.085715 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:20.085715 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:20.085715 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:20.086711 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:20.086711 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:20.086711 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:20.090367 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 280/550] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:20.091121 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43d809a-2ca9-481f-aae6-f47c86a7cc03 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:20.094153 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9249ac4-e6aa-4451-87c9-be1ca0dd2ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:20.096054 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9249ac4-e6aa-4451-87c9-be1ca0dd2ae0 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:20.096541 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9249ac4-e6aa-4451-87c9-be1ca0dd2ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:20.097013 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9249ac4-e6aa-4451-87c9-be1ca0dd2ae0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:20.112599 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9249ac4-e6aa-4451-87c9-be1ca0dd2ae0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:20.114444 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9249ac4-e6aa-4451-87c9-be1ca0dd2ae0 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:20.135587 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-d9249ac4-e6aa-4451-87c9-be1ca0dd2ae0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:20.135587 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:20.135587 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:20.135587 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:20.135587 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:20.135587 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:20.135587 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:20.135587 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:20.135587 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:20.135587 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:20.135587 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:20.135587 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:20.135587 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:20.135587 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:20.135587 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:20.135587 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:20.136558 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:20.136558 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:20.136558 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:20.136558 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:20.136558 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:20.136558 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:20.136558 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:20.136558 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:20.136558 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:20.136558 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:20.136558 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:20.136558 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:20.136558 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:20.136558 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:20.136558 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:20.136558 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:20.136558 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:20.137429 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:20.137429 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:20.137429 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:20.140139 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 271/551] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:20.141450 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9249ac4-e6aa-4451-87c9-be1ca0dd2ae0 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:20.183106 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:20.200442 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43d809a-2ca9-481f-aae6-f47c86a7cc03 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:20.237996 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4f3241-7322-40e6-ab7c-721a5a95fcdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:20.238824 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f3241-7322-40e6-ab7c-721a5a95fcdc None admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:20.238936 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f3241-7322-40e6-ab7c-721a5a95fcdc None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:20.239133 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f3241-7322-40e6-ab7c-721a5a95fcdc None admin] PATH_INFO: `/v3/services` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:20.239775 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4f3241-7322-40e6-ab7c-721a5a95fcdc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:20.241259 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4f3241-7322-40e6-ab7c-721a5a95fcdc None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:20.262278 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 281/552] 10.222.0.25 () {60 vars in 1141 bytes} [Thu Oct 13 10:58:20 2022] POST /identity/v3/services => generated 240 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 10:58:20.262278 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4f3241-7322-40e6-ab7c-721a5a95fcdc None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:20.270659 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9249ac4-e6aa-4451-87c9-be1ca0dd2ae0 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:20.295989 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:20.321863 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b62a63-453e-40ae-90e6-f0aaa19b4e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:20.322537 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b62a63-453e-40ae-90e6-f0aaa19b4e3f None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:20.322814 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b62a63-453e-40ae-90e6-f0aaa19b4e3f None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:20.323142 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b62a63-453e-40ae-90e6-f0aaa19b4e3f None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:20.324191 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b62a63-453e-40ae-90e6-f0aaa19b4e3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:20.324318 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b62a63-453e-40ae-90e6-f0aaa19b4e3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:20.325650 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b62a63-453e-40ae-90e6-f0aaa19b4e3f None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:20.345918 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 272/553] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:20.345918 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b62a63-453e-40ae-90e6-f0aaa19b4e3f None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:20.420161 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4f3241-7322-40e6-ab7c-721a5a95fcdc None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:20.457925 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:20.468693 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a5af9-ea5f-4584-b3a3-554e7eb6fdef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:20.469308 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a5af9-ea5f-4584-b3a3-554e7eb6fdef None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:20.469661 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a5af9-ea5f-4584-b3a3-554e7eb6fdef None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:20.469859 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a5af9-ea5f-4584-b3a3-554e7eb6fdef None admin] PATH_INFO: `/v3/domains` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:20.470602 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619a5af9-ea5f-4584-b3a3-554e7eb6fdef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:20.470910 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619a5af9-ea5f-4584-b3a3-554e7eb6fdef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:20.472334 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619a5af9-ea5f-4584-b3a3-554e7eb6fdef None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:20.475765 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b62a63-453e-40ae-90e6-f0aaa19b4e3f None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:20.487313 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 282/554] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:20.488842 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a5af9-ea5f-4584-b3a3-554e7eb6fdef None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:20.516916 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00382e99-3e79-490e-989f-f5a71a873939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:20.517615 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00382e99-3e79-490e-989f-f5a71a873939 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:20.517901 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00382e99-3e79-490e-989f-f5a71a873939 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:20.518240 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00382e99-3e79-490e-989f-f5a71a873939 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:20.529118 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00382e99-3e79-490e-989f-f5a71a873939 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:58:20.534634 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-00382e99-3e79-490e-989f-f5a71a873939 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 13 10:58:20.534634 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:20.534634 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:20.534634 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:20.534634 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:20.534634 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:20.534634 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:20.534634 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:20.534634 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:20.534634 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:20.534634 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:20.534634 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:20.534634 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:58:20.534634 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:58:20.534634 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:58:20.534634 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:58:20.535579 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:58:20.535579 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:58:20.535579 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:58:20.535579 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:58:20.535579 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:20.535579 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:20.535579 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:20.535579 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:20.535579 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:20.535579 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:20.535579 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:20.535579 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:20.535579 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:20.535579 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:20.535579 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:20.535579 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:20.536432 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:20.536432 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:20.536432 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:20.536432 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:20.536432 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:58:20.536432 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:58:20.536432 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:58:20.536432 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:58:20.536432 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:58:20.536432 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:58:20.536432 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 13 10:58:20.536432 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:20.538053 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 273/555] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Oct 13 10:58:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:20.538919 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00382e99-3e79-490e-989f-f5a71a873939 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:20.587854 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:20.609434 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a5af9-ea5f-4584-b3a3-554e7eb6fdef None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:20.647304 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c9000-e6fc-4d36-a62c-c8a21d954b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:20.648301 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c9000-e6fc-4d36-a62c-c8a21d954b2f None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:20.649257 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c9000-e6fc-4d36-a62c-c8a21d954b2f None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:20.649735 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c9000-e6fc-4d36-a62c-c8a21d954b2f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:20.659313 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909c9000-e6fc-4d36-a62c-c8a21d954b2f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:20.661916 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909c9000-e6fc-4d36-a62c-c8a21d954b2f None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:20.672265 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00382e99-3e79-490e-989f-f5a71a873939 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:20.678803 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-909c9000-e6fc-4d36-a62c-c8a21d954b2f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:58:20.678803 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:20.678803 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:20.678803 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:20.678803 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:20.678803 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:20.678803 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:20.678803 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:20.678803 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:20.678803 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:20.678803 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:20.678803 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:20.678803 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 10:58:20.678803 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 10:58:20.678803 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 10:58:20.679688 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 10:58:20.679688 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:20.679688 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:20.679688 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:20.679688 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:20.679688 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:20.679688 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:20.679688 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:20.679688 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:20.679688 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:20.679688 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:20.679688 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:20.679688 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:20.679688 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:20.679688 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:20.679688 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:20.679688 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:20.680551 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 10:58:20.680551 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 10:58:20.680551 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 10:58:20.680551 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 10:58:20.680551 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 10:58:20.680551 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 10:58:20.680551 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:58:20.680551 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:20.682986 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 283/556] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Oct 13 10:58:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:20.684396 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c9000-e6fc-4d36-a62c-c8a21d954b2f None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:20.716905 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb05ac-9a72-400b-9aff-79ffcd877369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:20.718425 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb05ac-9a72-400b-9aff-79ffcd877369 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:20.718855 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb05ac-9a72-400b-9aff-79ffcd877369 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:20.719512 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb05ac-9a72-400b-9aff-79ffcd877369 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:20.733346 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fb05ac-9a72-400b-9aff-79ffcd877369 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:20.734846 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fb05ac-9a72-400b-9aff-79ffcd877369 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:20.747688 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-32fb05ac-9a72-400b-9aff-79ffcd877369 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 13 10:58:20.747688 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:20.747688 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:20.747688 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:20.747688 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:20.747688 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:20.747688 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:20.747688 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:20.747688 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:20.747688 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:20.747688 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:20.747688 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:20.747688 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 10:58:20.747688 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 10:58:20.747688 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 10:58:20.747688 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 10:58:20.748654 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:20.748654 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:20.748654 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 10:58:20.748654 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:20.748654 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 10:58:20.748654 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:20.748654 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:20.748654 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:20.748654 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:20.748654 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:20.748654 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:20.748654 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:20.748654 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:20.748654 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:20.748654 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:20.748654 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:20.748654 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:20.748654 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:20.749602 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:20.749602 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:20.749602 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 10:58:20.749602 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 10:58:20.749602 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 10:58:20.749602 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 10:58:20.749602 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 10:58:20.749602 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 10:58:20.749602 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 13 10:58:20.749602 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:20.749602 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 274/557] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Oct 13 10:58:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:20.750210 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb05ac-9a72-400b-9aff-79ffcd877369 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:20.759964 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:20.818246 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c9000-e6fc-4d36-a62c-c8a21d954b2f None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:20.856929 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfca198-4638-4195-9d27-9dcdc2f5072a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:20.857927 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfca198-4638-4195-9d27-9dcdc2f5072a None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:20.858527 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfca198-4638-4195-9d27-9dcdc2f5072a None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:20.859022 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfca198-4638-4195-9d27-9dcdc2f5072a None admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:20.860049 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfca198-4638-4195-9d27-9dcdc2f5072a None admin] RBAC: Adding query filter params (name=service) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:20.860611 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfca198-4638-4195-9d27-9dcdc2f5072a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:20.862568 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfca198-4638-4195-9d27-9dcdc2f5072a None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:20.866894 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb05ac-9a72-400b-9aff-79ffcd877369 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:20.872339 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 284/558] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Oct 13 10:58:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:20.873481 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfca198-4638-4195-9d27-9dcdc2f5072a None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:20.884296 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:20.916447 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1936bb3-3531-4b4a-98a3-ca43e6a03bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:20.917539 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1936bb3-3531-4b4a-98a3-ca43e6a03bf9 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:20.918040 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1936bb3-3531-4b4a-98a3-ca43e6a03bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:20.918473 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1936bb3-3531-4b4a-98a3-ca43e6a03bf9 None admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:20.919297 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1936bb3-3531-4b4a-98a3-ca43e6a03bf9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:20.919821 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1936bb3-3531-4b4a-98a3-ca43e6a03bf9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:20.921497 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1936bb3-3531-4b4a-98a3-ca43e6a03bf9 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:20.939054 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 275/559] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Oct 13 10:58:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:20.940190 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1936bb3-3531-4b4a-98a3-ca43e6a03bf9 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:20.982162 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfca198-4638-4195-9d27-9dcdc2f5072a None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:21.009223 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:21.020499 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245f5d81-f208-472c-b3f7-4e1432db121b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:21.021250 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f5d81-f208-472c-b3f7-4e1432db121b None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:21.021642 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f5d81-f208-472c-b3f7-4e1432db121b None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:21.022068 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f5d81-f208-472c-b3f7-4e1432db121b None admin] PATH_INFO: `/v3/users` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:21.022921 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245f5d81-f208-472c-b3f7-4e1432db121b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:21.023557 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245f5d81-f208-472c-b3f7-4e1432db121b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:21.024875 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245f5d81-f208-472c-b3f7-4e1432db121b None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:21.045300 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 285/560] 10.222.0.25 () {56 vars in 1135 bytes} [Thu Oct 13 10:58:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:21.046412 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245f5d81-f208-472c-b3f7-4e1432db121b None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:21.050842 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1936bb3-3531-4b4a-98a3-ca43e6a03bf9 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:21.086939 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9390871-48c0-4237-9e21-4bae9e69ef90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:21.087861 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9390871-48c0-4237-9e21-4bae9e69ef90 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:21.088336 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9390871-48c0-4237-9e21-4bae9e69ef90 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:21.088783 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9390871-48c0-4237-9e21-4bae9e69ef90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:21.100042 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9390871-48c0-4237-9e21-4bae9e69ef90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:21.101836 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9390871-48c0-4237-9e21-4bae9e69ef90 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:21.111009 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:21.120719 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-c9390871-48c0-4237-9e21-4bae9e69ef90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:21.120719 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:21.120719 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:21.120719 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:21.120719 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:21.120719 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:21.120719 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:21.120719 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:21.120719 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:21.120719 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:21.120719 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:21.120719 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:21.120719 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:21.120719 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:21.120719 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:21.120719 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:21.121676 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:21.121676 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:21.121676 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:21.121676 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:21.121676 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:21.121676 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:21.121676 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:21.121676 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:21.121676 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:21.121676 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:21.121676 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:21.121676 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:21.121676 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:21.121676 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:21.121676 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:21.121676 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:21.121676 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:21.122571 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:21.122571 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:21.122571 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:21.124508 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 276/561] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:21.125515 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9390871-48c0-4237-9e21-4bae9e69ef90 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:21.155100 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245f5d81-f208-472c-b3f7-4e1432db121b None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:21.192354 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a4f8c7-f5f9-4ca0-879c-93b4efb33001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:21.192931 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a4f8c7-f5f9-4ca0-879c-93b4efb33001 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:21.193282 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a4f8c7-f5f9-4ca0-879c-93b4efb33001 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:21.193626 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a4f8c7-f5f9-4ca0-879c-93b4efb33001 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:21.194569 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a4f8c7-f5f9-4ca0-879c-93b4efb33001 None admin] RBAC: Adding query filter params (role.id=ea564961b1db4eb4a1d4d880964611b2, scope.project.id=85bfac5f03e24fb3870a59a6b52dba6e, user.id=78384fbffdd346578855e7214b335d8e) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:21.194951 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a4f8c7-f5f9-4ca0-879c-93b4efb33001 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:21.196449 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a4f8c7-f5f9-4ca0-879c-93b4efb33001 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:21.209992 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 286/562] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Oct 13 10:58:21 2022] GET /identity/v3/role_assignments?user.id=78384fbffdd346578855e7214b335d8e&scope.project.id=85bfac5f03e24fb3870a59a6b52dba6e&role.id=ea564961b1db4eb4a1d4d880964611b2 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:21.209992 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a4f8c7-f5f9-4ca0-879c-93b4efb33001 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:21.274301 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9390871-48c0-4237-9e21-4bae9e69ef90 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:21.306597 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:21.326785 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ea63c-62d3-433a-8b6d-f9865e780383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:21.327868 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ea63c-62d3-433a-8b6d-f9865e780383 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:21.328386 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ea63c-62d3-433a-8b6d-f9865e780383 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:21.328670 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ea63c-62d3-433a-8b6d-f9865e780383 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:21.341909 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018ea63c-62d3-433a-8b6d-f9865e780383 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:21.343963 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018ea63c-62d3-433a-8b6d-f9865e780383 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:21.360200 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-018ea63c-62d3-433a-8b6d-f9865e780383 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:21.360200 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:21.360200 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:21.360200 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:21.360200 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:21.360200 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:21.360200 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:21.360200 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:21.360200 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:21.360200 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:21.360200 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:21.360200 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:21.360200 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:21.360200 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:21.360200 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:21.360200 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:21.361243 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:21.361243 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:21.361243 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:21.361243 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:21.361243 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:21.361243 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:21.361243 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:21.361243 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:21.361243 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:21.361243 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:21.361243 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:21.361243 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:21.361243 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:21.361243 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:21.361243 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:21.361243 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:21.361243 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:21.362405 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:21.362405 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:21.362405 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:21.362405 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 277/563] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:21.371580 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ea63c-62d3-433a-8b6d-f9865e780383 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:21.440110 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a4f8c7-f5f9-4ca0-879c-93b4efb33001 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:21.466144 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:21.478795 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d68db81-ef07-438c-a48c-ce30f349ccde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:21.479706 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68db81-ef07-438c-a48c-ce30f349ccde None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:21.479817 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68db81-ef07-438c-a48c-ce30f349ccde None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:21.480029 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68db81-ef07-438c-a48c-ce30f349ccde None admin] PATH_INFO: `/v3/domains` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:21.480736 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d68db81-ef07-438c-a48c-ce30f349ccde None admin] RBAC: Adding query filter params (name=Default) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:21.481044 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d68db81-ef07-438c-a48c-ce30f349ccde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:21.482449 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d68db81-ef07-438c-a48c-ce30f349ccde None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:21.502232 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 287/564] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:21.503721 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d68db81-ef07-438c-a48c-ce30f349ccde None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:21.521028 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ea63c-62d3-433a-8b6d-f9865e780383 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:21.562751 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aab8e4e-dd9d-455b-843d-323527e7b9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:21.564086 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab8e4e-dd9d-455b-843d-323527e7b9eb None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:21.564806 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab8e4e-dd9d-455b-843d-323527e7b9eb None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:21.565255 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab8e4e-dd9d-455b-843d-323527e7b9eb None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:21.566775 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aab8e4e-dd9d-455b-843d-323527e7b9eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:21.567260 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aab8e4e-dd9d-455b-843d-323527e7b9eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:21.569387 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aab8e4e-dd9d-455b-843d-323527e7b9eb None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:21.586248 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 278/565] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:21.591066 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aab8e4e-dd9d-455b-843d-323527e7b9eb None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:21.620259 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d68db81-ef07-438c-a48c-ce30f349ccde None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:21.654296 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:21.662663 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3783e9-f3f0-45dd-b0d2-f2bda04ede51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:21.663845 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3783e9-f3f0-45dd-b0d2-f2bda04ede51 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:21.664225 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3783e9-f3f0-45dd-b0d2-f2bda04ede51 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:21.664592 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3783e9-f3f0-45dd-b0d2-f2bda04ede51 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:21.675889 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3783e9-f3f0-45dd-b0d2-f2bda04ede51 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:21.677630 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3783e9-f3f0-45dd-b0d2-f2bda04ede51 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:21.691790 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-de3783e9-f3f0-45dd-b0d2-f2bda04ede51 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 13 10:58:21.691790 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:21.691790 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:21.691790 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:21.691790 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:21.691790 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:21.691790 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:21.691790 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:21.691790 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:21.691790 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:21.691790 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:21.691790 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:21.691790 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 10:58:21.691790 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 10:58:21.691790 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 10:58:21.691790 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 10:58:21.692981 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:21.692981 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:21.692981 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 10:58:21.692981 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:21.692981 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 10:58:21.692981 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:21.692981 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:21.692981 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:21.692981 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:21.692981 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:21.692981 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:21.692981 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:21.692981 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:21.692981 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:21.692981 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:21.692981 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:21.692981 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:21.692981 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:21.694151 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:21.694151 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:21.694151 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 10:58:21.694151 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 10:58:21.694151 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 10:58:21.694151 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 10:58:21.694151 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 10:58:21.694151 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 10:58:21.694151 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 13 10:58:21.694151 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:21.695858 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 288/566] 10.222.0.25 () {56 vars in 1117 bytes} [Thu Oct 13 10:58:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:21.701844 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3783e9-f3f0-45dd-b0d2-f2bda04ede51 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:21.750247 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:21.776095 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aab8e4e-dd9d-455b-843d-323527e7b9eb None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:21.816690 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e6dc5-97f2-48db-a5f2-fb5f689315b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:21.817104 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3783e9-f3f0-45dd-b0d2-f2bda04ede51 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:21.817585 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e6dc5-97f2-48db-a5f2-fb5f689315b9 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:21.817995 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e6dc5-97f2-48db-a5f2-fb5f689315b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:21.818370 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e6dc5-97f2-48db-a5f2-fb5f689315b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:21.827436 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5e6dc5-97f2-48db-a5f2-fb5f689315b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:21.829650 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5e6dc5-97f2-48db-a5f2-fb5f689315b9 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:21.845881 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-fa5e6dc5-97f2-48db-a5f2-fb5f689315b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:58:21.845881 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:21.845881 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:21.845881 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:21.845881 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:21.845881 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:21.845881 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:21.845881 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:21.845881 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:21.845881 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:21.845881 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:21.845881 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:21.845881 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 10:58:21.845881 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 10:58:21.845881 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 10:58:21.846817 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 10:58:21.846817 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:21.846817 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:21.846817 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:21.846817 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:21.846817 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:21.846817 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:21.846817 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:21.846817 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:21.846817 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:21.846817 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:21.846817 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:21.846817 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:21.846817 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:21.846817 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:21.846817 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:21.846817 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:21.847749 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 10:58:21.847749 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 10:58:21.847749 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 10:58:21.847749 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 10:58:21.847749 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 10:58:21.847749 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 10:58:21.847749 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:58:21.847749 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:21.848325 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 279/567] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Oct 13 10:58:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:21.850397 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5bf26-308c-4c43-8536-b4a038f5a2ca None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:21.850744 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5bf26-308c-4c43-8536-b4a038f5a2ca None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:21.851082 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5bf26-308c-4c43-8536-b4a038f5a2ca None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:21.853615 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836d63dc-2be6-40c8-9dab-dd575ebc2275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:21.854344 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d63dc-2be6-40c8-9dab-dd575ebc2275 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:21.854727 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d63dc-2be6-40c8-9dab-dd575ebc2275 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:21.855109 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d63dc-2be6-40c8-9dab-dd575ebc2275 None admin] PATH_INFO: `/v3/users` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:21.855946 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836d63dc-2be6-40c8-9dab-dd575ebc2275 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:21.856351 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836d63dc-2be6-40c8-9dab-dd575ebc2275 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:21.856665 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 280/568] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:58:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:21.857321 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd5bf26-308c-4c43-8536-b4a038f5a2ca None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:21.858239 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836d63dc-2be6-40c8-9dab-dd575ebc2275 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:21.882640 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 289/569] 10.222.0.25 () {56 vars in 1149 bytes} [Thu Oct 13 10:58:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:21.883944 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0fa4d5-0d05-4d2f-8c05-b04bfa12553e None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:21.884332 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0fa4d5-0d05-4d2f-8c05-b04bfa12553e None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:21.884703 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0fa4d5-0d05-4d2f-8c05-b04bfa12553e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:21.911121 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-0f0fa4d5-0d05-4d2f-8c05-b04bfa12553e None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:21.912331 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-0f0fa4d5-0d05-4d2f-8c05-b04bfa12553e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:21.963600 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:21.978841 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd5bf26-308c-4c43-8536-b4a038f5a2ca None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:21.994323 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 290/570] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 10:58:21.995462 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0fa4d5-0d05-4d2f-8c05-b04bfa12553e None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:22.017195 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2035d87-da50-4228-b1f6-afb814c0fe18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:22.018229 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2035d87-da50-4228-b1f6-afb814c0fe18 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:22.018654 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2035d87-da50-4228-b1f6-afb814c0fe18 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:22.019458 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2035d87-da50-4228-b1f6-afb814c0fe18 None admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:22.020296 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2035d87-da50-4228-b1f6-afb814c0fe18 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:22.020602 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2035d87-da50-4228-b1f6-afb814c0fe18 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:22.022825 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2035d87-da50-4228-b1f6-afb814c0fe18 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:22.038164 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 281/571] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Oct 13 10:58:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:22.047283 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2035d87-da50-4228-b1f6-afb814c0fe18 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:22.058466 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:22.187060 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0fa4d5-0d05-4d2f-8c05-b04bfa12553e None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:22.233814 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2035d87-da50-4228-b1f6-afb814c0fe18 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:22.243531 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e87db3-d623-4b84-9a8c-2d37bef2cc31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:22.244412 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e87db3-d623-4b84-9a8c-2d37bef2cc31 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:22.244870 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e87db3-d623-4b84-9a8c-2d37bef2cc31 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:22.245318 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e87db3-d623-4b84-9a8c-2d37bef2cc31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:22.256247 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e87db3-d623-4b84-9a8c-2d37bef2cc31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:22.257906 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e87db3-d623-4b84-9a8c-2d37bef2cc31 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:22.273623 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-21e87db3-d623-4b84-9a8c-2d37bef2cc31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:22.273623 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:22.273623 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:22.273623 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:22.273623 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:22.273623 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:22.273623 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:22.273623 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:22.273623 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:22.273623 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:22.273623 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:22.273623 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:22.273623 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:22.273623 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:22.273623 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:22.273623 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:22.274702 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:22.274702 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:22.274702 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:22.274702 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:22.274702 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:22.274702 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:22.274702 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:22.274702 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:22.274702 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:22.274702 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:22.274702 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:22.274702 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:22.274702 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:22.274702 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:22.274702 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:22.274702 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:22.274702 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:22.275590 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:22.275590 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:22.275590 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:22.277756 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 291/572] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:22.282704 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e87db3-d623-4b84-9a8c-2d37bef2cc31 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:22.321251 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3328ef80-95e3-4485-9e09-371d70b46ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:22.323011 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3328ef80-95e3-4485-9e09-371d70b46ca3 None admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:22.323366 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3328ef80-95e3-4485-9e09-371d70b46ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:22.323738 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3328ef80-95e3-4485-9e09-371d70b46ca3 None admin] PATH_INFO: `/v3/projects/85bfac5f03e24fb3870a59a6b52dba6e/users/e24c779d0a604ef28dfc1235ee76a711/roles/ea564961b1db4eb4a1d4d880964611b2` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:22.326760 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3328ef80-95e3-4485-9e09-371d70b46ca3 None admin] RBAC: Authorizing `identity:create_grant(project_id=85bfac5f03e24fb3870a59a6b52dba6e, user_id=e24c779d0a604ef28dfc1235ee76a711, role_id=ea564961b1db4eb4a1d4d880964611b2)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:22.328282 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3328ef80-95e3-4485-9e09-371d70b46ca3 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:22.353970 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 282/573] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Oct 13 10:58:22 2022] PUT /identity/v3/projects/85bfac5f03e24fb3870a59a6b52dba6e/users/e24c779d0a604ef28dfc1235ee76a711/roles/ea564961b1db4eb4a1d4d880964611b2 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 10:58:22.353970 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3328ef80-95e3-4485-9e09-371d70b46ca3 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:22.361553 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:22.413919 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:22.446308 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e87db3-d623-4b84-9a8c-2d37bef2cc31 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:22.470470 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3328ef80-95e3-4485-9e09-371d70b46ca3 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:22.514893 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57f695-fa86-4ba2-aef6-adcece894bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:22.515815 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57f695-fa86-4ba2-aef6-adcece894bab None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:22.516167 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57f695-fa86-4ba2-aef6-adcece894bab None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:22.516513 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57f695-fa86-4ba2-aef6-adcece894bab None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:22.517193 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe57f695-fa86-4ba2-aef6-adcece894bab None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:22.518725 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe57f695-fa86-4ba2-aef6-adcece894bab None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:22.522418 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b77a1-16c8-4bce-939f-cb433fcf101e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:22.523312 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b77a1-16c8-4bce-939f-cb433fcf101e None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:22.523832 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b77a1-16c8-4bce-939f-cb433fcf101e None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:22.524284 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b77a1-16c8-4bce-939f-cb433fcf101e None admin] PATH_INFO: `/v3/domains` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:22.525178 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4b77a1-16c8-4bce-939f-cb433fcf101e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:22.525691 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4b77a1-16c8-4bce-939f-cb433fcf101e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:22.527343 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4b77a1-16c8-4bce-939f-cb433fcf101e None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:22.531069 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-fe57f695-fa86-4ba2-aef6-adcece894bab None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 13 10:58:22.531069 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:22.531069 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 10:58:22.531069 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 10:58:22.531069 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 10:58:22.531069 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 10:58:22.531069 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 10:58:22.531069 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:22.531069 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 13 10:58:22.531069 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:22.531069 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 10:58:22.531069 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:22.531069 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:22.531069 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:22.531069 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:22.531069 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:22.531069 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:22.536760 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:22.536760 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:22.536760 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:22.536760 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:22.536760 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:22.536760 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:22.536760 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 10:58:22.536760 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 10:58:22.536760 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 10:58:22.536760 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 10:58:22.536760 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:22.536760 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:22.536760 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:22.536760 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:22.536760 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:22.536760 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:22.537608 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:22.537608 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:22.537608 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:22.537608 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:22.537608 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:22.537608 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:22.537608 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:22.537608 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:22.537608 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:22.537608 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:22.537608 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 10:58:22.537608 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:22.537608 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 13 10:58:22.537608 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:22.537608 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 283/574] 10.222.0.25 () {56 vars in 1129 bytes} [Thu Oct 13 10:58:22 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:22.538499 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57f695-fa86-4ba2-aef6-adcece894bab None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:22.576302 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 292/575] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:22.583012 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b77a1-16c8-4bce-939f-cb433fcf101e None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:22.626310 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:22.654953 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57f695-fa86-4ba2-aef6-adcece894bab None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:22.698364 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd32b379-8601-4c4e-a822-baaa5a48536e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:22.699295 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd32b379-8601-4c4e-a822-baaa5a48536e None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:22.699585 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd32b379-8601-4c4e-a822-baaa5a48536e None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:22.699860 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd32b379-8601-4c4e-a822-baaa5a48536e None admin] PATH_INFO: `/v3/services` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:22.700492 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd32b379-8601-4c4e-a822-baaa5a48536e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:22.701154 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd32b379-8601-4c4e-a822-baaa5a48536e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:22.703096 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd32b379-8601-4c4e-a822-baaa5a48536e None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:22.709877 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 284/576] 10.222.0.25 () {56 vars in 1124 bytes} [Thu Oct 13 10:58:22 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:22.711092 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e1c013-c848-4950-bb04-2366330c3290 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:22.711372 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e1c013-c848-4950-bb04-2366330c3290 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:22.711643 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e1c013-c848-4950-bb04-2366330c3290 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:22.715544 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 285/577] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:58:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:22.716956 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e1c013-c848-4950-bb04-2366330c3290 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:22.729739 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b77a1-16c8-4bce-939f-cb433fcf101e None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:22.767412 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5060fcbd-9824-4c29-83a0-c630a11b50e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:22.768173 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060fcbd-9824-4c29-83a0-c630a11b50e2 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:22.768457 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060fcbd-9824-4c29-83a0-c630a11b50e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:22.768735 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060fcbd-9824-4c29-83a0-c630a11b50e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:22.776660 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5060fcbd-9824-4c29-83a0-c630a11b50e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:22.778189 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5060fcbd-9824-4c29-83a0-c630a11b50e2 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:22.790559 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-5060fcbd-9824-4c29-83a0-c630a11b50e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:58:22.790559 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:22.790559 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:22.790559 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:22.790559 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:22.790559 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:22.790559 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:22.790559 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:22.790559 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:22.790559 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:22.790559 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:22.790559 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:22.790559 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 10:58:22.790559 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 10:58:22.790559 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 10:58:22.791499 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 10:58:22.791499 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:22.791499 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:22.791499 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:22.791499 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:22.791499 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:22.791499 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:22.791499 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:22.791499 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:22.791499 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:22.791499 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:22.791499 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:22.791499 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:22.791499 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:22.791499 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:22.791499 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:22.791499 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:22.792771 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 10:58:22.792771 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 10:58:22.792771 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 10:58:22.792771 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 10:58:22.792771 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 10:58:22.792771 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 10:58:22.792771 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:58:22.792771 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:22.792771 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 293/578] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Oct 13 10:58:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:22.793382 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c82f1-9915-4e02-8d3a-7fc093dcda43 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:22.793382 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c82f1-9915-4e02-8d3a-7fc093dcda43 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:22.793382 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c82f1-9915-4e02-8d3a-7fc093dcda43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:22.801181 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:22.813334 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-c87c82f1-9915-4e02-8d3a-7fc093dcda43 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:22.814812 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-c87c82f1-9915-4e02-8d3a-7fc093dcda43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:22.845439 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e1c013-c848-4950-bb04-2366330c3290 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:22.888769 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 294/579] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 10:58:22.889215 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87c82f1-9915-4e02-8d3a-7fc093dcda43 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:22.890369 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d90eaf6-f3a3-4149-8a64-ab770b3842e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:22.891056 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90eaf6-f3a3-4149-8a64-ab770b3842e8 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:22.891403 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90eaf6-f3a3-4149-8a64-ab770b3842e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:22.891747 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90eaf6-f3a3-4149-8a64-ab770b3842e8 None admin] PATH_INFO: `/v3/services` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:22.892457 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d90eaf6-f3a3-4149-8a64-ab770b3842e8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:22.892837 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d90eaf6-f3a3-4149-8a64-ab770b3842e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:22.895165 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d90eaf6-f3a3-4149-8a64-ab770b3842e8 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:22.903852 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 286/580] 10.222.0.25 () {56 vars in 1124 bytes} [Thu Oct 13 10:58:22 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:58:22.910946 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d90eaf6-f3a3-4149-8a64-ab770b3842e8 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:22.916163 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:23.061513 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87c82f1-9915-4e02-8d3a-7fc093dcda43 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:23.078865 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d90eaf6-f3a3-4149-8a64-ab770b3842e8 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:23.114551 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f27f36a-659a-45b1-8036-2c72eec6117c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:23.115213 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f27f36a-659a-45b1-8036-2c72eec6117c None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:23.115498 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f27f36a-659a-45b1-8036-2c72eec6117c None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:23.116094 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f27f36a-659a-45b1-8036-2c72eec6117c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:23.116809 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f27f36a-659a-45b1-8036-2c72eec6117c None admin] RBAC: Adding query filter params (interface=public, service_id=274a2e46f52d4fbca2d5c8332ed7a842, region_id=RegionOne) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:23.117124 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f27f36a-659a-45b1-8036-2c72eec6117c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:23.118563 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f27f36a-659a-45b1-8036-2c72eec6117c None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:23.127068 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 287/581] 10.222.0.25 () {56 vars in 1251 bytes} [Thu Oct 13 10:58:22 2022] GET /identity/v3/endpoints?service_id=274a2e46f52d4fbca2d5c8332ed7a842&interface=public®ion_id=RegionOne => generated 194 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:23.133653 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f27f36a-659a-45b1-8036-2c72eec6117c None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:23.169661 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5319625-16d1-4b74-907a-9f27e8ccb2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:23.170329 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5319625-16d1-4b74-907a-9f27e8ccb2a6 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:23.170608 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5319625-16d1-4b74-907a-9f27e8ccb2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:23.170881 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5319625-16d1-4b74-907a-9f27e8ccb2a6 None admin] PATH_INFO: `/v3/projects` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:23.171583 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5319625-16d1-4b74-907a-9f27e8ccb2a6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:23.172103 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5319625-16d1-4b74-907a-9f27e8ccb2a6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:23.173532 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5319625-16d1-4b74-907a-9f27e8ccb2a6 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:23.178026 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:23.201118 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 295/582] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Oct 13 10:58:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:23.207155 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5319625-16d1-4b74-907a-9f27e8ccb2a6 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:23.219675 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:23.270372 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f27f36a-659a-45b1-8036-2c72eec6117c None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:23.317037 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9071b183-e141-4b3a-826d-7c4edcfe807f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:23.318595 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9071b183-e141-4b3a-826d-7c4edcfe807f None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:23.319061 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9071b183-e141-4b3a-826d-7c4edcfe807f None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:23.319523 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9071b183-e141-4b3a-826d-7c4edcfe807f None admin] PATH_INFO: `/v3/services` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:23.320976 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9071b183-e141-4b3a-826d-7c4edcfe807f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:23.322848 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9071b183-e141-4b3a-826d-7c4edcfe807f None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:23.323559 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5319625-16d1-4b74-907a-9f27e8ccb2a6 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:23.330183 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 288/583] 10.222.0.25 () {56 vars in 1087 bytes} [Thu Oct 13 10:58:23 2022] GET /identity/v3/services => generated 772 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:23.331192 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9071b183-e141-4b3a-826d-7c4edcfe807f None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:23.365443 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc54382-7b75-4252-a3d4-d6df277c9f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:23.366233 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc54382-7b75-4252-a3d4-d6df277c9f9e None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:23.366576 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc54382-7b75-4252-a3d4-d6df277c9f9e None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:23.366914 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc54382-7b75-4252-a3d4-d6df277c9f9e None admin] PATH_INFO: `/v3/services/network` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:23.367662 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc54382-7b75-4252-a3d4-d6df277c9f9e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:23.369229 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc54382-7b75-4252-a3d4-d6df277c9f9e None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:23.382629 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-1cc54382-7b75-4252-a3d4-d6df277c9f9e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 13 10:58:23.382629 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:23.382629 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 10:58:23.382629 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 10:58:23.382629 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 10:58:23.382629 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 10:58:23.382629 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 10:58:23.382629 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:23.382629 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 13 10:58:23.382629 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:23.382629 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 10:58:23.382629 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:23.382629 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:23.382629 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:23.382629 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:23.382629 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:23.382629 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:23.383771 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:23.383771 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:23.383771 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:23.383771 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:23.383771 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:23.383771 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:23.383771 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 10:58:23.383771 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 10:58:23.383771 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 10:58:23.383771 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 10:58:23.383771 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:23.383771 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:23.383771 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:23.383771 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:23.383771 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:23.383771 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:23.384664 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:23.384664 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:23.384664 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:23.384664 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:23.384664 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:23.384664 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:23.384664 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:23.384664 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:23.384664 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:23.384664 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:23.384664 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 10:58:23.384664 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:23.384664 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 13 10:58:23.384664 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:23.384664 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 296/584] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Oct 13 10:58:23 2022] GET /identity/v3/services/network => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:23.392407 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc54382-7b75-4252-a3d4-d6df277c9f9e None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:23.465542 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:23.518272 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc54382-7b75-4252-a3d4-d6df277c9f9e None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:23.556922 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9071b183-e141-4b3a-826d-7c4edcfe807f None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:23.561687 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580935df-0996-4a8b-a18a-b78f060343fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:23.563603 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580935df-0996-4a8b-a18a-b78f060343fc None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:23.564108 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580935df-0996-4a8b-a18a-b78f060343fc None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:23.564617 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580935df-0996-4a8b-a18a-b78f060343fc None admin] PATH_INFO: `/v3/services` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:23.565467 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580935df-0996-4a8b-a18a-b78f060343fc None admin] RBAC: Adding query filter params (name=network) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:23.566084 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580935df-0996-4a8b-a18a-b78f060343fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:23.568152 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580935df-0996-4a8b-a18a-b78f060343fc None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:23.573837 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 297/585] 10.222.0.25 () {56 vars in 1112 bytes} [Thu Oct 13 10:58:23 2022] GET /identity/v3/services?name=network => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:23.580634 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580935df-0996-4a8b-a18a-b78f060343fc None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:23.622611 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:23.631440 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbf3829-06bd-498b-9bdb-06056641aa85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:23.632111 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf3829-06bd-498b-9bdb-06056641aa85 None admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:23.632390 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf3829-06bd-498b-9bdb-06056641aa85 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:23.632666 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf3829-06bd-498b-9bdb-06056641aa85 None admin] PATH_INFO: `/v3/projects/85bfac5f03e24fb3870a59a6b52dba6e/users/6e803a9cc6114c4f93869e50bca313e7/roles/409a58470d23473abb676acf7c1095ae` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:23.649030 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbf3829-06bd-498b-9bdb-06056641aa85 None admin] RBAC: Authorizing `identity:create_grant(project_id=85bfac5f03e24fb3870a59a6b52dba6e, user_id=6e803a9cc6114c4f93869e50bca313e7, role_id=409a58470d23473abb676acf7c1095ae)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:23.650514 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbf3829-06bd-498b-9bdb-06056641aa85 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:23.674030 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 289/586] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Oct 13 10:58:23 2022] PUT /identity/v3/projects/85bfac5f03e24fb3870a59a6b52dba6e/users/6e803a9cc6114c4f93869e50bca313e7/roles/409a58470d23473abb676acf7c1095ae => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 10:58:23.737326 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580935df-0996-4a8b-a18a-b78f060343fc None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:23.766253 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:23.782373 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8507dedc-3479-44ff-a1e9-72288b1bab6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:23.783292 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8507dedc-3479-44ff-a1e9-72288b1bab6e None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:23.783758 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8507dedc-3479-44ff-a1e9-72288b1bab6e None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:23.784171 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8507dedc-3479-44ff-a1e9-72288b1bab6e None admin] PATH_INFO: `/v3/services` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:23.785070 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8507dedc-3479-44ff-a1e9-72288b1bab6e None admin] RBAC: Adding query filter params (type=network) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:23.785546 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8507dedc-3479-44ff-a1e9-72288b1bab6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:23.787153 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8507dedc-3479-44ff-a1e9-72288b1bab6e None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:23.799249 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 298/587] 10.222.0.25 () {56 vars in 1112 bytes} [Thu Oct 13 10:58:23 2022] GET /identity/v3/services?type=network => generated 350 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:58:23.805192 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbf3829-06bd-498b-9bdb-06056641aa85 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:23.844603 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9708610-7ff7-498b-ad70-1488a1146f1d None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:23.845284 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9708610-7ff7-498b-ad70-1488a1146f1d None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:23.845845 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9708610-7ff7-498b-ad70-1488a1146f1d None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:23.848211 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 299/588] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:58:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:23.854483 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed0a741-c459-417e-bc78-27f1d57d05b4 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:23.855061 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed0a741-c459-417e-bc78-27f1d57d05b4 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:23.855553 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed0a741-c459-417e-bc78-27f1d57d05b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:23.889153 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-8ed0a741-c459-417e-bc78-27f1d57d05b4 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:23.889153 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-8ed0a741-c459-417e-bc78-27f1d57d05b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:23.976907 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbf3829-06bd-498b-9bdb-06056641aa85 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:24.001575 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 300/589] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 13 10:58:24.021718 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4367744f-9ffa-4034-93e3-f874653ef2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:24.022714 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367744f-9ffa-4034-93e3-f874653ef2b4 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:24.023267 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367744f-9ffa-4034-93e3-f874653ef2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:24.023739 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367744f-9ffa-4034-93e3-f874653ef2b4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:24.024700 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4367744f-9ffa-4034-93e3-f874653ef2b4 None admin] RBAC: Adding query filter params (interface=public, service_id=0909bef344a1480f8e24bfa5dc703989, region_id=RegionOne) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:24.025207 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4367744f-9ffa-4034-93e3-f874653ef2b4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:24.026845 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4367744f-9ffa-4034-93e3-f874653ef2b4 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:24.032589 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 290/590] 10.222.0.25 () {56 vars in 1251 bytes} [Thu Oct 13 10:58:23 2022] GET /identity/v3/endpoints?service_id=0909bef344a1480f8e24bfa5dc703989&interface=public®ion_id=RegionOne => generated 194 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:24.038581 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed0a741-c459-417e-bc78-27f1d57d05b4 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:24.165291 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed0a741-c459-417e-bc78-27f1d57d05b4 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:24.181815 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:24.205578 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c48ba58-8595-49a6-ad58-c7a94f9280c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:24.206220 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c48ba58-8595-49a6-ad58-c7a94f9280c3 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:24.207051 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c48ba58-8595-49a6-ad58-c7a94f9280c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:24.207306 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c48ba58-8595-49a6-ad58-c7a94f9280c3 None admin] PATH_INFO: `/v3/services` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:24.207916 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c48ba58-8595-49a6-ad58-c7a94f9280c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:24.209262 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c48ba58-8595-49a6-ad58-c7a94f9280c3 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:24.218853 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 301/591] 10.222.0.25 () {56 vars in 1087 bytes} [Thu Oct 13 10:58:24 2022] GET /identity/v3/services => generated 772 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:24.471628 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4367744f-9ffa-4034-93e3-f874653ef2b4 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:24.523725 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:24.583678 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4367744f-9ffa-4034-93e3-f874653ef2b4 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:24.625279 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c413568-66f5-4c7a-b26a-e9780e62118d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:24.626304 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c413568-66f5-4c7a-b26a-e9780e62118d None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:24.626783 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c413568-66f5-4c7a-b26a-e9780e62118d None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:24.627249 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c413568-66f5-4c7a-b26a-e9780e62118d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:24.628203 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c413568-66f5-4c7a-b26a-e9780e62118d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:24.630317 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c413568-66f5-4c7a-b26a-e9780e62118d None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:24.639801 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-6c413568-66f5-4c7a-b26a-e9780e62118d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 13 10:58:24.639801 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:24.639801 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 10:58:24.639801 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 10:58:24.639801 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 10:58:24.639801 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 10:58:24.639801 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 10:58:24.639801 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:24.639801 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 13 10:58:24.639801 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:24.639801 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 10:58:24.639801 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:24.639801 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:24.639801 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:24.639801 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:24.639801 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:24.640722 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:24.640722 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:24.640722 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:24.640722 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:24.640722 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:24.640722 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:24.640722 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:24.640722 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 10:58:24.640722 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 10:58:24.640722 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 10:58:24.640722 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 10:58:24.640722 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:24.640722 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:24.640722 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:24.640722 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:24.640722 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:24.640722 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:24.641576 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:24.641576 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:24.641576 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:24.641576 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:24.641576 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:24.641576 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:24.641576 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:24.641576 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:24.641576 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:24.641576 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:24.641576 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 10:58:24.641576 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:24.641576 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 13 10:58:24.641576 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:24.644360 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 291/592] 10.222.0.25 () {56 vars in 1132 bytes} [Thu Oct 13 10:58:24 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:24.650409 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c48ba58-8595-49a6-ad58-c7a94f9280c3 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:24.761023 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c48ba58-8595-49a6-ad58-c7a94f9280c3 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:24.799097 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c19a11-bf39-45c5-8e54-761d988373c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:24.800273 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c19a11-bf39-45c5-8e54-761d988373c8 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:24.801293 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c19a11-bf39-45c5-8e54-761d988373c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:24.801767 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c19a11-bf39-45c5-8e54-761d988373c8 None admin] PATH_INFO: `/v3/services` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:24.802660 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c19a11-bf39-45c5-8e54-761d988373c8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:24.803196 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c19a11-bf39-45c5-8e54-761d988373c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:24.804857 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c19a11-bf39-45c5-8e54-761d988373c8 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:24.810903 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 302/593] 10.222.0.25 () {56 vars in 1126 bytes} [Thu Oct 13 10:58:24 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:24.819023 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c413568-66f5-4c7a-b26a-e9780e62118d None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:24.873356 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a62d6d-0c8d-4e64-9e46-87de05300e45 None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:24.873676 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a62d6d-0c8d-4e64-9e46-87de05300e45 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:24.873916 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a62d6d-0c8d-4e64-9e46-87de05300e45 None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:24.875543 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 303/594] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:58:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:24.880713 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f474ec5-117e-43c3-acb2-0751ea5b5c1c None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:24.880995 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f474ec5-117e-43c3-acb2-0751ea5b5c1c None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:24.881272 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f474ec5-117e-43c3-acb2-0751ea5b5c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:24.909144 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-2f474ec5-117e-43c3-acb2-0751ea5b5c1c None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:24.910904 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-2f474ec5-117e-43c3-acb2-0751ea5b5c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:24.983175 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:24.990366 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c413568-66f5-4c7a-b26a-e9780e62118d None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:25.005682 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:25.022563 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 304/595] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 13 10:58:25.038026 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b53d14-c35b-4f77-8d9a-280a4997a536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:25.038642 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b53d14-c35b-4f77-8d9a-280a4997a536 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:25.038925 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b53d14-c35b-4f77-8d9a-280a4997a536 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:25.039203 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b53d14-c35b-4f77-8d9a-280a4997a536 None admin] PATH_INFO: `/v3/services` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:25.039845 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b53d14-c35b-4f77-8d9a-280a4997a536 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:25.040157 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b53d14-c35b-4f77-8d9a-280a4997a536 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:25.041594 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b53d14-c35b-4f77-8d9a-280a4997a536 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:25.046690 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 292/596] 10.222.0.25 () {56 vars in 1126 bytes} [Thu Oct 13 10:58:24 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:25.353786 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f474ec5-117e-43c3-acb2-0751ea5b5c1c None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:25.460062 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f474ec5-117e-43c3-acb2-0751ea5b5c1c None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:25.505799 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cac497-8e8b-4fc4-89a7-c3665ea0cb53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:25.506719 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cac497-8e8b-4fc4-89a7-c3665ea0cb53 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:25.507148 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cac497-8e8b-4fc4-89a7-c3665ea0cb53 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:25.507574 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cac497-8e8b-4fc4-89a7-c3665ea0cb53 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:25.520718 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cac497-8e8b-4fc4-89a7-c3665ea0cb53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:58:25.525735 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-54cac497-8e8b-4fc4-89a7-c3665ea0cb53 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 10:58:25.525735 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:25.525735 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:25.525735 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:25.525735 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:25.525735 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:25.525735 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:25.525735 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:25.525735 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:25.525735 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:25.525735 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:25.525735 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:25.525735 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:58:25.525735 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:58:25.525735 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:58:25.525735 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:58:25.526946 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:58:25.526946 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:58:25.526946 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:58:25.526946 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:58:25.526946 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:25.526946 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:25.526946 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:25.526946 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:25.526946 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:25.526946 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:25.526946 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:25.526946 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:25.526946 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:25.526946 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:25.526946 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:25.526946 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:25.528063 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:25.528063 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:25.528063 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:25.528063 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:25.528063 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:58:25.528063 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:58:25.528063 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:58:25.528063 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:58:25.528063 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:58:25.528063 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:58:25.528063 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 10:58:25.528063 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:25.533460 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 305/597] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Oct 13 10:58:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:25.540091 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b53d14-c35b-4f77-8d9a-280a4997a536 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:25.671589 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b53d14-c35b-4f77-8d9a-280a4997a536 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:25.724635 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c4d71-d9f7-4b7b-bba3-e26aa513cc72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:25.725254 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c4d71-d9f7-4b7b-bba3-e26aa513cc72 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:25.725530 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c4d71-d9f7-4b7b-bba3-e26aa513cc72 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:25.725802 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c4d71-d9f7-4b7b-bba3-e26aa513cc72 None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:25.726496 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0c4d71-d9f7-4b7b-bba3-e26aa513cc72 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:25.726800 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0c4d71-d9f7-4b7b-bba3-e26aa513cc72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:25.728227 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0c4d71-d9f7-4b7b-bba3-e26aa513cc72 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:25.744355 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 293/598] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 10:58:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:25.750165 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cac497-8e8b-4fc4-89a7-c3665ea0cb53 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:25.790126 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:25.862417 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cac497-8e8b-4fc4-89a7-c3665ea0cb53 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:25.905485 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e769fb-c637-4c4e-8b76-df1bf2fd9593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:25.906152 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e769fb-c637-4c4e-8b76-df1bf2fd9593 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:25.906432 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e769fb-c637-4c4e-8b76-df1bf2fd9593 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:25.906705 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e769fb-c637-4c4e-8b76-df1bf2fd9593 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:25.917993 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e769fb-c637-4c4e-8b76-df1bf2fd9593 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:25.919439 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e769fb-c637-4c4e-8b76-df1bf2fd9593 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:25.941357 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-55e769fb-c637-4c4e-8b76-df1bf2fd9593 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:25.941357 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:25.941357 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:25.941357 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:25.941357 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:25.941357 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:25.941357 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:25.941357 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:25.941357 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:25.941357 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:25.941357 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:25.941357 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:25.941357 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:25.941357 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:25.941357 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:25.941357 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:25.942363 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:25.942363 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:25.942363 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:25.942363 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:25.942363 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:25.942363 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:25.942363 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:25.942363 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:25.942363 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:25.942363 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:25.942363 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:25.942363 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:25.942363 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:25.942363 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:25.942363 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:25.942363 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:25.942363 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:25.943685 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:25.943685 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:25.943685 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:25.946764 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 306/599] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:25.952907 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c4d71-d9f7-4b7b-bba3-e26aa513cc72 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:26.007577 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:26.095830 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c4d71-d9f7-4b7b-bba3-e26aa513cc72 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:26.145484 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7210eeb3-071e-4edf-80f7-1663c24c1d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:26.146122 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7210eeb3-071e-4edf-80f7-1663c24c1d27 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:26.146403 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7210eeb3-071e-4edf-80f7-1663c24c1d27 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:26.146674 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7210eeb3-071e-4edf-80f7-1663c24c1d27 None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:26.147316 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7210eeb3-071e-4edf-80f7-1663c24c1d27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:26.147619 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7210eeb3-071e-4edf-80f7-1663c24c1d27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:26.148975 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7210eeb3-071e-4edf-80f7-1663c24c1d27 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:26.161542 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 294/600] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:26.167232 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e769fb-c637-4c4e-8b76-df1bf2fd9593 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:26.193489 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ca292-2c3c-4913-b64a-f359d6a3f806 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:26.193852 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ca292-2c3c-4913-b64a-f359d6a3f806 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:26.194261 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ca292-2c3c-4913-b64a-f359d6a3f806 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:26.196720 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 295/601] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:58:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 10:58:26.200716 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd44a5-e893-465a-8f50-5224ed4e6eab None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:26.200997 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd44a5-e893-465a-8f50-5224ed4e6eab None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:26.201275 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd44a5-e893-465a-8f50-5224ed4e6eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:26.221636 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-27fd44a5-e893-465a-8f50-5224ed4e6eab None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:26.223271 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-27fd44a5-e893-465a-8f50-5224ed4e6eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:26.297687 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 296/602] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 13 10:58:26.349825 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:26.376563 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e769fb-c637-4c4e-8b76-df1bf2fd9593 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:26.428190 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4136c23d-994e-4e69-95d4-3b794836d605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:26.429053 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4136c23d-994e-4e69-95d4-3b794836d605 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:26.429498 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4136c23d-994e-4e69-95d4-3b794836d605 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:26.429924 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4136c23d-994e-4e69-95d4-3b794836d605 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:26.442975 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4136c23d-994e-4e69-95d4-3b794836d605 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:26.444681 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4136c23d-994e-4e69-95d4-3b794836d605 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:26.453523 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b2acf0-63a0-42f7-a0ea-f5a1f8d9af28 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:26.453807 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b2acf0-63a0-42f7-a0ea-f5a1f8d9af28 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:26.454101 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b2acf0-63a0-42f7-a0ea-f5a1f8d9af28 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:26.455680 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 297/603] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:58:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 10:58:26.458929 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-4136c23d-994e-4e69-95d4-3b794836d605 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 13 10:58:26.458929 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:26.458929 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:26.458929 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:26.458929 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:26.458929 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:26.458929 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:26.458929 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:26.458929 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:26.458929 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:26.458929 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:26.458929 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:26.458929 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 10:58:26.458929 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 10:58:26.458929 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 10:58:26.458929 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 10:58:26.459873 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:26.459873 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:26.459873 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 10:58:26.459873 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:26.459873 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 10:58:26.459873 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:26.459873 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:26.459873 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:26.459873 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:26.459873 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:26.459873 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:26.459873 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:26.459873 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:26.459873 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:26.459873 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:26.459873 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:26.459873 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:26.459873 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:26.460818 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:26.460818 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:26.460818 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 10:58:26.460818 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 10:58:26.460818 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 10:58:26.460818 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 10:58:26.460818 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 10:58:26.460818 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 10:58:26.460818 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 13 10:58:26.460818 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:26.460818 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 307/604] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Oct 13 10:58:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:26.466378 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b2acf0-63a0-42f7-a0ea-f5a1f8d9af28 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:26.467152 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47e655-0db0-4841-b118-acde893fca9f None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:26.467647 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47e655-0db0-4841-b118-acde893fca9f None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:26.468138 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47e655-0db0-4841-b118-acde893fca9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:26.498946 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-4c47e655-0db0-4841-b118-acde893fca9f None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:26.501245 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-4c47e655-0db0-4841-b118-acde893fca9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:26.516366 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:26.632544 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b2acf0-63a0-42f7-a0ea-f5a1f8d9af28 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:26.635659 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 308/605] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 10:58:26.646678 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c47e655-0db0-4841-b118-acde893fca9f None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:26.722786 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b661c0f3-1fc1-48ea-a49b-209fbcd1f6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:26.723329 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b661c0f3-1fc1-48ea-a49b-209fbcd1f6a0 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:26.723614 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b661c0f3-1fc1-48ea-a49b-209fbcd1f6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:26.723893 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b661c0f3-1fc1-48ea-a49b-209fbcd1f6a0 None admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:26.724637 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b661c0f3-1fc1-48ea-a49b-209fbcd1f6a0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:26.724947 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b661c0f3-1fc1-48ea-a49b-209fbcd1f6a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:26.726431 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b661c0f3-1fc1-48ea-a49b-209fbcd1f6a0 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:26.729493 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:26.756813 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c47e655-0db0-4841-b118-acde893fca9f None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:26.765639 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 298/606] 10.222.0.25 () {56 vars in 1135 bytes} [Thu Oct 13 10:58:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:26.771848 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b661c0f3-1fc1-48ea-a49b-209fbcd1f6a0 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:26.794006 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48102d10-5460-410f-b474-e6e98760aae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:26.794700 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48102d10-5460-410f-b474-e6e98760aae7 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:26.794981 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48102d10-5460-410f-b474-e6e98760aae7 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:26.795256 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48102d10-5460-410f-b474-e6e98760aae7 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:26.795911 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48102d10-5460-410f-b474-e6e98760aae7 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:26.797468 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48102d10-5460-410f-b474-e6e98760aae7 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:26.807137 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-48102d10-5460-410f-b474-e6e98760aae7 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 13 10:58:26.807137 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:26.807137 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 10:58:26.807137 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 10:58:26.807137 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 10:58:26.807137 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 10:58:26.807137 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 10:58:26.807137 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:26.807137 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 13 10:58:26.807137 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:26.807137 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 10:58:26.807137 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:26.807137 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:26.807137 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:26.807137 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:26.807137 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:26.807137 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:26.808196 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:26.808196 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:26.808196 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:26.808196 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:26.808196 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:26.808196 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:26.808196 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 10:58:26.808196 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 10:58:26.808196 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 10:58:26.808196 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 10:58:26.808196 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:26.808196 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:26.808196 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:26.808196 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:26.808196 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:26.808196 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:26.809500 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:26.809500 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:26.809500 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:26.809500 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:26.809500 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:26.809500 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:26.809500 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:26.809500 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:26.809500 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:26.809500 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:26.809500 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 10:58:26.809500 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:26.809500 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 13 10:58:26.809500 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:26.809500 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 309/607] 10.222.0.25 () {56 vars in 1129 bytes} [Thu Oct 13 10:58:26 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 10:58:26.814010 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48102d10-5460-410f-b474-e6e98760aae7 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:26.939396 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48102d10-5460-410f-b474-e6e98760aae7 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:26.962331 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:26.975403 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934f8ea6-cfad-48b8-9e2d-d3ec49f6bc62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:26.976093 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f8ea6-cfad-48b8-9e2d-d3ec49f6bc62 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:26.976384 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f8ea6-cfad-48b8-9e2d-d3ec49f6bc62 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:26.976660 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f8ea6-cfad-48b8-9e2d-d3ec49f6bc62 None admin] PATH_INFO: `/v3/services` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:26.977424 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934f8ea6-cfad-48b8-9e2d-d3ec49f6bc62 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:26.977737 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934f8ea6-cfad-48b8-9e2d-d3ec49f6bc62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:26.979245 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934f8ea6-cfad-48b8-9e2d-d3ec49f6bc62 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:26.983060 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b661c0f3-1fc1-48ea-a49b-209fbcd1f6a0 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:26.988870 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 310/608] 10.222.0.25 () {56 vars in 1124 bytes} [Thu Oct 13 10:58:26 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:26.988870 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934f8ea6-cfad-48b8-9e2d-d3ec49f6bc62 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:26.993176 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:27.029128 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da505a9-9436-4f77-acfc-3157a39148b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:27.029875 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da505a9-9436-4f77-acfc-3157a39148b9 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:27.030103 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da505a9-9436-4f77-acfc-3157a39148b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:27.030364 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da505a9-9436-4f77-acfc-3157a39148b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:27.116418 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da505a9-9436-4f77-acfc-3157a39148b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:27.117958 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da505a9-9436-4f77-acfc-3157a39148b9 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:27.118329 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934f8ea6-cfad-48b8-9e2d-d3ec49f6bc62 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:27.159956 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844a62d6-ae2c-4534-926d-54ae8fcbb99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:27.160591 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a62d6-ae2c-4534-926d-54ae8fcbb99d None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:27.160869 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a62d6-ae2c-4534-926d-54ae8fcbb99d None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:27.161141 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a62d6-ae2c-4534-926d-54ae8fcbb99d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:27.174131 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844a62d6-ae2c-4534-926d-54ae8fcbb99d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:58:27.180029 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-844a62d6-ae2c-4534-926d-54ae8fcbb99d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 13 10:58:27.180029 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:27.180029 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:27.180029 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:27.180029 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:27.180029 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:27.180029 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:27.180029 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:27.180029 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:27.180029 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:27.180029 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:27.180029 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:27.180029 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:58:27.180029 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:58:27.180029 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:58:27.180029 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:58:27.180950 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:58:27.180950 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:58:27.180950 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:58:27.180950 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:58:27.180950 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:27.180950 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:27.180950 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:27.180950 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:27.180950 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:27.180950 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:27.180950 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:27.180950 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:27.180950 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:27.180950 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:27.180950 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:27.180950 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:27.181795 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:27.181795 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:27.181795 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:27.181795 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:27.181795 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:58:27.181795 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:58:27.181795 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:58:27.181795 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:58:27.181795 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:58:27.181795 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:58:27.181795 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 13 10:58:27.181795 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:27.181795 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 311/609] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Oct 13 10:58:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:27.183438 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844a62d6-ae2c-4534-926d-54ae8fcbb99d None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:27.211173 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:27.233142 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 299/610] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Oct 13 10:58:26 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 13 10:58:27.234792 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0f348-1da5-4030-a737-26af03a4ee2b None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:27.235171 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0f348-1da5-4030-a737-26af03a4ee2b None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:27.235786 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0f348-1da5-4030-a737-26af03a4ee2b None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:27.238323 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 300/611] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:58:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:27.239344 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e0f348-1da5-4030-a737-26af03a4ee2b None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:27.255495 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:27.296409 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844a62d6-ae2c-4534-926d-54ae8fcbb99d None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:27.332670 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d77d5a1-25c8-4142-9e27-67d462dc1906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:27.333291 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d77d5a1-25c8-4142-9e27-67d462dc1906 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:27.333548 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d77d5a1-25c8-4142-9e27-67d462dc1906 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:27.333816 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d77d5a1-25c8-4142-9e27-67d462dc1906 None admin] PATH_INFO: `/v3/services` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:27.334471 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d77d5a1-25c8-4142-9e27-67d462dc1906 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:27.334765 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d77d5a1-25c8-4142-9e27-67d462dc1906 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:27.336103 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d77d5a1-25c8-4142-9e27-67d462dc1906 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:27.341578 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 312/612] 10.222.0.25 () {56 vars in 1124 bytes} [Thu Oct 13 10:58:27 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:27.342869 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d77d5a1-25c8-4142-9e27-67d462dc1906 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:27.343701 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e0f348-1da5-4030-a737-26af03a4ee2b None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:27.381383 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85918309-840a-4afa-b421-5d8bb7887f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:27.382016 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85918309-840a-4afa-b421-5d8bb7887f53 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:27.382296 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85918309-840a-4afa-b421-5d8bb7887f53 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:27.382573 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85918309-840a-4afa-b421-5d8bb7887f53 None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:27.383226 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85918309-840a-4afa-b421-5d8bb7887f53 None admin] RBAC: Adding query filter params (name=service) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:27.383535 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85918309-840a-4afa-b421-5d8bb7887f53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:27.384898 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85918309-840a-4afa-b421-5d8bb7887f53 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:27.397784 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 301/613] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Oct 13 10:58:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:27.397784 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21efc900-5c51-4f9c-9ef0-bc62c9e00caf None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:27.397784 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21efc900-5c51-4f9c-9ef0-bc62c9e00caf None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:27.397784 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21efc900-5c51-4f9c-9ef0-bc62c9e00caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:27.413209 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-21efc900-5c51-4f9c-9ef0-bc62c9e00caf None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:27.414411 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-21efc900-5c51-4f9c-9ef0-bc62c9e00caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:27.454508 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d77d5a1-25c8-4142-9e27-67d462dc1906 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:27.458170 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:27.483763 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:27.492737 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00061e2c-bc43-4c78-85ed-55a67e652094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:27.493367 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00061e2c-bc43-4c78-85ed-55a67e652094 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:27.493646 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00061e2c-bc43-4c78-85ed-55a67e652094 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:27.493918 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00061e2c-bc43-4c78-85ed-55a67e652094 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:27.498227 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 302/614] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 10:58:27.498961 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21efc900-5c51-4f9c-9ef0-bc62c9e00caf None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:27.504977 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00061e2c-bc43-4c78-85ed-55a67e652094 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:27.506465 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00061e2c-bc43-4c78-85ed-55a67e652094 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:27.522287 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-00061e2c-bc43-4c78-85ed-55a67e652094 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:27.522287 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:27.522287 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:27.522287 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:27.522287 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:27.522287 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:27.522287 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:27.522287 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:27.522287 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:27.522287 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:27.522287 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:27.522287 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:27.522287 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:27.522287 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:27.522287 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:27.522287 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:27.523254 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:27.523254 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:27.523254 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:27.523254 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:27.523254 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:27.523254 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:27.523254 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:27.523254 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:27.523254 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:27.523254 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:27.523254 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:27.523254 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:27.523254 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:27.523254 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:27.523254 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:27.523254 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:27.523254 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:27.524166 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:27.524166 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:27.524166 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:27.524166 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 313/615] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:27.524828 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00061e2c-bc43-4c78-85ed-55a67e652094 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:27.624248 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21efc900-5c51-4f9c-9ef0-bc62c9e00caf None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:27.652605 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00061e2c-bc43-4c78-85ed-55a67e652094 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:27.661868 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65486173-7cdd-4975-9f9e-2ba965e69d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:27.662513 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65486173-7cdd-4975-9f9e-2ba965e69d91 None admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:27.662852 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65486173-7cdd-4975-9f9e-2ba965e69d91 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:27.663132 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65486173-7cdd-4975-9f9e-2ba965e69d91 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:27.663799 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65486173-7cdd-4975-9f9e-2ba965e69d91 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:27.665239 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65486173-7cdd-4975-9f9e-2ba965e69d91 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:27.692981 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 303/616] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 10:58:27 2022] POST /identity/v3/endpoints => generated 346 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 10:58:27.693983 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65486173-7cdd-4975-9f9e-2ba965e69d91 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:27.714445 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2312fabb-6026-40a9-a037-4b99f6054f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:27.715442 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2312fabb-6026-40a9-a037-4b99f6054f12 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:27.715919 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2312fabb-6026-40a9-a037-4b99f6054f12 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:27.716404 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2312fabb-6026-40a9-a037-4b99f6054f12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:27.728940 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2312fabb-6026-40a9-a037-4b99f6054f12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:27.730882 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2312fabb-6026-40a9-a037-4b99f6054f12 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:27.736224 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:27.751330 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-2312fabb-6026-40a9-a037-4b99f6054f12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:27.751330 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:27.751330 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:27.751330 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:27.751330 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:27.751330 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:27.751330 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:27.751330 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:27.751330 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:27.751330 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:27.751330 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:27.751330 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:27.751330 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:27.751330 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:27.751330 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:27.751330 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:27.752384 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:27.752384 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:27.752384 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:27.752384 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:27.752384 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:27.752384 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:27.752384 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:27.752384 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:27.752384 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:27.752384 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:27.752384 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:27.752384 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:27.752384 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:27.752384 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:27.752384 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:27.752384 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:27.752384 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:27.753855 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:27.753855 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:27.753855 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:27.753855 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 314/617] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:27.755336 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339c92c-5bfa-4ba5-bf49-f2df0495281d None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:27.755624 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339c92c-5bfa-4ba5-bf49-f2df0495281d None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:27.755898 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339c92c-5bfa-4ba5-bf49-f2df0495281d None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:27.757402 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 315/618] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:58:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:27.762939 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1339c92c-5bfa-4ba5-bf49-f2df0495281d None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:27.795785 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:27.834657 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65486173-7cdd-4975-9f9e-2ba965e69d91 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:27.874167 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e5bd37-7005-46c8-b4b9-b66bc41de74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:27.874795 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e5bd37-7005-46c8-b4b9-b66bc41de74e None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:27.875078 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e5bd37-7005-46c8-b4b9-b66bc41de74e None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:27.875409 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e5bd37-7005-46c8-b4b9-b66bc41de74e None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:27.879446 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e5bd37-7005-46c8-b4b9-b66bc41de74e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:27.879446 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e5bd37-7005-46c8-b4b9-b66bc41de74e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:27.879446 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e5bd37-7005-46c8-b4b9-b66bc41de74e None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:27.890587 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1339c92c-5bfa-4ba5-bf49-f2df0495281d None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:27.895333 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 304/619] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:27.897991 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a993a95-f392-43df-a8d6-9731ac4020b9 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:27.897991 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a993a95-f392-43df-a8d6-9731ac4020b9 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:27.897991 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a993a95-f392-43df-a8d6-9731ac4020b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:27.917847 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-3a993a95-f392-43df-a8d6-9731ac4020b9 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:27.919100 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-3a993a95-f392-43df-a8d6-9731ac4020b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:27.933149 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0fae5c-bd31-4bca-81cd-397de2e310e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:27.933953 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0fae5c-bd31-4bca-81cd-397de2e310e2 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:27.934239 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0fae5c-bd31-4bca-81cd-397de2e310e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:27.934516 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0fae5c-bd31-4bca-81cd-397de2e310e2 None admin] PATH_INFO: `/v3/domains` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:27.935169 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0fae5c-bd31-4bca-81cd-397de2e310e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:27.935585 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0fae5c-bd31-4bca-81cd-397de2e310e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:27.936904 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0fae5c-bd31-4bca-81cd-397de2e310e2 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:27.949893 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 316/620] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:58:27.950898 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0fae5c-bd31-4bca-81cd-397de2e310e2 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:27.996448 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 305/621] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 10:58:27.997808 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a993a95-f392-43df-a8d6-9731ac4020b9 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:28.025124 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:28.043314 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:28.055617 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0fae5c-bd31-4bca-81cd-397de2e310e2 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:28.099585 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bb8e7e-25e4-44b0-a7ff-fc996afd2533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:28.100225 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb8e7e-25e4-44b0-a7ff-fc996afd2533 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:28.100507 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb8e7e-25e4-44b0-a7ff-fc996afd2533 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:28.100780 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb8e7e-25e4-44b0-a7ff-fc996afd2533 None admin] PATH_INFO: `/v3/services/network` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:28.101365 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bb8e7e-25e4-44b0-a7ff-fc996afd2533 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:28.102761 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bb8e7e-25e4-44b0-a7ff-fc996afd2533 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:28.111637 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-21bb8e7e-25e4-44b0-a7ff-fc996afd2533 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 13 10:58:28.111637 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:28.111637 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 10:58:28.111637 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 10:58:28.111637 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 10:58:28.111637 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 10:58:28.111637 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 10:58:28.111637 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:28.111637 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 13 10:58:28.111637 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:28.111637 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 10:58:28.111637 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:28.111637 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:28.111637 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:28.111637 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:28.111637 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:28.111637 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:28.113405 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:28.113405 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:28.113405 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:28.113405 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:28.113405 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:28.113405 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:28.113405 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 10:58:28.113405 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 10:58:28.113405 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 10:58:28.113405 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 10:58:28.113405 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:28.113405 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:28.113405 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:28.113405 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:28.113405 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:28.113405 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:28.114279 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:28.114279 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:28.114279 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:28.114279 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:28.114279 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:28.114279 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:28.114279 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:28.114279 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:28.114279 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:28.114279 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:28.114279 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 10:58:28.114279 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:28.114279 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 13 10:58:28.114279 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:28.114279 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 317/622] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Oct 13 10:58:27 2022] GET /identity/v3/services/network => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:28.115325 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bb8e7e-25e4-44b0-a7ff-fc996afd2533 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:28.134427 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a993a95-f392-43df-a8d6-9731ac4020b9 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:28.181974 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c392e693-5a85-4431-83af-c4ac7099068b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:28.182842 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c392e693-5a85-4431-83af-c4ac7099068b None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:28.183526 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c392e693-5a85-4431-83af-c4ac7099068b None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:28.184807 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c392e693-5a85-4431-83af-c4ac7099068b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:28.193360 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c392e693-5a85-4431-83af-c4ac7099068b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:28.195270 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c392e693-5a85-4431-83af-c4ac7099068b None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:28.211610 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-c392e693-5a85-4431-83af-c4ac7099068b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:58:28.211610 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:28.211610 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:28.211610 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:28.211610 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:28.211610 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:28.211610 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:28.211610 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:28.211610 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:28.211610 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:28.211610 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:28.211610 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:28.211610 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 10:58:28.211610 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 10:58:28.211610 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 10:58:28.212718 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 10:58:28.212718 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:28.212718 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:28.212718 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:28.212718 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:28.212718 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:28.212718 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:28.212718 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:28.212718 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:28.212718 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:28.212718 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:28.212718 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:28.212718 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:28.212718 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:28.212718 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:28.212718 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:28.212718 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:28.213799 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 10:58:28.213799 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 10:58:28.213799 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 10:58:28.213799 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 10:58:28.213799 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 10:58:28.213799 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 10:58:28.213799 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:58:28.213799 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:28.216606 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 306/623] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Oct 13 10:58:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:28.217525 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c392e693-5a85-4431-83af-c4ac7099068b None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:28.223024 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bb8e7e-25e4-44b0-a7ff-fc996afd2533 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:28.259874 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a6c10a-8948-4117-8124-1934debf72fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:28.260612 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6c10a-8948-4117-8124-1934debf72fb None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:28.261036 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6c10a-8948-4117-8124-1934debf72fb None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:28.261405 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6c10a-8948-4117-8124-1934debf72fb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:28.270463 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a6c10a-8948-4117-8124-1934debf72fb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:28.272150 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a6c10a-8948-4117-8124-1934debf72fb None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:28.284769 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-43a6c10a-8948-4117-8124-1934debf72fb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 13 10:58:28.284769 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:28.284769 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:28.284769 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:28.284769 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:28.284769 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:28.284769 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:28.284769 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:28.284769 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:28.284769 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:28.284769 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:28.284769 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:28.284769 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 10:58:28.284769 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 10:58:28.284769 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 10:58:28.284769 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 10:58:28.285930 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:28.285930 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:28.285930 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 10:58:28.285930 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:28.285930 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 10:58:28.285930 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:28.285930 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:28.285930 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:28.285930 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:28.285930 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:28.285930 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:28.285930 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:28.285930 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:28.285930 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:28.285930 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:28.285930 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:28.285930 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:28.285930 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:28.287089 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:28.287089 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:28.287089 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 10:58:28.287089 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 10:58:28.287089 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 10:58:28.287089 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 10:58:28.287089 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 10:58:28.287089 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 10:58:28.287089 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 13 10:58:28.287089 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:28.288622 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 318/624] 10.222.0.25 () {56 vars in 1117 bytes} [Thu Oct 13 10:58:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:28.289574 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a6c10a-8948-4117-8124-1934debf72fb None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:28.305063 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:28.318937 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:28.337918 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c392e693-5a85-4431-83af-c4ac7099068b None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:28.372251 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf8b8f7-e3ab-48b9-b2ad-dd9f10d382fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:28.372912 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf8b8f7-e3ab-48b9-b2ad-dd9f10d382fd None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:28.373196 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf8b8f7-e3ab-48b9-b2ad-dd9f10d382fd None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:28.373471 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf8b8f7-e3ab-48b9-b2ad-dd9f10d382fd None admin] PATH_INFO: `/v3/services` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:28.374156 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf8b8f7-e3ab-48b9-b2ad-dd9f10d382fd None admin] RBAC: Adding query filter params (name=network) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:28.374462 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf8b8f7-e3ab-48b9-b2ad-dd9f10d382fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:28.375835 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf8b8f7-e3ab-48b9-b2ad-dd9f10d382fd None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:28.385773 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 307/625] 10.222.0.25 () {56 vars in 1112 bytes} [Thu Oct 13 10:58:28 2022] GET /identity/v3/services?name=network => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:28.385773 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf8b8f7-e3ab-48b9-b2ad-dd9f10d382fd None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:28.402206 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a6c10a-8948-4117-8124-1934debf72fb None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:28.437681 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb3c32c-ad42-419e-a550-e5ae30628462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:28.438576 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3c32c-ad42-419e-a550-e5ae30628462 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:28.438855 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3c32c-ad42-419e-a550-e5ae30628462 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:28.439125 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3c32c-ad42-419e-a550-e5ae30628462 None admin] PATH_INFO: `/v3/projects` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:28.439969 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb3c32c-ad42-419e-a550-e5ae30628462 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:28.440276 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb3c32c-ad42-419e-a550-e5ae30628462 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:28.442583 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb3c32c-ad42-419e-a550-e5ae30628462 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:28.460426 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 319/626] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Oct 13 10:58:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:28.460426 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb3c32c-ad42-419e-a550-e5ae30628462 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:28.494040 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf8b8f7-e3ab-48b9-b2ad-dd9f10d382fd None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:28.529920 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd91fdc-5c4d-4d63-aed4-578de4a038fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:28.530492 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd91fdc-5c4d-4d63-aed4-578de4a038fb None admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:28.530767 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd91fdc-5c4d-4d63-aed4-578de4a038fb None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:28.531041 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd91fdc-5c4d-4d63-aed4-578de4a038fb None admin] PATH_INFO: `/v3/services` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:28.531681 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd91fdc-5c4d-4d63-aed4-578de4a038fb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:28.533039 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd91fdc-5c4d-4d63-aed4-578de4a038fb None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:28.535976 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:28.550792 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 308/627] 10.222.0.25 () {60 vars in 1141 bytes} [Thu Oct 13 10:58:28 2022] POST /identity/v3/services => generated 269 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 10:58:28.551610 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd91fdc-5c4d-4d63-aed4-578de4a038fb None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:28.564112 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:28.571381 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb3c32c-ad42-419e-a550-e5ae30628462 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:28.619204 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0c8e6e-174c-480c-beb9-05738b4cde96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:28.620024 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c8e6e-174c-480c-beb9-05738b4cde96 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:28.620391 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c8e6e-174c-480c-beb9-05738b4cde96 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:28.620752 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c8e6e-174c-480c-beb9-05738b4cde96 None admin] PATH_INFO: `/v3/users` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:28.621614 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0c8e6e-174c-480c-beb9-05738b4cde96 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:28.622177 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0c8e6e-174c-480c-beb9-05738b4cde96 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:28.623925 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0c8e6e-174c-480c-beb9-05738b4cde96 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:28.646708 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 320/628] 10.222.0.25 () {56 vars in 1149 bytes} [Thu Oct 13 10:58:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:28.647872 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0c8e6e-174c-480c-beb9-05738b4cde96 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:28.698445 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd91fdc-5c4d-4d63-aed4-578de4a038fb None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:28.744836 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98534b6b-640b-4298-8a4a-748c1f06445a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:28.745622 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98534b6b-640b-4298-8a4a-748c1f06445a None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:28.745979 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98534b6b-640b-4298-8a4a-748c1f06445a None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:28.746331 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98534b6b-640b-4298-8a4a-748c1f06445a None admin] PATH_INFO: `/v3/services` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:28.747046 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98534b6b-640b-4298-8a4a-748c1f06445a None admin] RBAC: Adding query filter params (type=network) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:28.747674 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98534b6b-640b-4298-8a4a-748c1f06445a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:28.749708 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98534b6b-640b-4298-8a4a-748c1f06445a None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:28.763234 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 309/629] 10.222.0.25 () {56 vars in 1112 bytes} [Thu Oct 13 10:58:28 2022] GET /identity/v3/services?type=network => generated 350 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:28.764393 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98534b6b-640b-4298-8a4a-748c1f06445a None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:28.775013 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0c8e6e-174c-480c-beb9-05738b4cde96 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:28.812871 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:28.826910 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a7515a-5ca8-4e34-a779-02e2fefa13de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:28.827685 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7515a-5ca8-4e34-a779-02e2fefa13de None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:28.828079 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7515a-5ca8-4e34-a779-02e2fefa13de None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:28.828647 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7515a-5ca8-4e34-a779-02e2fefa13de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:28.829388 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a7515a-5ca8-4e34-a779-02e2fefa13de None admin] RBAC: Adding query filter params (role.id=ea564961b1db4eb4a1d4d880964611b2, scope.project.id=85bfac5f03e24fb3870a59a6b52dba6e, user.id=e24c779d0a604ef28dfc1235ee76a711) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:28.829700 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a7515a-5ca8-4e34-a779-02e2fefa13de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:28.838075 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a7515a-5ca8-4e34-a779-02e2fefa13de None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:28.840374 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 321/630] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Oct 13 10:58:28 2022] GET /identity/v3/role_assignments?user.id=e24c779d0a604ef28dfc1235ee76a711&scope.project.id=85bfac5f03e24fb3870a59a6b52dba6e&role.id=ea564961b1db4eb4a1d4d880964611b2 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:28.841652 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a7515a-5ca8-4e34-a779-02e2fefa13de None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:28.846980 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:28.923757 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98534b6b-640b-4298-8a4a-748c1f06445a None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:28.998005 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d5f8d5-99aa-40ff-a7a7-c92051a06ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:28.998665 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d5f8d5-99aa-40ff-a7a7-c92051a06ca6 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:28.998946 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d5f8d5-99aa-40ff-a7a7-c92051a06ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:28.999223 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d5f8d5-99aa-40ff-a7a7-c92051a06ca6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:29.015983 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a7515a-5ca8-4e34-a779-02e2fefa13de None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:29.071665 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d5f8d5-99aa-40ff-a7a7-c92051a06ca6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:29.073030 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d5f8d5-99aa-40ff-a7a7-c92051a06ca6 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:29.083915 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be4c9a8-92fe-4ae8-acec-c99ecc96cb9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:29.084644 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4c9a8-92fe-4ae8-acec-c99ecc96cb9d None admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:29.084929 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4c9a8-92fe-4ae8-acec-c99ecc96cb9d None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:29.085199 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4c9a8-92fe-4ae8-acec-c99ecc96cb9d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:29.085906 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be4c9a8-92fe-4ae8-acec-c99ecc96cb9d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:29.087376 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be4c9a8-92fe-4ae8-acec-c99ecc96cb9d None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:29.122799 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 322/631] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 10:58:28 2022] POST /identity/v3/endpoints => generated 337 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 10:58:29.146165 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:29.185569 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 310/632] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Oct 13 10:58:28 2022] GET /identity/v3/auth/tokens => generated 1112 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 13 10:58:29.191523 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be4c9a8-92fe-4ae8-acec-c99ecc96cb9d None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:29.245507 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:29.325658 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be4c9a8-92fe-4ae8-acec-c99ecc96cb9d None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:29.365180 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9f2234-143f-4ea3-bf2e-33a5c472da1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:29.366243 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f2234-143f-4ea3-bf2e-33a5c472da1a None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:29.366747 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f2234-143f-4ea3-bf2e-33a5c472da1a None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:29.367230 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f2234-143f-4ea3-bf2e-33a5c472da1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:29.379114 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9f2234-143f-4ea3-bf2e-33a5c472da1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:29.380907 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9f2234-143f-4ea3-bf2e-33a5c472da1a None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:29.396628 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-ec9f2234-143f-4ea3-bf2e-33a5c472da1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:29.396628 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:29.396628 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:29.396628 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:29.396628 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:29.396628 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:29.396628 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:29.396628 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:29.396628 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:29.396628 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:29.396628 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:29.396628 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:29.396628 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:29.396628 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:29.396628 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:29.396628 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:29.397664 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:29.397664 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:29.397664 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:29.397664 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:29.397664 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:29.397664 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:29.397664 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:29.397664 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:29.397664 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:29.397664 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:29.397664 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:29.397664 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:29.397664 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:29.397664 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:29.397664 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:29.397664 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:29.397664 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:29.398592 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:29.398592 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:29.398592 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:29.400722 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 323/633] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:29.406772 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d5f8d5-99aa-40ff-a7a7-c92051a06ca6 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:29.518419 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d5f8d5-99aa-40ff-a7a7-c92051a06ca6 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:29.559557 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019010f0-ac3a-46d2-9a42-286122c93b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:29.560532 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019010f0-ac3a-46d2-9a42-286122c93b29 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:29.561018 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019010f0-ac3a-46d2-9a42-286122c93b29 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:29.561524 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019010f0-ac3a-46d2-9a42-286122c93b29 None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:29.562439 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019010f0-ac3a-46d2-9a42-286122c93b29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:29.562961 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019010f0-ac3a-46d2-9a42-286122c93b29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:29.564515 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019010f0-ac3a-46d2-9a42-286122c93b29 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:29.577147 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 311/634] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:29.582898 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9f2234-143f-4ea3-bf2e-33a5c472da1a None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:29.687304 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:29.695283 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9f2234-143f-4ea3-bf2e-33a5c472da1a None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:29.731011 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21bf138-ae32-441a-ae97-6bed8f4839d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:29.731988 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21bf138-ae32-441a-ae97-6bed8f4839d7 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:29.732509 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21bf138-ae32-441a-ae97-6bed8f4839d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:29.732985 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21bf138-ae32-441a-ae97-6bed8f4839d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:29.740875 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21bf138-ae32-441a-ae97-6bed8f4839d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:29.742643 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21bf138-ae32-441a-ae97-6bed8f4839d7 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:29.754286 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-e21bf138-ae32-441a-ae97-6bed8f4839d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:58:29.754286 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:29.754286 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:29.754286 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:29.754286 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:29.754286 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:29.754286 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:29.754286 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:29.754286 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:29.754286 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:29.754286 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:29.754286 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:29.754286 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 10:58:29.754286 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 10:58:29.754286 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 10:58:29.755156 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 10:58:29.755156 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:29.755156 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:29.755156 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:29.755156 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:29.755156 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:29.755156 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:29.755156 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:29.755156 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:29.755156 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:29.755156 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:29.755156 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:29.755156 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:29.755156 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:29.755156 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:29.755156 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:29.755156 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:29.756058 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 10:58:29.756058 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 10:58:29.756058 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 10:58:29.756058 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 10:58:29.756058 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 10:58:29.756058 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 10:58:29.756058 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:58:29.756058 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:29.758375 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 324/635] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Oct 13 10:58:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:29.767010 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019010f0-ac3a-46d2-9a42-286122c93b29 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:29.798407 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:29.880026 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019010f0-ac3a-46d2-9a42-286122c93b29 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:29.917142 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f21d089-26d9-45ca-a5f3-7018b1b53834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:29.917759 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f21d089-26d9-45ca-a5f3-7018b1b53834 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:29.918070 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f21d089-26d9-45ca-a5f3-7018b1b53834 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:29.918345 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f21d089-26d9-45ca-a5f3-7018b1b53834 None admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:29.919039 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f21d089-26d9-45ca-a5f3-7018b1b53834 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:29.919347 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f21d089-26d9-45ca-a5f3-7018b1b53834 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:29.920788 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f21d089-26d9-45ca-a5f3-7018b1b53834 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:29.933856 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 312/636] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Oct 13 10:58:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:29.939698 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21bf138-ae32-441a-ae97-6bed8f4839d7 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:29.990442 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72198167-7b95-49d6-a24d-16a981dbbfe8 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:29.991121 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72198167-7b95-49d6-a24d-16a981dbbfe8 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:29.991595 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72198167-7b95-49d6-a24d-16a981dbbfe8 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:29.993413 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 313/637] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:58:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:29.999300 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a2357-3895-4e5c-a286-31e22cb0b53f None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:29.999829 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a2357-3895-4e5c-a286-31e22cb0b53f None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:30.000305 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a2357-3895-4e5c-a286-31e22cb0b53f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:30.020185 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-578a2357-3895-4e5c-a286-31e22cb0b53f None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:30.021851 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-578a2357-3895-4e5c-a286-31e22cb0b53f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:30.057274 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21bf138-ae32-441a-ae97-6bed8f4839d7 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:30.106181 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062f5982-e616-4e18-bdb7-84f394456dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:30.106181 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f5982-e616-4e18-bdb7-84f394456dc3 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:30.106181 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f5982-e616-4e18-bdb7-84f394456dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:30.106181 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f5982-e616-4e18-bdb7-84f394456dc3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:30.106592 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062f5982-e616-4e18-bdb7-84f394456dc3 None admin] RBAC: Adding query filter params (role.id=409a58470d23473abb676acf7c1095ae, scope.project.id=85bfac5f03e24fb3870a59a6b52dba6e, user.id=6e803a9cc6114c4f93869e50bca313e7) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:30.106592 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062f5982-e616-4e18-bdb7-84f394456dc3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:30.106592 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062f5982-e616-4e18-bdb7-84f394456dc3 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:30.107029 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 314/638] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:29 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 10:58:30.113459 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 325/639] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Oct 13 10:58:29 2022] GET /identity/v3/role_assignments?user.id=6e803a9cc6114c4f93869e50bca313e7&scope.project.id=85bfac5f03e24fb3870a59a6b52dba6e&role.id=409a58470d23473abb676acf7c1095ae => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:30.370279 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578a2357-3895-4e5c-a286-31e22cb0b53f None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:30.389440 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:30.473951 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578a2357-3895-4e5c-a286-31e22cb0b53f None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:30.510379 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e5c529-b75d-4792-a586-b67a47da3481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:30.511129 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e5c529-b75d-4792-a586-b67a47da3481 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:30.511467 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e5c529-b75d-4792-a586-b67a47da3481 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:30.511780 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e5c529-b75d-4792-a586-b67a47da3481 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:30.512479 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e5c529-b75d-4792-a586-b67a47da3481 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:30.514007 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e5c529-b75d-4792-a586-b67a47da3481 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:30.523068 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-c2e5c529-b75d-4792-a586-b67a47da3481 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 13 10:58:30.523068 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:30.523068 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 10:58:30.523068 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 10:58:30.523068 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 10:58:30.523068 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 10:58:30.523068 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 10:58:30.523068 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:30.523068 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 13 10:58:30.523068 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:30.523068 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 10:58:30.523068 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:30.523068 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:30.523068 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:30.523068 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:30.523068 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:30.523068 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:30.524018 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:30.524018 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:30.524018 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:30.524018 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:30.524018 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:30.524018 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:30.524018 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 10:58:30.524018 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 10:58:30.524018 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 10:58:30.524018 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 10:58:30.524018 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:30.524018 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:30.524018 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:30.524018 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:30.524018 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:30.524018 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:30.524898 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:30.524898 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:30.524898 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:30.524898 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:30.524898 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:30.524898 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:30.524898 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:30.524898 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:30.524898 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:30.524898 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:30.524898 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 10:58:30.524898 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:30.524898 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 13 10:58:30.524898 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:30.524898 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 315/640] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Oct 13 10:58:30 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:30.530276 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062f5982-e616-4e18-bdb7-84f394456dc3 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:30.550452 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:30.633487 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062f5982-e616-4e18-bdb7-84f394456dc3 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:30.667329 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e0e718-c2da-4c9f-8eb2-86d7178bb649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:30.667945 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0e718-c2da-4c9f-8eb2-86d7178bb649 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:30.668227 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0e718-c2da-4c9f-8eb2-86d7178bb649 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:30.668491 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0e718-c2da-4c9f-8eb2-86d7178bb649 None admin] PATH_INFO: `/v3/services` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:30.669126 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e0e718-c2da-4c9f-8eb2-86d7178bb649 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:30.669428 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e0e718-c2da-4c9f-8eb2-86d7178bb649 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:30.670806 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e0e718-c2da-4c9f-8eb2-86d7178bb649 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:30.675879 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 326/641] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Oct 13 10:58:30 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:30.681429 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e5c529-b75d-4792-a586-b67a47da3481 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:30.772484 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:30.792476 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e5c529-b75d-4792-a586-b67a47da3481 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:30.827646 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4e019b-d39d-462c-826f-94deac64c1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:30.828279 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e019b-d39d-462c-826f-94deac64c1f5 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:30.828558 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e019b-d39d-462c-826f-94deac64c1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:30.828829 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e019b-d39d-462c-826f-94deac64c1f5 None admin] PATH_INFO: `/v3/services` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:30.829491 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4e019b-d39d-462c-826f-94deac64c1f5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:30.829797 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4e019b-d39d-462c-826f-94deac64c1f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:30.831862 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4e019b-d39d-462c-826f-94deac64c1f5 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:30.837789 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 316/642] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Oct 13 10:58:30 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:30.955627 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d0701-4947-49d1-9f24-f1db66a322ed None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:30.955934 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d0701-4947-49d1-9f24-f1db66a322ed None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:30.956213 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d0701-4947-49d1-9f24-f1db66a322ed None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:30.957887 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 327/643] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:58:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:30.963585 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb520e2-686c-45b7-a01a-f1b0bdd98a09 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:30.963865 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb520e2-686c-45b7-a01a-f1b0bdd98a09 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:30.964144 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb520e2-686c-45b7-a01a-f1b0bdd98a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:30.983551 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-6eb520e2-686c-45b7-a01a-f1b0bdd98a09 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:30.984758 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-6eb520e2-686c-45b7-a01a-f1b0bdd98a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:31.059185 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 317/644] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:30 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 10:58:31.325921 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d0701-4947-49d1-9f24-f1db66a322ed None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:31.414068 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:31.434643 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d0701-4947-49d1-9f24-f1db66a322ed None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:31.436385 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485605c-95e6-4cba-912f-f1055e055585 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:31.436838 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485605c-95e6-4cba-912f-f1055e055585 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:31.437108 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485605c-95e6-4cba-912f-f1055e055585 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:31.438997 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 318/645] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:58:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:31.444902 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec802b-ae26-4923-9e0f-5d7966380842 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:31.445287 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec802b-ae26-4923-9e0f-5d7966380842 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:31.445670 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec802b-ae26-4923-9e0f-5d7966380842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:31.467585 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-deec802b-ae26-4923-9e0f-5d7966380842 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:31.469596 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-deec802b-ae26-4923-9e0f-5d7966380842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:31.473820 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a72190-fcd3-4dd1-9888-78f0b3d31fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:31.474483 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a72190-fcd3-4dd1-9888-78f0b3d31fbe None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:31.474758 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a72190-fcd3-4dd1-9888-78f0b3d31fbe None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:31.475031 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a72190-fcd3-4dd1-9888-78f0b3d31fbe None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:31.475616 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a72190-fcd3-4dd1-9888-78f0b3d31fbe None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:31.476963 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a72190-fcd3-4dd1-9888-78f0b3d31fbe None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:31.486126 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-75a72190-fcd3-4dd1-9888-78f0b3d31fbe None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 13 10:58:31.486126 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:31.486126 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 10:58:31.486126 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 10:58:31.486126 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 10:58:31.486126 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 10:58:31.486126 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 10:58:31.486126 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:31.486126 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 13 10:58:31.486126 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:31.486126 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 10:58:31.486126 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:31.486126 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:31.486126 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:31.486126 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:31.486126 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:31.487371 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:31.487371 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:31.487371 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:31.487371 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:31.487371 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:31.487371 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:31.487371 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:31.487371 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 10:58:31.487371 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 10:58:31.487371 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 10:58:31.487371 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 10:58:31.487371 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:31.487371 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:31.487371 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:31.487371 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:31.487371 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:31.487371 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:31.488349 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:31.488349 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:31.488349 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:31.488349 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:31.488349 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:31.488349 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:31.488349 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:31.488349 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:31.488349 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:31.488349 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:31.488349 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 10:58:31.488349 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:31.488349 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 13 10:58:31.488349 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:31.488349 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 328/646] 10.222.0.25 () {56 vars in 1132 bytes} [Thu Oct 13 10:58:31 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:31.493142 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a72190-fcd3-4dd1-9888-78f0b3d31fbe None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:31.570107 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 319/647] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:31 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 13 10:58:31.617244 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a72190-fcd3-4dd1-9888-78f0b3d31fbe None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:31.652201 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eed7f1-64c6-4d44-bb61-6f7bac71661a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:31.652861 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eed7f1-64c6-4d44-bb61-6f7bac71661a None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:31.653137 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eed7f1-64c6-4d44-bb61-6f7bac71661a None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:31.653455 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eed7f1-64c6-4d44-bb61-6f7bac71661a None admin] PATH_INFO: `/v3/services` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:31.654113 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eed7f1-64c6-4d44-bb61-6f7bac71661a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:31.654463 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eed7f1-64c6-4d44-bb61-6f7bac71661a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:31.655833 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eed7f1-64c6-4d44-bb61-6f7bac71661a None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:31.661340 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 329/648] 10.222.0.25 () {56 vars in 1126 bytes} [Thu Oct 13 10:58:31 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:58:31.667037 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deec802b-ae26-4923-9e0f-5d7966380842 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:31.676074 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:31.776123 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deec802b-ae26-4923-9e0f-5d7966380842 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:31.810736 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5760ee-0156-4706-8cb5-32aaf884d6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:31.811650 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5760ee-0156-4706-8cb5-32aaf884d6c9 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:31.812133 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5760ee-0156-4706-8cb5-32aaf884d6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:31.812626 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5760ee-0156-4706-8cb5-32aaf884d6c9 None admin] PATH_INFO: `/v3/services` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:31.813472 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5760ee-0156-4706-8cb5-32aaf884d6c9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:31.813998 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5760ee-0156-4706-8cb5-32aaf884d6c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:31.815605 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5760ee-0156-4706-8cb5-32aaf884d6c9 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:31.821007 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 320/649] 10.222.0.25 () {56 vars in 1126 bytes} [Thu Oct 13 10:58:31 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:31.826683 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eed7f1-64c6-4d44-bb61-6f7bac71661a None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:31.840900 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:31.896260 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5760ee-0156-4706-8cb5-32aaf884d6c9 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:31.947477 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eed7f1-64c6-4d44-bb61-6f7bac71661a None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:31.990994 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:31.996857 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aca3dce-0e1d-43ca-a33a-e35ce0f7dbaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:31.997539 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca3dce-0e1d-43ca-a33a-e35ce0f7dbaf None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:31.997826 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca3dce-0e1d-43ca-a33a-e35ce0f7dbaf None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:31.998149 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca3dce-0e1d-43ca-a33a-e35ce0f7dbaf None admin] PATH_INFO: `/v3/endpoints` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:31.998849 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aca3dce-0e1d-43ca-a33a-e35ce0f7dbaf None admin] RBAC: Adding query filter params (interface=public, service_id=92b4235800464db89462f05db5aba7c7, region_id=RegionOne) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:31.999163 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aca3dce-0e1d-43ca-a33a-e35ce0f7dbaf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:32.001166 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aca3dce-0e1d-43ca-a33a-e35ce0f7dbaf None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:32.016402 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 330/650] 10.222.0.25 () {56 vars in 1251 bytes} [Thu Oct 13 10:58:31 2022] GET /identity/v3/endpoints?service_id=92b4235800464db89462f05db5aba7c7&interface=public®ion_id=RegionOne => generated 194 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:32.018215 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aca3dce-0e1d-43ca-a33a-e35ce0f7dbaf None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:32.038551 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5760ee-0156-4706-8cb5-32aaf884d6c9 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:32.078456 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d8b79-cedd-4e19-94f5-3093426d5bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:32.079473 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d8b79-cedd-4e19-94f5-3093426d5bc8 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:32.079977 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d8b79-cedd-4e19-94f5-3093426d5bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:32.080549 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d8b79-cedd-4e19-94f5-3093426d5bc8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:32.081403 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103d8b79-cedd-4e19-94f5-3093426d5bc8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:32.082993 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103d8b79-cedd-4e19-94f5-3093426d5bc8 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:32.092115 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-103d8b79-cedd-4e19-94f5-3093426d5bc8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 13 10:58:32.092115 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:32.092115 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 10:58:32.092115 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 10:58:32.092115 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 10:58:32.092115 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 10:58:32.092115 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 10:58:32.092115 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:32.092115 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 13 10:58:32.092115 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:32.092115 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 10:58:32.092115 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:32.092115 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:32.092115 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:32.092115 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:32.092115 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:32.092115 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:32.093094 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:32.093094 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:32.093094 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:32.093094 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:32.093094 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:32.093094 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:32.093094 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 10:58:32.093094 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 10:58:32.093094 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 10:58:32.093094 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 10:58:32.093094 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:32.093094 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:32.093094 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:32.093094 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:32.093094 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:32.093094 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:32.093926 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:32.093926 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:32.093926 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:32.093926 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:32.093926 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:32.093926 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:32.093926 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:32.093926 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:32.093926 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:32.093926 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:32.093926 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 10:58:32.093926 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:32.093926 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 13 10:58:32.093926 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:32.101780 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 321/651] 10.222.0.25 () {56 vars in 1126 bytes} [Thu Oct 13 10:58:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 10:58:32.102951 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d8b79-cedd-4e19-94f5-3093426d5bc8 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:32.113285 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:32.141861 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aca3dce-0e1d-43ca-a33a-e35ce0f7dbaf None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:32.185264 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325eb1a9-2c81-41fe-a813-20a7caedb2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:32.186427 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325eb1a9-2c81-41fe-a813-20a7caedb2a9 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:32.186910 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325eb1a9-2c81-41fe-a813-20a7caedb2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:32.187605 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325eb1a9-2c81-41fe-a813-20a7caedb2a9 None admin] PATH_INFO: `/v3/services` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:32.189256 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325eb1a9-2c81-41fe-a813-20a7caedb2a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:32.191379 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325eb1a9-2c81-41fe-a813-20a7caedb2a9 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:32.206267 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 331/652] 10.222.0.25 () {56 vars in 1087 bytes} [Thu Oct 13 10:58:32 2022] GET /identity/v3/services => generated 1029 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 10:58:32.230016 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d8b79-cedd-4e19-94f5-3093426d5bc8 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:32.270618 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3097cd45-faf1-45bb-b93a-34cf56d287ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:32.271246 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097cd45-faf1-45bb-b93a-34cf56d287ac None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:32.271529 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097cd45-faf1-45bb-b93a-34cf56d287ac None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:32.271804 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097cd45-faf1-45bb-b93a-34cf56d287ac None admin] PATH_INFO: `/v3/services` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:32.272452 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3097cd45-faf1-45bb-b93a-34cf56d287ac None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:32.272761 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3097cd45-faf1-45bb-b93a-34cf56d287ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:32.274370 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3097cd45-faf1-45bb-b93a-34cf56d287ac None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:32.275900 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:32.280959 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 322/653] 10.222.0.25 () {56 vars in 1122 bytes} [Thu Oct 13 10:58:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:32.289538 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325eb1a9-2c81-41fe-a813-20a7caedb2a9 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:32.351882 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a6828-c4f1-493f-89ba-da855f81e5cd None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:32.352247 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a6828-c4f1-493f-89ba-da855f81e5cd None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:32.352431 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a6828-c4f1-493f-89ba-da855f81e5cd None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:32.354150 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 323/654] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:58:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:32.359700 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8c1dc-7727-4481-a4d9-37550177d8a8 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:32.359999 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8c1dc-7727-4481-a4d9-37550177d8a8 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:32.360251 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8c1dc-7727-4481-a4d9-37550177d8a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:32.379690 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-1ec8c1dc-7727-4481-a4d9-37550177d8a8 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:32.380912 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-1ec8c1dc-7727-4481-a4d9-37550177d8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:32.416627 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325eb1a9-2c81-41fe-a813-20a7caedb2a9 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:32.455973 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ec0ec9-c156-4b3c-973e-8bc9d868b6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:32.457103 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec0ec9-c156-4b3c-973e-8bc9d868b6e8 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:32.457382 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec0ec9-c156-4b3c-973e-8bc9d868b6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:32.457660 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec0ec9-c156-4b3c-973e-8bc9d868b6e8 None admin] PATH_INFO: `/v3/services` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:32.458381 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ec0ec9-c156-4b3c-973e-8bc9d868b6e8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:32.458685 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ec0ec9-c156-4b3c-973e-8bc9d868b6e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:32.460269 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 324/655] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:32 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 13 10:58:32.460702 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ec0ec9-c156-4b3c-973e-8bc9d868b6e8 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:32.465093 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 332/656] 10.222.0.25 () {56 vars in 1122 bytes} [Thu Oct 13 10:58:32 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:32.733632 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec8c1dc-7727-4481-a4d9-37550177d8a8 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:32.836481 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec8c1dc-7727-4481-a4d9-37550177d8a8 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:32.864030 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:32.871853 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e75c5c-3916-425c-8b31-c212f87497a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:32.872738 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e75c5c-3916-425c-8b31-c212f87497a6 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:32.873017 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e75c5c-3916-425c-8b31-c212f87497a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:32.873289 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e75c5c-3916-425c-8b31-c212f87497a6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:32.884735 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e75c5c-3916-425c-8b31-c212f87497a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:58:32.891935 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-69e75c5c-3916-425c-8b31-c212f87497a6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 13 10:58:32.891935 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:32.891935 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:32.891935 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:32.891935 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:32.891935 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:32.891935 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:32.891935 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:32.891935 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:32.891935 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:32.891935 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:32.891935 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:32.891935 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:58:32.891935 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:58:32.891935 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:58:32.891935 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:58:32.892889 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:58:32.892889 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:58:32.892889 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:58:32.892889 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:58:32.892889 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:32.892889 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:32.892889 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:32.892889 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:32.892889 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:32.892889 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:32.892889 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:32.892889 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:32.892889 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:32.892889 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:32.892889 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:32.892889 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:32.893784 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:32.893784 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:32.893784 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:32.893784 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:32.893784 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:58:32.893784 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:58:32.893784 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:58:32.893784 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:58:32.893784 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:58:32.893784 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:58:32.893784 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 13 10:58:32.893784 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:32.893784 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 325/657] 10.222.0.25 () {56 vars in 1120 bytes} [Thu Oct 13 10:58:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:32.903779 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ec0ec9-c156-4b3c-973e-8bc9d868b6e8 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:32.914326 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:33.014533 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ec0ec9-c156-4b3c-973e-8bc9d868b6e8 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:33.048606 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309097ad-c12e-480e-9f15-9de03771bd85 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:33.048928 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309097ad-c12e-480e-9f15-9de03771bd85 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:33.049174 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309097ad-c12e-480e-9f15-9de03771bd85 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:33.050957 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f8e459-78b8-4808-ad8d-1c8b53b1479f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:33.051798 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8e459-78b8-4808-ad8d-1c8b53b1479f None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:33.052298 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8e459-78b8-4808-ad8d-1c8b53b1479f None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:33.052772 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8e459-78b8-4808-ad8d-1c8b53b1479f None admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:33.053659 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f8e459-78b8-4808-ad8d-1c8b53b1479f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:33.054507 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f8e459-78b8-4808-ad8d-1c8b53b1479f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:33.054614 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 326/658] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:58:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:33.055924 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b081c9d0-ab8a-4c89-ab5b-fc8fd7a2cb0a None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:33.056208 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b081c9d0-ab8a-4c89-ab5b-fc8fd7a2cb0a None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:33.056491 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b081c9d0-ab8a-4c89-ab5b-fc8fd7a2cb0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:33.056812 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f8e459-78b8-4808-ad8d-1c8b53b1479f None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:33.066846 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 333/659] 10.222.0.25 () {56 vars in 1115 bytes} [Thu Oct 13 10:58:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:33.072457 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f8e459-78b8-4808-ad8d-1c8b53b1479f None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:33.074995 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-b081c9d0-ab8a-4c89-ab5b-fc8fd7a2cb0a None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:33.076309 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-b081c9d0-ab8a-4c89-ab5b-fc8fd7a2cb0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:33.139693 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:33.154844 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 327/660] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:33 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 13 10:58:33.180666 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f8e459-78b8-4808-ad8d-1c8b53b1479f None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:33.218119 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe65c7c-b4f1-4696-8e79-36e89e0f478d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:33.219131 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe65c7c-b4f1-4696-8e79-36e89e0f478d None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:33.219629 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe65c7c-b4f1-4696-8e79-36e89e0f478d None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:33.220119 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe65c7c-b4f1-4696-8e79-36e89e0f478d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:33.231378 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe65c7c-b4f1-4696-8e79-36e89e0f478d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:33.233066 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe65c7c-b4f1-4696-8e79-36e89e0f478d None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:33.248384 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-7fe65c7c-b4f1-4696-8e79-36e89e0f478d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:33.248384 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:33.248384 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:33.248384 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:33.248384 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:33.248384 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:33.248384 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:33.248384 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:33.248384 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:33.248384 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:33.248384 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:33.248384 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:33.248384 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:33.248384 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:33.248384 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:33.248384 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:33.249324 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:33.249324 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:33.249324 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:33.249324 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:33.249324 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:33.249324 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:33.249324 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:33.249324 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:33.249324 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:33.249324 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:33.249324 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:33.249324 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:33.249324 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:33.249324 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:33.249324 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:33.249324 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:33.249324 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:33.250265 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:33.250265 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:33.250265 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:33.252254 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 334/661] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:33.258494 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b081c9d0-ab8a-4c89-ab5b-fc8fd7a2cb0a None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:33.364060 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b081c9d0-ab8a-4c89-ab5b-fc8fd7a2cb0a None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:33.386899 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:33.399096 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1457b743-92ad-4946-b427-98cd95b6a668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:33.399714 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1457b743-92ad-4946-b427-98cd95b6a668 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:33.399993 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1457b743-92ad-4946-b427-98cd95b6a668 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:33.400269 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1457b743-92ad-4946-b427-98cd95b6a668 None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:33.400910 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1457b743-92ad-4946-b427-98cd95b6a668 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:33.401211 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1457b743-92ad-4946-b427-98cd95b6a668 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:33.402603 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1457b743-92ad-4946-b427-98cd95b6a668 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:33.414165 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 328/662] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:33.419602 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe65c7c-b4f1-4696-8e79-36e89e0f478d None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:33.426008 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1457b743-92ad-4946-b427-98cd95b6a668 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:33.534854 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1457b743-92ad-4946-b427-98cd95b6a668 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:33.537015 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe65c7c-b4f1-4696-8e79-36e89e0f478d None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:33.554169 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:33.572055 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a518727-104f-4ada-90e8-64112b1e540c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:33.572719 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a518727-104f-4ada-90e8-64112b1e540c None admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:33.573001 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a518727-104f-4ada-90e8-64112b1e540c None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:33.573278 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a518727-104f-4ada-90e8-64112b1e540c None admin] PATH_INFO: `/v3/services` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:33.574020 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a518727-104f-4ada-90e8-64112b1e540c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:33.575578 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a518727-104f-4ada-90e8-64112b1e540c None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:33.576238 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a515d097-059c-4d13-b135-c6e376f0fadf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:33.577095 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515d097-059c-4d13-b135-c6e376f0fadf None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:33.577589 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515d097-059c-4d13-b135-c6e376f0fadf None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:33.578136 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515d097-059c-4d13-b135-c6e376f0fadf None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:33.587772 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a515d097-059c-4d13-b135-c6e376f0fadf None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:33.589630 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a515d097-059c-4d13-b135-c6e376f0fadf None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:33.593157 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 329/663] 10.222.0.25 () {60 vars in 1141 bytes} [Thu Oct 13 10:58:33 2022] POST /identity/v3/services => generated 251 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 10:58:33.602736 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-a515d097-059c-4d13-b135-c6e376f0fadf None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 13 10:58:33.602736 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:33.602736 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:33.602736 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:33.602736 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:33.602736 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:33.602736 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:33.602736 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:33.602736 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:33.602736 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:33.602736 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:33.602736 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:33.602736 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 10:58:33.602736 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 10:58:33.602736 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 10:58:33.602736 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 10:58:33.603912 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:33.603912 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:33.603912 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 10:58:33.603912 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:33.603912 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 10:58:33.603912 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:33.603912 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:33.603912 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:33.603912 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:33.603912 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:33.603912 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:33.603912 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:33.603912 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:33.603912 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:33.603912 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:33.603912 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:33.603912 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:33.603912 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:33.604854 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:33.604854 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:33.604854 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 10:58:33.604854 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 10:58:33.604854 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 10:58:33.604854 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 10:58:33.604854 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 10:58:33.604854 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 10:58:33.604854 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 13 10:58:33.604854 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:33.607424 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 335/664] 10.222.0.25 () {56 vars in 1117 bytes} [Thu Oct 13 10:58:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:33.614553 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a518727-104f-4ada-90e8-64112b1e540c None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:33.660145 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:33.744615 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a518727-104f-4ada-90e8-64112b1e540c None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:33.780839 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d390d096-f4a6-4d2e-8ecf-c6c62d2bc53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:33.781448 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d390d096-f4a6-4d2e-8ecf-c6c62d2bc53b None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:33.781725 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d390d096-f4a6-4d2e-8ecf-c6c62d2bc53b None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:33.782022 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d390d096-f4a6-4d2e-8ecf-c6c62d2bc53b None admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:33.782741 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d390d096-f4a6-4d2e-8ecf-c6c62d2bc53b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:33.783042 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d390d096-f4a6-4d2e-8ecf-c6c62d2bc53b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:33.785000 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d390d096-f4a6-4d2e-8ecf-c6c62d2bc53b None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:33.803621 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 330/665] 10.222.0.25 () {56 vars in 1149 bytes} [Thu Oct 13 10:58:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:33.809132 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a515d097-059c-4d13-b135-c6e376f0fadf None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:33.921678 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a515d097-059c-4d13-b135-c6e376f0fadf None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:33.957077 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bd4812-d815-40c6-b173-18eb5ca0ab7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:33.957753 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd4812-d815-40c6-b173-18eb5ca0ab7e None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:33.958060 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd4812-d815-40c6-b173-18eb5ca0ab7e None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:33.958331 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd4812-d815-40c6-b173-18eb5ca0ab7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:33.969265 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bd4812-d815-40c6-b173-18eb5ca0ab7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:33.970747 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bd4812-d815-40c6-b173-18eb5ca0ab7e None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:33.985459 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-49bd4812-d815-40c6-b173-18eb5ca0ab7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:33.985459 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:33.985459 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:33.985459 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:33.985459 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:33.985459 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:33.985459 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:33.985459 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:33.985459 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:33.985459 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:33.985459 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:33.985459 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:33.985459 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:33.985459 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:33.985459 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:33.985459 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:33.986449 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:33.986449 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:33.986449 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:33.986449 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:33.986449 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:33.986449 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:33.986449 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:33.986449 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:33.986449 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:33.986449 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:33.986449 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:33.986449 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:33.986449 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:33.986449 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:33.986449 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:33.986449 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:33.986449 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:33.988116 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:33.988116 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:33.988116 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:33.988116 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 336/666] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 10:58:33.994516 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d390d096-f4a6-4d2e-8ecf-c6c62d2bc53b None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:34.090122 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:34.098652 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d390d096-f4a6-4d2e-8ecf-c6c62d2bc53b None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:34.134872 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72d72b1-7ebd-464f-bbfa-6707afaed67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:34.135404 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d72b1-7ebd-464f-bbfa-6707afaed67b None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:34.135682 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d72b1-7ebd-464f-bbfa-6707afaed67b None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:34.135954 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d72b1-7ebd-464f-bbfa-6707afaed67b None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:34.136597 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72d72b1-7ebd-464f-bbfa-6707afaed67b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:34.136899 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72d72b1-7ebd-464f-bbfa-6707afaed67b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:34.138285 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72d72b1-7ebd-464f-bbfa-6707afaed67b None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:34.150961 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 331/667] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:34.156428 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bd4812-d815-40c6-b173-18eb5ca0ab7e None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:34.191597 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:34.264581 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bd4812-d815-40c6-b173-18eb5ca0ab7e None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:34.298818 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a23c80-cd42-4142-af61-1505fd8c0d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:34.299448 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a23c80-cd42-4142-af61-1505fd8c0d2d None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:34.299727 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a23c80-cd42-4142-af61-1505fd8c0d2d None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:34.300034 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a23c80-cd42-4142-af61-1505fd8c0d2d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:34.306955 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a23c80-cd42-4142-af61-1505fd8c0d2d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:34.308390 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a23c80-cd42-4142-af61-1505fd8c0d2d None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:34.320099 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-b5a23c80-cd42-4142-af61-1505fd8c0d2d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:58:34.320099 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:34.320099 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:34.320099 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:34.320099 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:34.320099 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:34.320099 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:34.320099 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:34.320099 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:34.320099 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:34.320099 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:34.320099 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:34.320099 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 10:58:34.320099 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 10:58:34.320099 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 10:58:34.320970 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 10:58:34.320970 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:34.320970 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:34.320970 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:34.320970 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:34.320970 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:34.320970 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:34.320970 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:34.320970 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:34.320970 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:34.320970 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:34.320970 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:34.320970 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:34.320970 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:34.320970 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:34.320970 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:34.320970 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:34.321857 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 10:58:34.321857 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 10:58:34.321857 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 10:58:34.321857 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 10:58:34.321857 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 10:58:34.321857 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 10:58:34.321857 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:58:34.321857 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:34.321857 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 337/668] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Oct 13 10:58:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:34.328663 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72d72b1-7ebd-464f-bbfa-6707afaed67b None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:34.440051 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72d72b1-7ebd-464f-bbfa-6707afaed67b None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:34.476023 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742099dc-538b-4ac3-8e3c-03222c187159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:34.476635 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742099dc-538b-4ac3-8e3c-03222c187159 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:34.476914 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742099dc-538b-4ac3-8e3c-03222c187159 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:34.477189 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742099dc-538b-4ac3-8e3c-03222c187159 None admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:34.477880 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742099dc-538b-4ac3-8e3c-03222c187159 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:34.478214 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742099dc-538b-4ac3-8e3c-03222c187159 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:34.479636 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742099dc-538b-4ac3-8e3c-03222c187159 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:34.492311 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 332/669] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Oct 13 10:58:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:34.498205 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a23c80-cd42-4142-af61-1505fd8c0d2d None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:34.539953 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f1f57f-ce14-44b9-bce8-640381374928 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:34.540505 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f1f57f-ce14-44b9-bce8-640381374928 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:34.540505 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f1f57f-ce14-44b9-bce8-640381374928 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:34.541968 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 333/670] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:58:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:34.547259 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4061f74-05ea-4a5b-8613-4d52e01285af None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:34.547543 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4061f74-05ea-4a5b-8613-4d52e01285af None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:34.547816 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4061f74-05ea-4a5b-8613-4d52e01285af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:34.567404 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-d4061f74-05ea-4a5b-8613-4d52e01285af None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:34.568634 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-d4061f74-05ea-4a5b-8613-4d52e01285af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:34.576631 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:34.604763 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:34.622948 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a23c80-cd42-4142-af61-1505fd8c0d2d None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:34.645814 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 334/671] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:34 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 13 10:58:34.665530 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0f7d72-22f2-454c-9ef4-97e91d275416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:34.666511 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f7d72-22f2-454c-9ef4-97e91d275416 None admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:34.667025 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f7d72-22f2-454c-9ef4-97e91d275416 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:34.667489 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f7d72-22f2-454c-9ef4-97e91d275416 None admin] PATH_INFO: `/v3/projects/85bfac5f03e24fb3870a59a6b52dba6e/users/6e803a9cc6114c4f93869e50bca313e7/roles/fba8d2d3d7964167b2f43a7eb6f5e8b7` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:34.670018 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0f7d72-22f2-454c-9ef4-97e91d275416 None admin] RBAC: Authorizing `identity:create_grant(project_id=85bfac5f03e24fb3870a59a6b52dba6e, user_id=6e803a9cc6114c4f93869e50bca313e7, role_id=fba8d2d3d7964167b2f43a7eb6f5e8b7)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:34.671638 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0f7d72-22f2-454c-9ef4-97e91d275416 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:34.686506 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 338/672] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Oct 13 10:58:34 2022] PUT /identity/v3/projects/85bfac5f03e24fb3870a59a6b52dba6e/users/6e803a9cc6114c4f93869e50bca313e7/roles/fba8d2d3d7964167b2f43a7eb6f5e8b7 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 10:58:34.740702 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969e2df5-8caf-4f2a-bdda-7190f46cfec9 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:34.741036 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969e2df5-8caf-4f2a-bdda-7190f46cfec9 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:34.741431 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969e2df5-8caf-4f2a-bdda-7190f46cfec9 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:34.743306 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 335/673] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:58:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:34.749537 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8182b-9d47-4bee-831d-8a577e7f0b6d None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:34.750069 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8182b-9d47-4bee-831d-8a577e7f0b6d None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:34.750593 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8182b-9d47-4bee-831d-8a577e7f0b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:34.772965 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-83f8182b-9d47-4bee-831d-8a577e7f0b6d None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:34.774616 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-83f8182b-9d47-4bee-831d-8a577e7f0b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:34.851391 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 339/674] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:34 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 10:58:34.920623 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969e2df5-8caf-4f2a-bdda-7190f46cfec9 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:35.026963 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969e2df5-8caf-4f2a-bdda-7190f46cfec9 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:35.062994 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c037ca-2429-4d4f-9b92-f814715b262e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:35.063622 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c037ca-2429-4d4f-9b92-f814715b262e None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:35.063897 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c037ca-2429-4d4f-9b92-f814715b262e None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:35.064167 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c037ca-2429-4d4f-9b92-f814715b262e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:35.064746 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c037ca-2429-4d4f-9b92-f814715b262e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:35.066644 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c037ca-2429-4d4f-9b92-f814715b262e None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:35.075576 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-c2c037ca-2429-4d4f-9b92-f814715b262e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 13 10:58:35.075576 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:35.075576 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 10:58:35.075576 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 10:58:35.075576 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 10:58:35.075576 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 10:58:35.075576 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 10:58:35.075576 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:35.075576 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 13 10:58:35.075576 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:35.075576 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 10:58:35.075576 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:35.075576 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:35.075576 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:35.075576 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:35.075576 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:35.076505 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:35.076505 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:35.076505 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:35.076505 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:35.076505 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:35.076505 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:35.076505 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:35.076505 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 10:58:35.076505 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 10:58:35.076505 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 10:58:35.076505 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 10:58:35.076505 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:35.076505 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:35.076505 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:35.076505 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:35.076505 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:35.076505 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:35.077395 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:35.077395 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:35.077395 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:35.077395 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:35.077395 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:35.077395 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:35.077395 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:35.077395 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:35.077395 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:35.077395 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:35.077395 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 10:58:35.077395 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:35.077395 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 13 10:58:35.077395 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:35.077395 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 336/675] 10.222.0.25 () {56 vars in 1132 bytes} [Thu Oct 13 10:58:34 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:35.084815 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f8182b-9d47-4bee-831d-8a577e7f0b6d None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:35.123087 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c037ca-2429-4d4f-9b92-f814715b262e None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:35.132826 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:35.172477 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:35.207418 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f8182b-9d47-4bee-831d-8a577e7f0b6d None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:35.232499 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c037ca-2429-4d4f-9b92-f814715b262e None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:35.259528 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabc2851-135f-4130-ab3d-ebacdbb099e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:35.260718 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc2851-135f-4130-ab3d-ebacdbb099e9 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:35.261622 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc2851-135f-4130-ab3d-ebacdbb099e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:35.262431 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc2851-135f-4130-ab3d-ebacdbb099e9 None admin] PATH_INFO: `/v3/services` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:35.263511 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabc2851-135f-4130-ab3d-ebacdbb099e9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:35.264421 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabc2851-135f-4130-ab3d-ebacdbb099e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:35.266538 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabc2851-135f-4130-ab3d-ebacdbb099e9 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:35.277382 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 340/676] 10.222.0.25 () {56 vars in 1126 bytes} [Thu Oct 13 10:58:35 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:35.278535 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabc2851-135f-4130-ab3d-ebacdbb099e9 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:35.279286 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f227e2f0-003a-4029-9e6f-8e2d6fa6278e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:35.279903 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f227e2f0-003a-4029-9e6f-8e2d6fa6278e None admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:35.280180 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f227e2f0-003a-4029-9e6f-8e2d6fa6278e None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:35.280449 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f227e2f0-003a-4029-9e6f-8e2d6fa6278e None admin] PATH_INFO: `/v3/services` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:35.281103 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f227e2f0-003a-4029-9e6f-8e2d6fa6278e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:35.282534 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f227e2f0-003a-4029-9e6f-8e2d6fa6278e None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:35.303224 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 337/677] 10.222.0.25 () {60 vars in 1141 bytes} [Thu Oct 13 10:58:35 2022] POST /identity/v3/services => generated 241 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 10:58:35.396503 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabc2851-135f-4130-ab3d-ebacdbb099e9 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:35.441069 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a9694e-f362-42ab-be32-ef80b85bf1b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:35.442205 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9694e-f362-42ab-be32-ef80b85bf1b3 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:35.442768 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9694e-f362-42ab-be32-ef80b85bf1b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:35.443276 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9694e-f362-42ab-be32-ef80b85bf1b3 None admin] PATH_INFO: `/v3/services` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:35.444143 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a9694e-f362-42ab-be32-ef80b85bf1b3 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:35.444655 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a9694e-f362-42ab-be32-ef80b85bf1b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:35.446383 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a9694e-f362-42ab-be32-ef80b85bf1b3 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:35.452727 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 341/678] 10.222.0.25 () {56 vars in 1126 bytes} [Thu Oct 13 10:58:35 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:35.459482 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f227e2f0-003a-4029-9e6f-8e2d6fa6278e None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:35.533119 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:35.574069 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f227e2f0-003a-4029-9e6f-8e2d6fa6278e None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:35.611306 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d4ce4c-3dc3-4b36-92da-ff75e253f0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:35.613160 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d4ce4c-3dc3-4b36-92da-ff75e253f0f3 None admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:35.613639 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d4ce4c-3dc3-4b36-92da-ff75e253f0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:35.614139 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d4ce4c-3dc3-4b36-92da-ff75e253f0f3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:35.615019 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d4ce4c-3dc3-4b36-92da-ff75e253f0f3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:35.616597 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d4ce4c-3dc3-4b36-92da-ff75e253f0f3 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:35.639047 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 338/679] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 10:58:35 2022] POST /identity/v3/endpoints => generated 347 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 10:58:35.915720 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69dd16b-b753-4292-8951-758e62bf1ff8 None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:35.916252 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69dd16b-b753-4292-8951-758e62bf1ff8 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:35.916252 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69dd16b-b753-4292-8951-758e62bf1ff8 None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:35.917806 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 342/680] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:58:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:35.923156 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21335e38-86af-494d-9619-8b9a1570c4bc None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:35.923436 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21335e38-86af-494d-9619-8b9a1570c4bc None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:35.923708 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21335e38-86af-494d-9619-8b9a1570c4bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:35.942628 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-21335e38-86af-494d-9619-8b9a1570c4bc None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:35.944161 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-21335e38-86af-494d-9619-8b9a1570c4bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:36.023369 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 339/681] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 10:58:36.291132 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69dd16b-b753-4292-8951-758e62bf1ff8 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:36.294048 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:36.397797 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69dd16b-b753-4292-8951-758e62bf1ff8 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:36.432628 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f45dbff-9f78-4121-a851-e1399cc1fe81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:36.433260 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45dbff-9f78-4121-a851-e1399cc1fe81 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:36.433568 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45dbff-9f78-4121-a851-e1399cc1fe81 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:36.433849 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45dbff-9f78-4121-a851-e1399cc1fe81 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:36.434518 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f45dbff-9f78-4121-a851-e1399cc1fe81 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:36.435931 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f45dbff-9f78-4121-a851-e1399cc1fe81 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:36.444979 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-8f45dbff-9f78-4121-a851-e1399cc1fe81 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 13 10:58:36.444979 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:36.444979 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 10:58:36.444979 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 10:58:36.444979 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 10:58:36.444979 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 10:58:36.444979 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 10:58:36.444979 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:36.444979 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 13 10:58:36.444979 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:36.444979 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 10:58:36.444979 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:36.444979 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:36.444979 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:36.444979 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:36.444979 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:36.444979 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:36.445934 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:36.445934 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:36.445934 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:36.445934 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:36.445934 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:36.445934 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:36.445934 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 10:58:36.445934 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 10:58:36.445934 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 10:58:36.445934 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 10:58:36.445934 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:36.445934 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:36.445934 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:36.445934 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:36.445934 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:36.445934 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:36.446806 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:36.446806 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:36.446806 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:36.446806 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:36.446806 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:36.446806 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:36.446806 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:36.446806 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:36.446806 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:36.446806 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:36.446806 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 10:58:36.446806 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:36.446806 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 13 10:58:36.446806 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:36.446806 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 343/682] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Oct 13 10:58:36 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:36.455482 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21335e38-86af-494d-9619-8b9a1570c4bc None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:36.507130 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:36.564166 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21335e38-86af-494d-9619-8b9a1570c4bc None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:36.601897 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f069d5-048f-4342-806a-18daa712a8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:36.602632 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f069d5-048f-4342-806a-18daa712a8af None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:36.602796 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f069d5-048f-4342-806a-18daa712a8af None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:36.603048 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f069d5-048f-4342-806a-18daa712a8af None admin] PATH_INFO: `/v3/services` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:36.603680 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f069d5-048f-4342-806a-18daa712a8af None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:36.603983 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f069d5-048f-4342-806a-18daa712a8af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:36.605342 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f069d5-048f-4342-806a-18daa712a8af None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:36.610604 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 340/683] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Oct 13 10:58:36 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:36.619017 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f45dbff-9f78-4121-a851-e1399cc1fe81 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:36.684238 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:36.720489 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f45dbff-9f78-4121-a851-e1399cc1fe81 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:36.759776 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d549f9-c930-466b-ad5f-6708ff40811a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:36.760410 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d549f9-c930-466b-ad5f-6708ff40811a None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:36.760690 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d549f9-c930-466b-ad5f-6708ff40811a None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:36.760966 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d549f9-c930-466b-ad5f-6708ff40811a None admin] PATH_INFO: `/v3/services` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:36.761618 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d549f9-c930-466b-ad5f-6708ff40811a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:36.761922 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d549f9-c930-466b-ad5f-6708ff40811a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:36.763391 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d549f9-c930-466b-ad5f-6708ff40811a None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:36.769631 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 344/684] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Oct 13 10:58:36 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:36.775525 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f069d5-048f-4342-806a-18daa712a8af None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:36.881824 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9afb10-7768-4e94-b720-b327f4b61fc5 None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:36.881824 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9afb10-7768-4e94-b720-b327f4b61fc5 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:36.882023 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9afb10-7768-4e94-b720-b327f4b61fc5 None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:36.883463 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 345/685] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:58:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:36.888690 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a245a8-3d66-4b3e-826e-86727cf50c10 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:36.889164 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f069d5-048f-4342-806a-18daa712a8af None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:36.889470 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a245a8-3d66-4b3e-826e-86727cf50c10 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:36.889960 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a245a8-3d66-4b3e-826e-86727cf50c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:36.905451 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:36.909931 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-89a245a8-3d66-4b3e-826e-86727cf50c10 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:36.911558 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-89a245a8-3d66-4b3e-826e-86727cf50c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:36.931414 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b0fad-7f6a-4f20-99a4-3451049e1cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:36.932028 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b0fad-7f6a-4f20-99a4-3451049e1cb7 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:36.932307 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b0fad-7f6a-4f20-99a4-3451049e1cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:36.932582 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b0fad-7f6a-4f20-99a4-3451049e1cb7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:36.933289 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10b0fad-7f6a-4f20-99a4-3451049e1cb7 None admin] RBAC: Adding query filter params (interface=public, service_id=a6b840cea6554667a2703e392ab00425, region_id=RegionOne) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:36.933600 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10b0fad-7f6a-4f20-99a4-3451049e1cb7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:36.935450 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10b0fad-7f6a-4f20-99a4-3451049e1cb7 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:36.942801 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 341/686] 10.222.0.25 () {56 vars in 1251 bytes} [Thu Oct 13 10:58:36 2022] GET /identity/v3/endpoints?service_id=a6b840cea6554667a2703e392ab00425&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:36.948193 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b0fad-7f6a-4f20-99a4-3451049e1cb7 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:36.998304 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 346/687] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 13 10:58:37.059683 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b0fad-7f6a-4f20-99a4-3451049e1cb7 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:37.093497 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83c7586-3fd5-4725-9470-103fe4b20ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:37.094399 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c7586-3fd5-4725-9470-103fe4b20ff4 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:37.094675 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c7586-3fd5-4725-9470-103fe4b20ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:37.094947 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c7586-3fd5-4725-9470-103fe4b20ff4 None admin] PATH_INFO: `/v3/services` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:37.095604 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83c7586-3fd5-4725-9470-103fe4b20ff4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:37.097053 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83c7586-3fd5-4725-9470-103fe4b20ff4 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:37.103229 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 342/688] 10.222.0.25 () {56 vars in 1087 bytes} [Thu Oct 13 10:58:36 2022] GET /identity/v3/services => generated 1497 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 10:58:37.276401 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a245a8-3d66-4b3e-826e-86727cf50c10 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:37.335287 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:37.375621 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a245a8-3d66-4b3e-826e-86727cf50c10 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:37.411224 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a271e633-3c89-4e6d-963b-9168053a32b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:37.411860 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a271e633-3c89-4e6d-963b-9168053a32b5 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:37.412140 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a271e633-3c89-4e6d-963b-9168053a32b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:37.412413 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a271e633-3c89-4e6d-963b-9168053a32b5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:37.422614 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a271e633-3c89-4e6d-963b-9168053a32b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:58:37.427533 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-a271e633-3c89-4e6d-963b-9168053a32b5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 13 10:58:37.427533 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:37.427533 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:37.427533 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:37.427533 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:37.427533 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:37.427533 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:37.427533 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:37.427533 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:37.427533 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:37.427533 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:37.427533 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:37.427533 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:58:37.427533 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:58:37.427533 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:58:37.427533 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:58:37.428489 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:58:37.428489 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:58:37.428489 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:58:37.428489 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:58:37.428489 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:37.428489 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:37.428489 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:37.428489 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:37.428489 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:37.428489 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:37.428489 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:37.428489 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:37.428489 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:37.428489 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:37.428489 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:37.428489 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:37.429374 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:37.429374 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:37.429374 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:37.429374 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:37.429374 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:58:37.429374 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:58:37.429374 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:58:37.429374 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:58:37.429374 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:58:37.429374 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:58:37.429374 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 13 10:58:37.429374 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:37.432999 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 347/689] 10.222.0.25 () {56 vars in 1120 bytes} [Thu Oct 13 10:58:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:37.434987 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83c7586-3fd5-4725-9470-103fe4b20ff4 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:37.481082 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:37.551758 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83c7586-3fd5-4725-9470-103fe4b20ff4 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:37.588926 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c026e-6367-48aa-9f20-ebd91f344996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:37.589576 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c026e-6367-48aa-9f20-ebd91f344996 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:37.589857 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c026e-6367-48aa-9f20-ebd91f344996 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:37.590157 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c026e-6367-48aa-9f20-ebd91f344996 None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:37.590820 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7c026e-6367-48aa-9f20-ebd91f344996 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:37.591123 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7c026e-6367-48aa-9f20-ebd91f344996 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:37.592484 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7c026e-6367-48aa-9f20-ebd91f344996 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:37.601984 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 343/690] 10.222.0.25 () {56 vars in 1115 bytes} [Thu Oct 13 10:58:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:37.607610 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a271e633-3c89-4e6d-963b-9168053a32b5 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:37.667333 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d8189-0ce2-4770-8eb4-7f2c534b0539 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:37.667643 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d8189-0ce2-4770-8eb4-7f2c534b0539 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:37.667880 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d8189-0ce2-4770-8eb4-7f2c534b0539 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:37.669835 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 344/691] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:58:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:37.676925 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e33c77-5538-4944-8ca8-ce5a627793ff None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:37.677307 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e33c77-5538-4944-8ca8-ce5a627793ff None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:37.678004 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e33c77-5538-4944-8ca8-ce5a627793ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:37.703313 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-f0e33c77-5538-4944-8ca8-ce5a627793ff None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:37.704503 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-f0e33c77-5538-4944-8ca8-ce5a627793ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:37.718746 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a271e633-3c89-4e6d-963b-9168053a32b5 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:37.741297 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:37.759581 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14c448a-eb96-433a-afc0-2d6207045838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:37.760716 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c448a-eb96-433a-afc0-2d6207045838 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:37.761201 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c448a-eb96-433a-afc0-2d6207045838 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:37.761674 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c448a-eb96-433a-afc0-2d6207045838 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:37.775166 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14c448a-eb96-433a-afc0-2d6207045838 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:37.777055 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14c448a-eb96-433a-afc0-2d6207045838 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:37.796055 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-a14c448a-eb96-433a-afc0-2d6207045838 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:37.796055 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:37.796055 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:37.796055 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:37.796055 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:37.796055 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:37.796055 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:37.796055 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:37.796055 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:37.796055 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:37.796055 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:37.796055 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:37.796055 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:37.796055 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:37.796055 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:37.796055 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:37.797073 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:37.797073 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:37.797073 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:37.797073 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:37.797073 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:37.797073 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:37.797073 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:37.797073 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:37.797073 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:37.797073 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:37.797073 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:37.797073 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:37.797073 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:37.797073 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:37.797073 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:37.797073 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:37.797073 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:37.797986 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:37.797986 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:37.797986 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:37.802048 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 345/692] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:37 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 13 10:58:37.807333 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 348/693] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:37.818986 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e33c77-5538-4944-8ca8-ce5a627793ff None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:37.851272 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:37.873203 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74979025-1982-44cf-b743-3ba8c12e02e9 None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:37.873490 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74979025-1982-44cf-b743-3ba8c12e02e9 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:37.873920 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74979025-1982-44cf-b743-3ba8c12e02e9 None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:37.875369 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 349/694] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:58:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:37.885295 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0668e2-603a-4a48-aa94-7d21e7185318 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:37.885585 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0668e2-603a-4a48-aa94-7d21e7185318 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:37.885864 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0668e2-603a-4a48-aa94-7d21e7185318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:37.909599 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-1b0668e2-603a-4a48-aa94-7d21e7185318 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:37.910931 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-1b0668e2-603a-4a48-aa94-7d21e7185318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:37.933182 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e33c77-5538-4944-8ca8-ce5a627793ff None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:37.971307 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62adc402-b36d-47be-b50b-675dd021f864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:37.972484 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62adc402-b36d-47be-b50b-675dd021f864 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:37.973275 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62adc402-b36d-47be-b50b-675dd021f864 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:37.973718 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62adc402-b36d-47be-b50b-675dd021f864 None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:37.974522 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62adc402-b36d-47be-b50b-675dd021f864 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:37.974965 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62adc402-b36d-47be-b50b-675dd021f864 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:37.976963 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62adc402-b36d-47be-b50b-675dd021f864 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:37.992903 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 346/695] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:37.998189 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 350/696] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:37 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 10:58:37.998577 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62adc402-b36d-47be-b50b-675dd021f864 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:38.072040 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0668e2-603a-4a48-aa94-7d21e7185318 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:38.105323 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:38.118603 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62adc402-b36d-47be-b50b-675dd021f864 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:38.164214 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576115df-3da5-435b-9289-8fdd02a2d074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:38.165635 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576115df-3da5-435b-9289-8fdd02a2d074 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:38.166347 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576115df-3da5-435b-9289-8fdd02a2d074 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:38.166769 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576115df-3da5-435b-9289-8fdd02a2d074 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:38.177265 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0668e2-603a-4a48-aa94-7d21e7185318 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:38.177917 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576115df-3da5-435b-9289-8fdd02a2d074 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:38.178950 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:38.181981 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576115df-3da5-435b-9289-8fdd02a2d074 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:38.197505 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-576115df-3da5-435b-9289-8fdd02a2d074 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 13 10:58:38.197505 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:38.197505 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:38.197505 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:38.197505 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:38.197505 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:38.197505 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:38.197505 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:38.197505 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:38.197505 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:38.197505 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:38.197505 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:38.197505 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 10:58:38.197505 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 10:58:38.197505 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 10:58:38.197505 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 10:58:38.198637 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:38.198637 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:38.198637 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 10:58:38.198637 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:38.198637 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 10:58:38.198637 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:38.198637 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:38.198637 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:38.198637 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:38.198637 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:38.198637 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:38.198637 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:38.198637 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:38.198637 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:38.198637 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:38.198637 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:38.198637 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:38.198637 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:38.199754 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:38.199754 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:38.199754 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 10:58:38.199754 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 10:58:38.199754 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 10:58:38.199754 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 10:58:38.199754 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 10:58:38.199754 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 10:58:38.199754 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 13 10:58:38.199754 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:38.202466 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 347/697] 10.222.0.25 () {56 vars in 1117 bytes} [Thu Oct 13 10:58:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:38.211554 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576115df-3da5-435b-9289-8fdd02a2d074 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:38.219844 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f89d406-47d1-4f3d-9388-149f2fa223b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:38.220637 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f89d406-47d1-4f3d-9388-149f2fa223b6 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:38.220886 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f89d406-47d1-4f3d-9388-149f2fa223b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:38.221226 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f89d406-47d1-4f3d-9388-149f2fa223b6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:38.222424 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f89d406-47d1-4f3d-9388-149f2fa223b6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:38.223915 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f89d406-47d1-4f3d-9388-149f2fa223b6 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:38.234939 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-8f89d406-47d1-4f3d-9388-149f2fa223b6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 13 10:58:38.234939 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:38.234939 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 10:58:38.234939 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 10:58:38.234939 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 10:58:38.234939 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 10:58:38.234939 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 10:58:38.234939 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:38.234939 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 13 10:58:38.234939 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:38.234939 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 10:58:38.234939 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:38.234939 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:38.234939 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:38.234939 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:38.234939 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:38.234939 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:38.235929 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:38.235929 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:38.235929 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:38.235929 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:38.235929 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:38.235929 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:38.235929 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 10:58:38.235929 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 10:58:38.235929 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 10:58:38.235929 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 10:58:38.235929 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:38.235929 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:38.235929 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:38.235929 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:38.235929 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:38.235929 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:38.236774 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:38.236774 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:38.236774 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:38.236774 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:38.236774 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:38.236774 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:38.236774 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:38.236774 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:38.236774 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:38.236774 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:38.236774 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 10:58:38.236774 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:38.236774 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 13 10:58:38.236774 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:38.241453 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 351/698] 10.222.0.25 () {56 vars in 1126 bytes} [Thu Oct 13 10:58:38 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 10:58:38.242337 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f89d406-47d1-4f3d-9388-149f2fa223b6 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:38.326256 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576115df-3da5-435b-9289-8fdd02a2d074 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:38.349474 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f89d406-47d1-4f3d-9388-149f2fa223b6 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:38.362108 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed50b07a-7047-4d34-b8f3-5527196ac31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:38.363421 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50b07a-7047-4d34-b8f3-5527196ac31f None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:38.363794 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50b07a-7047-4d34-b8f3-5527196ac31f None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:38.364080 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50b07a-7047-4d34-b8f3-5527196ac31f None admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:38.364806 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed50b07a-7047-4d34-b8f3-5527196ac31f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:38.365113 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed50b07a-7047-4d34-b8f3-5527196ac31f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:38.366676 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed50b07a-7047-4d34-b8f3-5527196ac31f None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:38.388526 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 348/699] 10.222.0.25 () {56 vars in 1149 bytes} [Thu Oct 13 10:58:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:38.388693 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4114ca6d-09df-41c4-956e-fd4f1f97a4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:38.388791 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed50b07a-7047-4d34-b8f3-5527196ac31f None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:38.388891 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114ca6d-09df-41c4-956e-fd4f1f97a4aa None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:38.388891 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114ca6d-09df-41c4-956e-fd4f1f97a4aa None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:38.388891 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114ca6d-09df-41c4-956e-fd4f1f97a4aa None admin] PATH_INFO: `/v3/services` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:38.388891 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4114ca6d-09df-41c4-956e-fd4f1f97a4aa None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:38.388891 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4114ca6d-09df-41c4-956e-fd4f1f97a4aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:38.388891 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4114ca6d-09df-41c4-956e-fd4f1f97a4aa None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:38.392798 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 352/700] 10.222.0.25 () {56 vars in 1122 bytes} [Thu Oct 13 10:58:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:38.398219 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4114ca6d-09df-41c4-956e-fd4f1f97a4aa None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:38.402299 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:38.430515 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:38.499265 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed50b07a-7047-4d34-b8f3-5527196ac31f None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:38.502255 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4114ca6d-09df-41c4-956e-fd4f1f97a4aa None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:38.536764 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752b1f74-b8a8-4732-9daa-62bc57b7df8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:38.537362 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752b1f74-b8a8-4732-9daa-62bc57b7df8e None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:38.537639 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752b1f74-b8a8-4732-9daa-62bc57b7df8e None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:38.537985 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752b1f74-b8a8-4732-9daa-62bc57b7df8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:38.540426 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838e3131-90f2-412a-926e-b6f33a043f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:38.541739 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e3131-90f2-412a-926e-b6f33a043f78 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:38.541739 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e3131-90f2-412a-926e-b6f33a043f78 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:38.541739 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e3131-90f2-412a-926e-b6f33a043f78 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:38.542183 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838e3131-90f2-412a-926e-b6f33a043f78 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:38.543545 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838e3131-90f2-412a-926e-b6f33a043f78 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:38.553201 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-838e3131-90f2-412a-926e-b6f33a043f78 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 13 10:58:38.553201 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:38.553201 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 10:58:38.553201 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 10:58:38.553201 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 10:58:38.553201 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 10:58:38.553201 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 10:58:38.553201 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:38.553201 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 13 10:58:38.553201 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:38.553201 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 10:58:38.553201 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:38.553201 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:38.553201 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:38.553201 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:38.553201 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:38.553201 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:38.554494 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:38.554494 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:38.554494 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:38.554494 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:38.554494 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:38.554494 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:38.554494 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 10:58:38.554494 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 10:58:38.554494 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 10:58:38.554494 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 10:58:38.554494 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:38.554494 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:38.554494 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:38.554494 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:38.554494 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:38.554494 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:38.555327 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:38.555327 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:38.555327 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:38.555327 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:38.555327 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:38.555327 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:38.555327 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:38.555327 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:38.555327 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:38.555327 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:38.555327 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 10:58:38.555327 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:38.555327 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 13 10:58:38.555327 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:38.555327 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 349/701] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Oct 13 10:58:38 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:38.556437 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838e3131-90f2-412a-926e-b6f33a043f78 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:38.613628 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752b1f74-b8a8-4732-9daa-62bc57b7df8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:38.615015 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752b1f74-b8a8-4732-9daa-62bc57b7df8e None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:38.635173 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:38.646589 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:38.662949 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838e3131-90f2-412a-926e-b6f33a043f78 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:38.697301 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5446ecd7-0441-40cd-85a1-7ed2bc2d9ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:38.698157 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5446ecd7-0441-40cd-85a1-7ed2bc2d9ef5 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:38.698884 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5446ecd7-0441-40cd-85a1-7ed2bc2d9ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:38.699161 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5446ecd7-0441-40cd-85a1-7ed2bc2d9ef5 None admin] PATH_INFO: `/v3/services` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:38.699787 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5446ecd7-0441-40cd-85a1-7ed2bc2d9ef5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:38.700088 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5446ecd7-0441-40cd-85a1-7ed2bc2d9ef5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:38.701691 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5446ecd7-0441-40cd-85a1-7ed2bc2d9ef5 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:38.712094 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 350/702] 10.222.0.25 () {56 vars in 1122 bytes} [Thu Oct 13 10:58:38 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:38.713029 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5446ecd7-0441-40cd-85a1-7ed2bc2d9ef5 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:38.716959 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 353/703] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Oct 13 10:58:38 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 13 10:58:38.722356 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752b1f74-b8a8-4732-9daa-62bc57b7df8e None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:38.814607 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5446ecd7-0441-40cd-85a1-7ed2bc2d9ef5 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:38.826885 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752b1f74-b8a8-4732-9daa-62bc57b7df8e None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:38.847946 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1736b3-4a57-4b8b-ba8d-ea5ed6ce6b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:38.848554 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1736b3-4a57-4b8b-ba8d-ea5ed6ce6b67 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:38.848834 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1736b3-4a57-4b8b-ba8d-ea5ed6ce6b67 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:38.849108 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1736b3-4a57-4b8b-ba8d-ea5ed6ce6b67 None admin] PATH_INFO: `/v3/services` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:38.849747 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1736b3-4a57-4b8b-ba8d-ea5ed6ce6b67 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:38.850064 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1736b3-4a57-4b8b-ba8d-ea5ed6ce6b67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:38.851412 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1736b3-4a57-4b8b-ba8d-ea5ed6ce6b67 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:38.856110 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 351/704] 10.222.0.25 () {56 vars in 1112 bytes} [Thu Oct 13 10:58:38 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:38.856885 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1736b3-4a57-4b8b-ba8d-ea5ed6ce6b67 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:38.859387 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:38.863833 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:38.870078 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb493928-cf38-4b37-a517-c0abc58e2b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:38.870688 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb493928-cf38-4b37-a517-c0abc58e2b17 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:38.870968 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb493928-cf38-4b37-a517-c0abc58e2b17 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:38.871240 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb493928-cf38-4b37-a517-c0abc58e2b17 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:38.872067 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb493928-cf38-4b37-a517-c0abc58e2b17 None admin] RBAC: Adding query filter params (interface=public, service_id=5c8ff975119e40f48f952fa6f64e1308, region_id=RegionOne) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:38.872375 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb493928-cf38-4b37-a517-c0abc58e2b17 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:38.873777 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb493928-cf38-4b37-a517-c0abc58e2b17 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:38.889643 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 354/705] 10.222.0.25 () {56 vars in 1251 bytes} [Thu Oct 13 10:58:38 2022] GET /identity/v3/endpoints?service_id=5c8ff975119e40f48f952fa6f64e1308&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:38.889643 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb493928-cf38-4b37-a517-c0abc58e2b17 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:38.963693 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1736b3-4a57-4b8b-ba8d-ea5ed6ce6b67 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:38.998212 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b04c58-d752-4364-b460-da46ecac7a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:38.998853 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b04c58-d752-4364-b460-da46ecac7a6c None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:38.999135 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b04c58-d752-4364-b460-da46ecac7a6c None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:38.999410 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b04c58-d752-4364-b460-da46ecac7a6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:39.001284 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb493928-cf38-4b37-a517-c0abc58e2b17 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:39.011931 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b04c58-d752-4364-b460-da46ecac7a6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:39.013373 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b04c58-d752-4364-b460-da46ecac7a6c None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:39.029022 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-b3b04c58-d752-4364-b460-da46ecac7a6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:39.029022 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:39.029022 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:39.029022 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:39.029022 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:39.029022 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:39.029022 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:39.029022 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:39.029022 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:39.029022 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:39.029022 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:39.029022 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:39.029022 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:39.029022 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:39.029022 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:39.029022 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:39.030029 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:39.030029 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:39.030029 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:39.030029 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:39.030029 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:39.030029 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:39.030029 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:39.030029 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:39.030029 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:39.030029 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:39.030029 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:39.030029 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:39.030029 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:39.030029 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:39.030029 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:39.030029 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:39.030029 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:39.030952 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:39.030952 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:39.030952 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:39.030952 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 352/706] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:39.030952 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b04c58-d752-4364-b460-da46ecac7a6c None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:39.045104 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1aba96-682f-4e13-aec3-d9936e1d9ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:39.045715 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1aba96-682f-4e13-aec3-d9936e1d9ee5 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:39.046024 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1aba96-682f-4e13-aec3-d9936e1d9ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:39.046296 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1aba96-682f-4e13-aec3-d9936e1d9ee5 None admin] PATH_INFO: `/v3/services` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:39.046921 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1aba96-682f-4e13-aec3-d9936e1d9ee5 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:39.047219 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1aba96-682f-4e13-aec3-d9936e1d9ee5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:39.048558 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1aba96-682f-4e13-aec3-d9936e1d9ee5 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:39.053449 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 355/707] 10.222.0.25 () {56 vars in 1112 bytes} [Thu Oct 13 10:58:38 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:39.063291 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1aba96-682f-4e13-aec3-d9936e1d9ee5 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:39.111565 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:39.140268 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:39.166014 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b04c58-d752-4364-b460-da46ecac7a6c None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:39.192651 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1aba96-682f-4e13-aec3-d9936e1d9ee5 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:39.202803 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72980936-4e07-4b49-823b-98619ff11e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:39.203566 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72980936-4e07-4b49-823b-98619ff11e18 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:39.203918 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72980936-4e07-4b49-823b-98619ff11e18 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:39.204272 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72980936-4e07-4b49-823b-98619ff11e18 None admin] PATH_INFO: `/v3/services` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:39.205231 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72980936-4e07-4b49-823b-98619ff11e18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:39.206997 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72980936-4e07-4b49-823b-98619ff11e18 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:39.214221 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 353/708] 10.222.0.25 () {56 vars in 1087 bytes} [Thu Oct 13 10:58:39 2022] GET /identity/v3/services => generated 1497 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 10:58:39.234695 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d3ad6b-5d14-4d93-af75-41342a92f563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:39.235656 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d3ad6b-5d14-4d93-af75-41342a92f563 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:39.235939 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d3ad6b-5d14-4d93-af75-41342a92f563 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:39.236217 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d3ad6b-5d14-4d93-af75-41342a92f563 None admin] PATH_INFO: `/v3/domains` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:39.237178 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d3ad6b-5d14-4d93-af75-41342a92f563 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:39.238778 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d3ad6b-5d14-4d93-af75-41342a92f563 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:39.240289 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d3ad6b-5d14-4d93-af75-41342a92f563 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:39.256383 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 356/709] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:39.262007 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72980936-4e07-4b49-823b-98619ff11e18 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:39.373136 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c603b4-7d1f-47b6-96b0-bc6667a323a4 None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:39.373475 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c603b4-7d1f-47b6-96b0-bc6667a323a4 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:39.373686 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c603b4-7d1f-47b6-96b0-bc6667a323a4 None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:39.375726 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 357/710] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:58:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 10:58:39.381522 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5699c2-78ca-450a-b2cf-9dbbc50fb6ab None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:39.381826 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5699c2-78ca-450a-b2cf-9dbbc50fb6ab None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:39.382170 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5699c2-78ca-450a-b2cf-9dbbc50fb6ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:39.386395 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72980936-4e07-4b49-823b-98619ff11e18 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:39.403861 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-9c5699c2-78ca-450a-b2cf-9dbbc50fb6ab None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:39.405912 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-9c5699c2-78ca-450a-b2cf-9dbbc50fb6ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:39.407056 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:39.430649 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56573be1-3661-492e-88cc-7d15a73df75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:39.431289 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56573be1-3661-492e-88cc-7d15a73df75c None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:39.431573 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56573be1-3661-492e-88cc-7d15a73df75c None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:39.431850 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56573be1-3661-492e-88cc-7d15a73df75c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:39.441688 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56573be1-3661-492e-88cc-7d15a73df75c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:39.442750 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56573be1-3661-492e-88cc-7d15a73df75c None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:39.454510 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-56573be1-3661-492e-88cc-7d15a73df75c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:58:39.454510 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:39.454510 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:39.454510 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:39.454510 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:39.454510 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:39.454510 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:39.454510 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:39.454510 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:39.454510 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:39.454510 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:39.454510 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:39.454510 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 10:58:39.454510 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 10:58:39.454510 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 10:58:39.455457 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 10:58:39.455457 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:39.455457 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:39.455457 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:39.455457 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:39.455457 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:39.455457 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:39.455457 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:39.455457 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:39.455457 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:39.455457 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:39.455457 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:39.455457 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:39.455457 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:39.455457 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:39.455457 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:39.455457 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:39.457205 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 10:58:39.457205 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 10:58:39.457205 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 10:58:39.457205 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 10:58:39.457205 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 10:58:39.457205 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 10:58:39.457205 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:58:39.457205 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:39.457205 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 354/711] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Oct 13 10:58:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:39.462947 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56573be1-3661-492e-88cc-7d15a73df75c None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:39.501974 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 358/712] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:39 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 13 10:58:39.575911 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56573be1-3661-492e-88cc-7d15a73df75c None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:39.613052 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aee8385-104b-4db5-9b37-2474a6044c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:39.613984 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee8385-104b-4db5-9b37-2474a6044c2b None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:39.614470 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee8385-104b-4db5-9b37-2474a6044c2b None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:39.614936 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee8385-104b-4db5-9b37-2474a6044c2b None admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:39.615818 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aee8385-104b-4db5-9b37-2474a6044c2b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:39.616305 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aee8385-104b-4db5-9b37-2474a6044c2b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:39.618009 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aee8385-104b-4db5-9b37-2474a6044c2b None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:39.632109 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 355/713] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Oct 13 10:58:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:39.640070 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5699c2-78ca-450a-b2cf-9dbbc50fb6ab None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:39.698356 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:39.741349 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5699c2-78ca-450a-b2cf-9dbbc50fb6ab None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:39.780727 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fac1a4-797d-4b66-84d5-8b4d1028f44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:39.781343 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fac1a4-797d-4b66-84d5-8b4d1028f44b None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:39.781623 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fac1a4-797d-4b66-84d5-8b4d1028f44b None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:39.782006 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fac1a4-797d-4b66-84d5-8b4d1028f44b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:39.782720 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fac1a4-797d-4b66-84d5-8b4d1028f44b None admin] RBAC: Adding query filter params (role.id=fba8d2d3d7964167b2f43a7eb6f5e8b7, scope.project.id=85bfac5f03e24fb3870a59a6b52dba6e, user.id=6e803a9cc6114c4f93869e50bca313e7) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:39.783034 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fac1a4-797d-4b66-84d5-8b4d1028f44b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:39.785062 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fac1a4-797d-4b66-84d5-8b4d1028f44b None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:39.792185 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 359/714] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Oct 13 10:58:39 2022] GET /identity/v3/role_assignments?user.id=6e803a9cc6114c4f93869e50bca313e7&scope.project.id=85bfac5f03e24fb3870a59a6b52dba6e&role.id=fba8d2d3d7964167b2f43a7eb6f5e8b7 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:39.807404 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aee8385-104b-4db5-9b37-2474a6044c2b None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:39.854046 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:39.929992 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aee8385-104b-4db5-9b37-2474a6044c2b None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:39.973545 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d45919-e643-4689-81c3-c9639f5c3564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:39.974141 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d45919-e643-4689-81c3-c9639f5c3564 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:39.974493 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d45919-e643-4689-81c3-c9639f5c3564 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:39.974775 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d45919-e643-4689-81c3-c9639f5c3564 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:39.975377 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d45919-e643-4689-81c3-c9639f5c3564 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:39.976752 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d45919-e643-4689-81c3-c9639f5c3564 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:39.986394 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-30d45919-e643-4689-81c3-c9639f5c3564 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 13 10:58:39.986394 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:39.986394 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 10:58:39.986394 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 10:58:39.986394 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 10:58:39.986394 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 10:58:39.986394 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 10:58:39.986394 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:39.986394 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 13 10:58:39.986394 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:39.986394 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 10:58:39.986394 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:39.986394 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:39.986394 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:39.986394 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:39.986394 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:39.986394 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:39.988204 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:39.988204 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:39.988204 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:39.988204 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:39.988204 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:39.988204 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:39.988204 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 10:58:39.988204 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 10:58:39.988204 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 10:58:39.988204 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 10:58:39.988204 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:39.988204 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:39.988204 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:39.988204 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:39.988204 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:39.988204 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:39.989017 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:39.989017 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:39.989017 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:39.989017 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:39.989017 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:39.989017 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:39.989017 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:39.989017 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:39.989017 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:39.989017 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:39.989017 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 10:58:39.989017 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:39.989017 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 13 10:58:39.989017 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:39.993256 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 356/715] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Oct 13 10:58:39 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:39.994781 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fac1a4-797d-4b66-84d5-8b4d1028f44b None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:40.114910 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fac1a4-797d-4b66-84d5-8b4d1028f44b None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:40.128712 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:40.151951 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c924563-a6cc-4501-8d8b-3fe36ee5fc86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:40.152944 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c924563-a6cc-4501-8d8b-3fe36ee5fc86 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:40.152944 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c924563-a6cc-4501-8d8b-3fe36ee5fc86 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:40.153208 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c924563-a6cc-4501-8d8b-3fe36ee5fc86 None admin] PATH_INFO: `/v3/services` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:40.153693 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c924563-a6cc-4501-8d8b-3fe36ee5fc86 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:40.154054 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c924563-a6cc-4501-8d8b-3fe36ee5fc86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:40.155353 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c924563-a6cc-4501-8d8b-3fe36ee5fc86 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:40.165859 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 360/716] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Oct 13 10:58:39 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:40.167370 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d45919-e643-4689-81c3-c9639f5c3564 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:40.273251 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d45919-e643-4689-81c3-c9639f5c3564 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:40.274732 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:40.308304 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75db9a6-1799-4b12-b09b-f5c5b844710a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:40.308907 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75db9a6-1799-4b12-b09b-f5c5b844710a None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:40.309181 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75db9a6-1799-4b12-b09b-f5c5b844710a None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:40.309450 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75db9a6-1799-4b12-b09b-f5c5b844710a None admin] PATH_INFO: `/v3/services` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:40.310100 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75db9a6-1799-4b12-b09b-f5c5b844710a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:40.310399 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75db9a6-1799-4b12-b09b-f5c5b844710a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:40.311744 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75db9a6-1799-4b12-b09b-f5c5b844710a None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:40.321887 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 357/717] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Oct 13 10:58:40 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:40.323236 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c924563-a6cc-4501-8d8b-3fe36ee5fc86 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:40.431043 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c924563-a6cc-4501-8d8b-3fe36ee5fc86 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:40.470145 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fdef64-be6f-49c7-b716-ba1b84e62e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:40.471132 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fdef64-be6f-49c7-b716-ba1b84e62e8c None admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:40.471651 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fdef64-be6f-49c7-b716-ba1b84e62e8c None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:40.472123 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fdef64-be6f-49c7-b716-ba1b84e62e8c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:40.472996 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fdef64-be6f-49c7-b716-ba1b84e62e8c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:40.474593 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fdef64-be6f-49c7-b716-ba1b84e62e8c None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:40.495719 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 361/718] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 10:58:40 2022] POST /identity/v3/endpoints => generated 346 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 10:58:41.321321 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e5ff6-a73d-4a17-a8af-8f890ed29c66 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:41.321854 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e5ff6-a73d-4a17-a8af-8f890ed29c66 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:41.321854 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e5ff6-a73d-4a17-a8af-8f890ed29c66 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:41.323455 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 358/719] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:58:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:41.328804 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48abb9-7e3a-4554-83b3-4e4e0ce643ba None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:41.329215 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48abb9-7e3a-4554-83b3-4e4e0ce643ba None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:41.329384 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48abb9-7e3a-4554-83b3-4e4e0ce643ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:41.347911 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-de48abb9-7e3a-4554-83b3-4e4e0ce643ba None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:41.349095 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-de48abb9-7e3a-4554-83b3-4e4e0ce643ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:41.375190 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:41.433699 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 362/720] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 10:58:41.536984 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c476e-3c00-4a75-b914-7fd36f658f5e None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:41.537437 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c476e-3c00-4a75-b914-7fd36f658f5e None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:41.538041 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c476e-3c00-4a75-b914-7fd36f658f5e None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:41.539926 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 359/721] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:58:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:41.545326 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421c4af-3016-49c7-be3f-93efb93f9580 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:41.545839 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421c4af-3016-49c7-be3f-93efb93f9580 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:41.546396 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421c4af-3016-49c7-be3f-93efb93f9580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:41.565668 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-d421c4af-3016-49c7-be3f-93efb93f9580 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:41.567191 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-d421c4af-3016-49c7-be3f-93efb93f9580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:41.637491 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 363/722] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 10:58:41.700163 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c476e-3c00-4a75-b914-7fd36f658f5e None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:41.802740 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c476e-3c00-4a75-b914-7fd36f658f5e None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:41.841051 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ddec53-7041-4597-985c-82cffeecf453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:41.841655 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ddec53-7041-4597-985c-82cffeecf453 None admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:41.841930 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ddec53-7041-4597-985c-82cffeecf453 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:41.842225 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ddec53-7041-4597-985c-82cffeecf453 None admin] PATH_INFO: `/v3/services` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:41.842885 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ddec53-7041-4597-985c-82cffeecf453 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:41.844239 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ddec53-7041-4597-985c-82cffeecf453 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:41.862771 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 360/723] 10.222.0.25 () {60 vars in 1141 bytes} [Thu Oct 13 10:58:41 2022] POST /identity/v3/services => generated 242 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 10:58:41.934642 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d421c4af-3016-49c7-be3f-93efb93f9580 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:42.037375 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:42.051445 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d421c4af-3016-49c7-be3f-93efb93f9580 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:42.102036 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898af043-dc8d-477e-8784-5f693666e692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:42.102676 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898af043-dc8d-477e-8784-5f693666e692 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:42.102956 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898af043-dc8d-477e-8784-5f693666e692 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:42.103229 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898af043-dc8d-477e-8784-5f693666e692 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:42.103819 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898af043-dc8d-477e-8784-5f693666e692 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:42.105242 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898af043-dc8d-477e-8784-5f693666e692 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:42.114660 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-898af043-dc8d-477e-8784-5f693666e692 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 13 10:58:42.114660 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:42.114660 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 10:58:42.114660 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 10:58:42.114660 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 10:58:42.114660 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 10:58:42.114660 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 10:58:42.114660 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:42.114660 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 13 10:58:42.114660 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:42.114660 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 10:58:42.114660 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:42.114660 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:42.114660 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:42.114660 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:42.114660 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:42.114660 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:42.115646 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:42.115646 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:42.115646 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:42.115646 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:42.115646 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:42.115646 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:42.115646 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 10:58:42.115646 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 10:58:42.115646 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 10:58:42.115646 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 10:58:42.115646 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:42.115646 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:42.115646 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:42.115646 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:42.115646 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:42.115646 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:42.116471 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:42.116471 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:42.116471 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:42.116471 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:42.116471 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:42.116471 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:42.116471 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:42.116471 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:42.116471 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:42.116471 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:42.116471 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 10:58:42.116471 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:42.116471 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 13 10:58:42.116471 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:42.116471 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 364/724] 10.222.0.25 () {56 vars in 1126 bytes} [Thu Oct 13 10:58:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:42.121755 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ddec53-7041-4597-985c-82cffeecf453 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:42.154969 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:42.188248 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547c7c0-81d3-4981-a6b5-10da2d9f3083 None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:42.188857 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547c7c0-81d3-4981-a6b5-10da2d9f3083 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:42.189338 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547c7c0-81d3-4981-a6b5-10da2d9f3083 None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:42.191219 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 365/725] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:58:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:42.196357 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1fe5e4-5b05-4be7-9e0d-70a4c95ef14a None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:42.196873 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1fe5e4-5b05-4be7-9e0d-70a4c95ef14a None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:42.197442 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1fe5e4-5b05-4be7-9e0d-70a4c95ef14a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:42.217019 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-2e1fe5e4-5b05-4be7-9e0d-70a4c95ef14a None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:42.218604 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-2e1fe5e4-5b05-4be7-9e0d-70a4c95ef14a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:42.234899 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ddec53-7041-4597-985c-82cffeecf453 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:42.271940 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14599169-4a28-4e7a-a30e-4db126ae6708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:42.273100 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14599169-4a28-4e7a-a30e-4db126ae6708 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:42.273590 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14599169-4a28-4e7a-a30e-4db126ae6708 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:42.274332 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14599169-4a28-4e7a-a30e-4db126ae6708 None admin] PATH_INFO: `/v3/services` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:42.275550 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14599169-4a28-4e7a-a30e-4db126ae6708 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:42.276042 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14599169-4a28-4e7a-a30e-4db126ae6708 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:42.277587 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14599169-4a28-4e7a-a30e-4db126ae6708 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:42.284831 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 361/726] 10.222.0.25 () {56 vars in 1122 bytes} [Thu Oct 13 10:58:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:42.290868 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14599169-4a28-4e7a-a30e-4db126ae6708 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:42.300277 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 366/727] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:42 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 13 10:58:42.383128 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:42.392615 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14599169-4a28-4e7a-a30e-4db126ae6708 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:42.427924 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde821a-4f67-4c12-a731-5f3489971002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:42.428507 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde821a-4f67-4c12-a731-5f3489971002 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:42.428781 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde821a-4f67-4c12-a731-5f3489971002 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:42.429052 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde821a-4f67-4c12-a731-5f3489971002 None admin] PATH_INFO: `/v3/services` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:42.429676 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffde821a-4f67-4c12-a731-5f3489971002 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:42.429994 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffde821a-4f67-4c12-a731-5f3489971002 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:42.431340 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffde821a-4f67-4c12-a731-5f3489971002 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:42.441104 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 362/728] 10.222.0.25 () {56 vars in 1122 bytes} [Thu Oct 13 10:58:42 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:42.442363 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1fe5e4-5b05-4be7-9e0d-70a4c95ef14a None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:42.530166 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:42.553143 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1fe5e4-5b05-4be7-9e0d-70a4c95ef14a None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:42.588181 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aefbaa5-1106-4eb2-a531-437173b8a8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:42.588787 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aefbaa5-1106-4eb2-a531-437173b8a8e3 None admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:42.589066 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aefbaa5-1106-4eb2-a531-437173b8a8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:42.589335 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aefbaa5-1106-4eb2-a531-437173b8a8e3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:42.590028 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aefbaa5-1106-4eb2-a531-437173b8a8e3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:42.591391 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aefbaa5-1106-4eb2-a531-437173b8a8e3 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:42.605207 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde821a-4f67-4c12-a731-5f3489971002 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:42.634147 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 367/729] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 10:58:42 2022] POST /identity/v3/endpoints => generated 349 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 10:58:42.734114 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde821a-4f67-4c12-a731-5f3489971002 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:42.766152 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56937658-d845-452d-87f1-cddc6b3b5187 None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:42.766679 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56937658-d845-452d-87f1-cddc6b3b5187 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:42.767146 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56937658-d845-452d-87f1-cddc6b3b5187 None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:42.769073 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 368/730] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:58:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:42.774923 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d57b1-0f52-4fbc-be2e-72636c289172 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:42.775487 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d57b1-0f52-4fbc-be2e-72636c289172 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:42.775941 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d57b1-0f52-4fbc-be2e-72636c289172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:42.781452 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d530aa8b-4542-49c0-84eb-520f847e7385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:42.782191 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d530aa8b-4542-49c0-84eb-520f847e7385 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:42.782475 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d530aa8b-4542-49c0-84eb-520f847e7385 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:42.782753 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d530aa8b-4542-49c0-84eb-520f847e7385 None admin] PATH_INFO: `/v3/services/image` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:42.783363 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d530aa8b-4542-49c0-84eb-520f847e7385 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:42.786612 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d530aa8b-4542-49c0-84eb-520f847e7385 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:42.798717 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-990d57b1-0f52-4fbc-be2e-72636c289172 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:42.800333 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-990d57b1-0f52-4fbc-be2e-72636c289172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:42.801648 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-d530aa8b-4542-49c0-84eb-520f847e7385 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 13 10:58:42.801648 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:42.801648 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 10:58:42.801648 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 10:58:42.801648 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 10:58:42.801648 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 10:58:42.801648 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 10:58:42.801648 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:42.801648 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 13 10:58:42.801648 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:42.801648 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 10:58:42.801648 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:42.801648 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:42.801648 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:42.801648 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:42.801648 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:42.801648 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:42.802759 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:42.802759 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:42.802759 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:42.802759 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:42.802759 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:42.802759 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:42.802759 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 10:58:42.802759 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 10:58:42.802759 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 10:58:42.802759 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 10:58:42.802759 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:42.802759 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:42.802759 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:42.802759 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:42.802759 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:42.802759 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:42.803583 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:42.803583 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:42.803583 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:42.803583 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:42.803583 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:42.803583 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:42.803583 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:42.803583 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:42.803583 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:42.803583 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:42.803583 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 10:58:42.803583 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:42.803583 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 13 10:58:42.803583 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:42.804316 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 363/731] 10.222.0.25 () {56 vars in 1105 bytes} [Thu Oct 13 10:58:42 2022] GET /identity/v3/services/image => generated 86 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:42.809921 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d530aa8b-4542-49c0-84eb-520f847e7385 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:42.827665 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:42.883529 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 369/732] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:42 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 13 10:58:42.937749 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d530aa8b-4542-49c0-84eb-520f847e7385 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:42.972389 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e08d7b8-f9fa-48f6-bff3-d66a83507700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:42.973001 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08d7b8-f9fa-48f6-bff3-d66a83507700 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:42.973285 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08d7b8-f9fa-48f6-bff3-d66a83507700 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:42.973561 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08d7b8-f9fa-48f6-bff3-d66a83507700 None admin] PATH_INFO: `/v3/services` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:42.974218 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e08d7b8-f9fa-48f6-bff3-d66a83507700 None admin] RBAC: Adding query filter params (name=image) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:42.974525 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e08d7b8-f9fa-48f6-bff3-d66a83507700 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:42.975957 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e08d7b8-f9fa-48f6-bff3-d66a83507700 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:42.981120 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 364/733] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:42 2022] GET /identity/v3/services?name=image => generated 122 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:58:42.987124 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990d57b1-0f52-4fbc-be2e-72636c289172 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:43.052054 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:43.092100 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990d57b1-0f52-4fbc-be2e-72636c289172 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:43.127374 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a27123-3c47-4eb7-b75e-2907e4c1fe89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:43.128128 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a27123-3c47-4eb7-b75e-2907e4c1fe89 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:43.128414 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a27123-3c47-4eb7-b75e-2907e4c1fe89 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:43.128686 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a27123-3c47-4eb7-b75e-2907e4c1fe89 None admin] PATH_INFO: `/v3/services` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:43.129321 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a27123-3c47-4eb7-b75e-2907e4c1fe89 None admin] RBAC: Adding query filter params (type=image) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:43.129624 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a27123-3c47-4eb7-b75e-2907e4c1fe89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:43.131078 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a27123-3c47-4eb7-b75e-2907e4c1fe89 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:43.135971 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 370/734] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:42 2022] GET /identity/v3/services?type=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:43.170027 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e08d7b8-f9fa-48f6-bff3-d66a83507700 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:43.259581 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:43.283764 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e08d7b8-f9fa-48f6-bff3-d66a83507700 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:43.321208 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ff8891-1768-4a2c-a579-b6d26e197d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:43.321819 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ff8891-1768-4a2c-a579-b6d26e197d34 None admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:43.322144 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ff8891-1768-4a2c-a579-b6d26e197d34 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:43.322422 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ff8891-1768-4a2c-a579-b6d26e197d34 None admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:43.323067 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ff8891-1768-4a2c-a579-b6d26e197d34 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:43.324736 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ff8891-1768-4a2c-a579-b6d26e197d34 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:43.327385 dv-cinder-861001-1-smb devstack@keystone.service[81550]: WARNING keystone.server.flask.common [None req-10ff8891-1768-4a2c-a579-b6d26e197d34 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 13 10:58:43.346179 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.sql.core [None req-10ff8891-1768-4a2c-a579-b6d26e197d34 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 13 10:58:43.346179 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 13 10:58:43.346179 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [parameters: {'id': '2043e14a976749f699fa45fad3e07911', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 13 10:58:43.346179 dv-cinder-861001-1-smb devstack@keystone.service[81550]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81550) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 13 10:58:43.355014 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-10ff8891-1768-4a2c-a579-b6d26e197d34 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2043e14a976749f699fa45fad3e07911.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2043e14a976749f699fa45fad3e07911. Oct 13 10:58:43.355014 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:43.355014 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 13 10:58:43.355014 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 13 10:58:43.355014 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 13 10:58:43.355014 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 13 10:58:43.355014 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 13 10:58:43.355014 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application result = self._query(query) Oct 13 10:58:43.355014 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 13 10:58:43.355014 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application conn.query(q) Oct 13 10:58:43.355014 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 13 10:58:43.355014 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 13 10:58:43.355014 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 13 10:58:43.355815 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application result.read() Oct 13 10:58:43.355815 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 13 10:58:43.355815 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 13 10:58:43.355815 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 13 10:58:43.355815 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 13 10:58:43.355815 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 13 10:58:43.355815 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 13 10:58:43.355815 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 13 10:58:43.355815 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 13 10:58:43.355815 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 13 10:58:43.355815 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:43.355815 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 13 10:58:43.355815 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:43.355815 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:43.355815 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 13 10:58:43.355815 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 13 10:58:43.355815 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 13 10:58:43.355815 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 13 10:58:43.356765 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 13 10:58:43.356765 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application next(self.gen) Oct 13 10:58:43.356765 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 13 10:58:43.356765 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application yield resource Oct 13 10:58:43.356765 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 13 10:58:43.356765 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application next(self.gen) Oct 13 10:58:43.356765 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 13 10:58:43.356765 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self.session.rollback() Oct 13 10:58:43.356765 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 13 10:58:43.356765 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self.force_reraise() Oct 13 10:58:43.356765 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 13 10:58:43.356765 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise self.value Oct 13 10:58:43.356765 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 13 10:58:43.356765 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 13 10:58:43.356765 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 13 10:58:43.356765 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application session.commit() Oct 13 10:58:43.356765 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 13 10:58:43.358504 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 13 10:58:43.358504 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 13 10:58:43.358504 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self._prepare_impl() Oct 13 10:58:43.358504 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 13 10:58:43.358504 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self.session.flush() Oct 13 10:58:43.358504 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 13 10:58:43.358504 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self._flush(objects) Oct 13 10:58:43.358504 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 13 10:58:43.358504 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 13 10:58:43.358504 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 13 10:58:43.358504 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application compat.raise_( Oct 13 10:58:43.358504 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 13 10:58:43.358504 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception Oct 13 10:58:43.358504 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 13 10:58:43.358504 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application flush_context.execute() Oct 13 10:58:43.358504 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 13 10:58:43.358504 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rec.execute(self) Oct 13 10:58:43.359424 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 13 10:58:43.359424 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 13 10:58:43.359424 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 13 10:58:43.359424 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 13 10:58:43.359424 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 13 10:58:43.359424 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 13 10:58:43.359424 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 13 10:58:43.359424 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 13 10:58:43.359424 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 13 10:58:43.359424 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 13 10:58:43.359424 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 13 10:58:43.359424 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 13 10:58:43.359424 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 13 10:58:43.359424 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 13 10:58:43.359424 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 13 10:58:43.360229 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 13 10:58:43.360229 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 13 10:58:43.360229 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception Oct 13 10:58:43.360229 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 13 10:58:43.360229 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 13 10:58:43.360229 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 13 10:58:43.360229 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 13 10:58:43.360229 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 13 10:58:43.360229 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application result = self._query(query) Oct 13 10:58:43.360229 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 13 10:58:43.360229 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application conn.query(q) Oct 13 10:58:43.360229 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 13 10:58:43.360229 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 13 10:58:43.360229 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 13 10:58:43.360229 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application result.read() Oct 13 10:58:43.360229 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 13 10:58:43.360229 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 13 10:58:43.361087 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 13 10:58:43.361087 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 13 10:58:43.361087 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 13 10:58:43.361087 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 13 10:58:43.361087 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 13 10:58:43.361087 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 13 10:58:43.361087 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 13 10:58:43.361087 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 13 10:58:43.361087 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [parameters: {'id': '2043e14a976749f699fa45fad3e07911', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 13 10:58:43.361087 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 13 10:58:43.361087 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:43.361087 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 10:58:43.361087 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:43.361087 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:43.361087 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 13 10:58:43.363852 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 13 10:58:43.363852 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 13 10:58:43.363852 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 13 10:58:43.363852 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 13 10:58:43.363852 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:43.363852 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 10:58:43.363852 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:43.363852 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:43.363852 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:43.363852 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:43.363852 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:43.363852 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:43.363852 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:43.363852 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:43.363852 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:43.363852 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:43.363852 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:43.366020 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:43.366020 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 13 10:58:43.366020 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 13 10:58:43.366020 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:43.366020 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:43.366020 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 13 10:58:43.366020 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 13 10:58:43.366020 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2043e14a976749f699fa45fad3e07911. Oct 13 10:58:43.366020 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:43.366020 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 365/735] 10.222.0.25 () {60 vars in 1140 bytes} [Thu Oct 13 10:58:43 2022] POST /identity/v3/projects => generated 262 bytes in 187 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:43.370194 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a27123-3c47-4eb7-b75e-2907e4c1fe89 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:43.474919 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a27123-3c47-4eb7-b75e-2907e4c1fe89 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:43.501750 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:43.511060 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c058390-a2cf-4083-b261-f0db2b70ec2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:43.511762 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c058390-a2cf-4083-b261-f0db2b70ec2b None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:43.512046 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c058390-a2cf-4083-b261-f0db2b70ec2b None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:43.512378 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c058390-a2cf-4083-b261-f0db2b70ec2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:43.520537 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c058390-a2cf-4083-b261-f0db2b70ec2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:43.522010 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c058390-a2cf-4083-b261-f0db2b70ec2b None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:43.535155 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-4c058390-a2cf-4083-b261-f0db2b70ec2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:58:43.535155 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:43.535155 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:43.535155 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:43.535155 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:43.535155 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:43.535155 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:43.535155 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:43.535155 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:43.535155 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:43.535155 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:43.535155 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:43.535155 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 10:58:43.535155 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 10:58:43.535155 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 10:58:43.536050 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 10:58:43.536050 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:43.536050 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:43.536050 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:43.536050 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:43.536050 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:43.536050 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:43.536050 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:43.536050 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:43.536050 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:43.536050 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:43.536050 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:43.536050 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:43.536050 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:43.536050 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:43.536050 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:43.536050 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:43.536943 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 10:58:43.536943 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 10:58:43.536943 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 10:58:43.536943 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 10:58:43.536943 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 10:58:43.536943 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 10:58:43.536943 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:58:43.536943 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:43.536943 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 371/736] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Oct 13 10:58:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:43.542507 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ff8891-1768-4a2c-a579-b6d26e197d34 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:43.649169 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ff8891-1768-4a2c-a579-b6d26e197d34 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:43.686673 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae817f48-92c8-48a9-9760-68e009e0e6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:43.687291 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae817f48-92c8-48a9-9760-68e009e0e6d4 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:43.687572 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae817f48-92c8-48a9-9760-68e009e0e6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:43.687850 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae817f48-92c8-48a9-9760-68e009e0e6d4 None admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:43.688528 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae817f48-92c8-48a9-9760-68e009e0e6d4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:43.688837 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae817f48-92c8-48a9-9760-68e009e0e6d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:43.690615 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae817f48-92c8-48a9-9760-68e009e0e6d4 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:43.692302 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:43.712819 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 366/737] 10.222.0.25 () {56 vars in 1112 bytes} [Thu Oct 13 10:58:43 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:44.100712 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e318d-84bc-42e7-9805-3fb509b0d15f None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:44.101415 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e318d-84bc-42e7-9805-3fb509b0d15f None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:44.101906 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e318d-84bc-42e7-9805-3fb509b0d15f None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:44.103914 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 372/738] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:58:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:44.110987 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd09460-c71a-4aef-9a90-e81bef25433c None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:44.111630 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd09460-c71a-4aef-9a90-e81bef25433c None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:44.112940 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd09460-c71a-4aef-9a90-e81bef25433c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:44.133405 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-fbd09460-c71a-4aef-9a90-e81bef25433c None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:44.135271 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-fbd09460-c71a-4aef-9a90-e81bef25433c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:44.201594 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 367/739] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:44 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 10:58:44.469821 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973e318d-84bc-42e7-9805-3fb509b0d15f None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:44.577082 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973e318d-84bc-42e7-9805-3fb509b0d15f None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:44.613000 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b1d8bd-b1a2-4ae9-93f2-03c97bb648fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:44.613634 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b1d8bd-b1a2-4ae9-93f2-03c97bb648fe None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:44.613911 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b1d8bd-b1a2-4ae9-93f2-03c97bb648fe None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:44.614205 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b1d8bd-b1a2-4ae9-93f2-03c97bb648fe None admin] PATH_INFO: `/v3/services/compute` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:44.614792 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b1d8bd-b1a2-4ae9-93f2-03c97bb648fe None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:44.616209 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b1d8bd-b1a2-4ae9-93f2-03c97bb648fe None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:44.625027 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-43b1d8bd-b1a2-4ae9-93f2-03c97bb648fe None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 13 10:58:44.625027 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:44.625027 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 10:58:44.625027 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 10:58:44.625027 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 10:58:44.625027 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 10:58:44.625027 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 10:58:44.625027 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:44.625027 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 13 10:58:44.625027 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:44.625027 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 10:58:44.625027 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:44.625027 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:44.625027 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:44.625027 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:44.625027 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:44.625027 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:44.626003 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:44.626003 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:44.626003 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:44.626003 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:44.626003 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:44.626003 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:44.626003 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 10:58:44.626003 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 10:58:44.626003 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 10:58:44.626003 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 10:58:44.626003 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:44.626003 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:44.626003 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:44.626003 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:44.626003 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:44.626003 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:44.626861 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:44.626861 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:44.626861 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:44.626861 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:44.626861 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:44.626861 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:44.626861 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:44.626861 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:44.626861 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:44.626861 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:44.626861 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 10:58:44.626861 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:44.626861 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 13 10:58:44.626861 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:44.626861 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 373/740] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Oct 13 10:58:44 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:44.634288 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd09460-c71a-4aef-9a90-e81bef25433c None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:44.739416 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd09460-c71a-4aef-9a90-e81bef25433c None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:44.762664 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:44.774587 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f521d219-8e69-4755-80de-acdc59a332a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:44.775492 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f521d219-8e69-4755-80de-acdc59a332a3 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:44.776167 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f521d219-8e69-4755-80de-acdc59a332a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:44.776444 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f521d219-8e69-4755-80de-acdc59a332a3 None admin] PATH_INFO: `/v3/services` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:44.777077 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f521d219-8e69-4755-80de-acdc59a332a3 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:44.777382 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f521d219-8e69-4755-80de-acdc59a332a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:44.778837 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f521d219-8e69-4755-80de-acdc59a332a3 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:44.784211 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 368/741] 10.222.0.25 () {56 vars in 1112 bytes} [Thu Oct 13 10:58:44 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:44.790490 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b1d8bd-b1a2-4ae9-93f2-03c97bb648fe None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:44.844995 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:44.903958 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b1d8bd-b1a2-4ae9-93f2-03c97bb648fe None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:44.938426 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b24ba-062d-4001-9f71-83b5f42b81d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:44.939039 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b24ba-062d-4001-9f71-83b5f42b81d1 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:44.939324 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b24ba-062d-4001-9f71-83b5f42b81d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:44.939599 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b24ba-062d-4001-9f71-83b5f42b81d1 None admin] PATH_INFO: `/v3/services` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:44.940787 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477b24ba-062d-4001-9f71-83b5f42b81d1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:44.941091 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477b24ba-062d-4001-9f71-83b5f42b81d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:44.942485 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477b24ba-062d-4001-9f71-83b5f42b81d1 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:44.947635 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 374/742] 10.222.0.25 () {56 vars in 1112 bytes} [Thu Oct 13 10:58:44 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:44.953288 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f521d219-8e69-4755-80de-acdc59a332a3 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:45.004258 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a3741-0ddc-4611-b865-d726aff8cf6d None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:45.004886 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a3741-0ddc-4611-b865-d726aff8cf6d None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:45.005360 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a3741-0ddc-4611-b865-d726aff8cf6d None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:45.008234 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 375/743] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:58:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:45.012454 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8cbf6-7a44-40c8-91bc-8ec1f1472441 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:45.012969 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8cbf6-7a44-40c8-91bc-8ec1f1472441 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:45.013443 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8cbf6-7a44-40c8-91bc-8ec1f1472441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:45.032102 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-11e8cbf6-7a44-40c8-91bc-8ec1f1472441 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:45.033652 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-11e8cbf6-7a44-40c8-91bc-8ec1f1472441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:45.058113 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f521d219-8e69-4755-80de-acdc59a332a3 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:45.095026 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae274e3-7577-4f23-a597-fe50da6d98ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:45.095641 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae274e3-7577-4f23-a597-fe50da6d98ea None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:45.095923 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae274e3-7577-4f23-a597-fe50da6d98ea None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:45.096228 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae274e3-7577-4f23-a597-fe50da6d98ea None admin] PATH_INFO: `/v3/endpoints` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:45.097590 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae274e3-7577-4f23-a597-fe50da6d98ea None admin] RBAC: Adding query filter params (interface=public, service_id=68f32556577c4f5da33a71871852be99, region_id=RegionOne) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:45.098215 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae274e3-7577-4f23-a597-fe50da6d98ea None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:45.099716 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae274e3-7577-4f23-a597-fe50da6d98ea None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:45.106828 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 369/744] 10.222.0.25 () {56 vars in 1251 bytes} [Thu Oct 13 10:58:44 2022] GET /identity/v3/endpoints?service_id=68f32556577c4f5da33a71871852be99&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:45.111691 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae274e3-7577-4f23-a597-fe50da6d98ea None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:45.121836 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 376/745] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:45 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 13 10:58:45.172808 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:45.222972 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae274e3-7577-4f23-a597-fe50da6d98ea None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:45.262602 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b22d70-50db-4e88-aa6d-75dc8035433a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:45.263170 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b22d70-50db-4e88-aa6d-75dc8035433a None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:45.263449 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b22d70-50db-4e88-aa6d-75dc8035433a None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:45.263772 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b22d70-50db-4e88-aa6d-75dc8035433a None admin] PATH_INFO: `/v3/services` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:45.264437 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b22d70-50db-4e88-aa6d-75dc8035433a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:45.265829 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b22d70-50db-4e88-aa6d-75dc8035433a None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:45.273051 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 370/746] 10.222.0.25 () {56 vars in 1087 bytes} [Thu Oct 13 10:58:45 2022] GET /identity/v3/services => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 13 10:58:45.397793 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e8cbf6-7a44-40c8-91bc-8ec1f1472441 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:45.428244 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199194d9-e857-47a9-9869-55ccfaffa63b None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:45.428694 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199194d9-e857-47a9-9869-55ccfaffa63b None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:45.429069 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199194d9-e857-47a9-9869-55ccfaffa63b None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:45.430935 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 371/747] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:58:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 10:58:45.436850 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3f9e7d-8fcd-4905-9415-d4bbbde5a544 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:45.437135 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3f9e7d-8fcd-4905-9415-d4bbbde5a544 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:45.437411 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3f9e7d-8fcd-4905-9415-d4bbbde5a544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:45.458268 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:45.458719 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-3b3f9e7d-8fcd-4905-9415-d4bbbde5a544 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:45.459934 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-3b3f9e7d-8fcd-4905-9415-d4bbbde5a544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:45.521309 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e8cbf6-7a44-40c8-91bc-8ec1f1472441 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:45.548724 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 372/748] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:45 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 13 10:58:45.561672 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39a973a-e3ec-4693-8730-04c95bd58413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:45.562381 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a973a-e3ec-4693-8730-04c95bd58413 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:45.562663 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a973a-e3ec-4693-8730-04c95bd58413 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:45.562934 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a973a-e3ec-4693-8730-04c95bd58413 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:45.563526 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39a973a-e3ec-4693-8730-04c95bd58413 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:45.564880 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39a973a-e3ec-4693-8730-04c95bd58413 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:45.574578 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-c39a973a-e3ec-4693-8730-04c95bd58413 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 13 10:58:45.574578 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:45.574578 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 10:58:45.574578 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 10:58:45.574578 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 10:58:45.574578 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 10:58:45.574578 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 10:58:45.574578 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:45.574578 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 13 10:58:45.574578 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:45.574578 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 10:58:45.574578 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:45.574578 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:45.574578 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:45.574578 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:45.574578 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:45.574578 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:45.575571 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:45.575571 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:45.575571 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:45.575571 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:45.575571 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:45.575571 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:45.575571 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 10:58:45.575571 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 10:58:45.575571 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 10:58:45.575571 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 10:58:45.575571 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:45.575571 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:45.575571 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:45.575571 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:45.575571 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:45.575571 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:45.576425 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:45.576425 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:45.576425 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:45.576425 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:45.576425 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:45.576425 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:45.576425 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:45.576425 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:45.576425 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:45.576425 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:45.576425 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 10:58:45.576425 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:45.576425 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 13 10:58:45.576425 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:45.580600 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 377/749] 10.222.0.25 () {56 vars in 1126 bytes} [Thu Oct 13 10:58:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:45.582062 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3f9e7d-8fcd-4905-9415-d4bbbde5a544 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:45.631433 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:45.685476 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3f9e7d-8fcd-4905-9415-d4bbbde5a544 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:45.720379 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8038da-4ce8-48e0-a94f-0608bda0d886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:45.720988 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8038da-4ce8-48e0-a94f-0608bda0d886 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:45.721271 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8038da-4ce8-48e0-a94f-0608bda0d886 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:45.722129 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8038da-4ce8-48e0-a94f-0608bda0d886 None admin] PATH_INFO: `/v3/services` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:45.722760 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8038da-4ce8-48e0-a94f-0608bda0d886 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:45.723062 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8038da-4ce8-48e0-a94f-0608bda0d886 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:45.724477 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8038da-4ce8-48e0-a94f-0608bda0d886 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:45.733519 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 373/750] 10.222.0.25 () {56 vars in 1122 bytes} [Thu Oct 13 10:58:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:45.735243 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39a973a-e3ec-4693-8730-04c95bd58413 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:45.819099 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8038da-4ce8-48e0-a94f-0608bda0d886 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:45.842135 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39a973a-e3ec-4693-8730-04c95bd58413 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:45.854998 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:45.886662 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e46e2-ad1d-4023-a514-3a0521459e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:45.887288 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e46e2-ad1d-4023-a514-3a0521459e5f None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:45.890369 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e46e2-ad1d-4023-a514-3a0521459e5f None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:45.890369 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e46e2-ad1d-4023-a514-3a0521459e5f None admin] PATH_INFO: `/v3/services` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:45.890369 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380e46e2-ad1d-4023-a514-3a0521459e5f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:45.890369 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380e46e2-ad1d-4023-a514-3a0521459e5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:45.890369 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380e46e2-ad1d-4023-a514-3a0521459e5f None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:45.896010 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 378/751] 10.222.0.25 () {56 vars in 1122 bytes} [Thu Oct 13 10:58:45 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:45.902647 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e46e2-ad1d-4023-a514-3a0521459e5f None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:45.959677 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8038da-4ce8-48e0-a94f-0608bda0d886 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:45.973660 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:46.003477 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e06c05-de1a-406e-bf34-06ad1b747046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:46.004158 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e06c05-de1a-406e-bf34-06ad1b747046 None admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:46.004530 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e06c05-de1a-406e-bf34-06ad1b747046 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:46.004903 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e06c05-de1a-406e-bf34-06ad1b747046 None admin] PATH_INFO: `/v3/services` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:46.005670 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e06c05-de1a-406e-bf34-06ad1b747046 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:46.007348 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e06c05-de1a-406e-bf34-06ad1b747046 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:46.027912 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 374/752] 10.222.0.25 () {60 vars in 1141 bytes} [Thu Oct 13 10:58:45 2022] POST /identity/v3/services => generated 242 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 10:58:46.029425 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ebf53-6535-463a-b91e-da6bd091619e None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:46.029773 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ebf53-6535-463a-b91e-da6bd091619e None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:46.030140 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ebf53-6535-463a-b91e-da6bd091619e None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:46.031652 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 375/753] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:58:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:46.033086 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e46e2-ad1d-4023-a514-3a0521459e5f None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:46.043474 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a2fe2-db10-4f9f-8ef5-ded4e5e3b5a2 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:46.043765 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a2fe2-db10-4f9f-8ef5-ded4e5e3b5a2 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:46.044039 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a2fe2-db10-4f9f-8ef5-ded4e5e3b5a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:46.064114 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-0b4a2fe2-db10-4f9f-8ef5-ded4e5e3b5a2 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:46.066055 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-0b4a2fe2-db10-4f9f-8ef5-ded4e5e3b5a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:46.085255 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eab155-73af-4a01-8bd7-a3d3397d4c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:46.086154 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eab155-73af-4a01-8bd7-a3d3397d4c6b None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:46.086606 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eab155-73af-4a01-8bd7-a3d3397d4c6b None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:46.087019 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eab155-73af-4a01-8bd7-a3d3397d4c6b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:46.087968 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eab155-73af-4a01-8bd7-a3d3397d4c6b None admin] RBAC: Adding query filter params (interface=admin, service_id=5c8ff975119e40f48f952fa6f64e1308, region_id=RegionOne) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:46.088426 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eab155-73af-4a01-8bd7-a3d3397d4c6b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:46.090190 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eab155-73af-4a01-8bd7-a3d3397d4c6b None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:46.096996 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 379/754] 10.222.0.25 () {56 vars in 1249 bytes} [Thu Oct 13 10:58:45 2022] GET /identity/v3/endpoints?service_id=5c8ff975119e40f48f952fa6f64e1308&interface=admin®ion_id=RegionOne => generated 193 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:58:46.104130 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eab155-73af-4a01-8bd7-a3d3397d4c6b None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:46.148538 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 376/755] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:46 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 10:58:46.154472 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:46.229028 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eab155-73af-4a01-8bd7-a3d3397d4c6b None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:46.268809 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97bf4c5-d620-471d-99c2-d2882e726b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:46.269781 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97bf4c5-d620-471d-99c2-d2882e726b83 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:46.270289 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97bf4c5-d620-471d-99c2-d2882e726b83 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:46.270733 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97bf4c5-d620-471d-99c2-d2882e726b83 None admin] PATH_INFO: `/v3/services` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:46.271518 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97bf4c5-d620-471d-99c2-d2882e726b83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:46.273045 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97bf4c5-d620-471d-99c2-d2882e726b83 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:46.280538 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 380/756] 10.222.0.25 () {56 vars in 1087 bytes} [Thu Oct 13 10:58:46 2022] GET /identity/v3/services => generated 1957 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 13 10:58:46.428995 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4a2fe2-db10-4f9f-8ef5-ded4e5e3b5a2 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:46.535589 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:46.539030 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4a2fe2-db10-4f9f-8ef5-ded4e5e3b5a2 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:46.575962 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd61665-d630-4907-b2ff-0cdb5018741f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:46.576924 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd61665-d630-4907-b2ff-0cdb5018741f None admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:46.577419 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd61665-d630-4907-b2ff-0cdb5018741f None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:46.577910 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd61665-d630-4907-b2ff-0cdb5018741f None admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:46.578783 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd61665-d630-4907-b2ff-0cdb5018741f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:46.580400 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd61665-d630-4907-b2ff-0cdb5018741f None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:46.597763 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.sql.core [None req-6dd61665-d630-4907-b2ff-0cdb5018741f None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 13 10:58:46.597763 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 13 10:58:46.597763 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [parameters: {'user_id': '9f7002ba46144b20930f57c85f92e30a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 13 10:58:46.597763 dv-cinder-861001-1-smb devstack@keystone.service[81550]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81550) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 13 10:58:46.605755 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-6dd61665-d630-4907-b2ff-0cdb5018741f None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 13 10:58:46.605755 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:46.605755 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 13 10:58:46.605755 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 13 10:58:46.605755 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 13 10:58:46.605755 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 13 10:58:46.605755 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 13 10:58:46.605755 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application result = self._query(query) Oct 13 10:58:46.605755 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 13 10:58:46.605755 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application conn.query(q) Oct 13 10:58:46.605755 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 13 10:58:46.605755 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 13 10:58:46.605755 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 13 10:58:46.605755 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application result.read() Oct 13 10:58:46.605755 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 13 10:58:46.606783 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 13 10:58:46.606783 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 13 10:58:46.606783 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 13 10:58:46.606783 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 13 10:58:46.606783 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 13 10:58:46.606783 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 13 10:58:46.606783 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 13 10:58:46.606783 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 13 10:58:46.606783 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:46.606783 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 13 10:58:46.606783 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:46.606783 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:46.606783 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 13 10:58:46.606783 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 13 10:58:46.606783 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 13 10:58:46.606783 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 13 10:58:46.606783 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 13 10:58:46.606783 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application next(self.gen) Oct 13 10:58:46.607921 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 13 10:58:46.607921 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application yield resource Oct 13 10:58:46.607921 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 13 10:58:46.607921 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application next(self.gen) Oct 13 10:58:46.607921 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 13 10:58:46.607921 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self.session.rollback() Oct 13 10:58:46.607921 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 13 10:58:46.607921 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self.force_reraise() Oct 13 10:58:46.607921 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 13 10:58:46.607921 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise self.value Oct 13 10:58:46.607921 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 13 10:58:46.607921 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 13 10:58:46.607921 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 13 10:58:46.607921 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application session.commit() Oct 13 10:58:46.607921 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 13 10:58:46.607921 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 13 10:58:46.607921 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 13 10:58:46.608935 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self._prepare_impl() Oct 13 10:58:46.608935 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 13 10:58:46.608935 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self.session.flush() Oct 13 10:58:46.608935 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 13 10:58:46.608935 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self._flush(objects) Oct 13 10:58:46.608935 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 13 10:58:46.608935 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 13 10:58:46.608935 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 13 10:58:46.608935 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application compat.raise_( Oct 13 10:58:46.608935 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 13 10:58:46.608935 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception Oct 13 10:58:46.608935 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 13 10:58:46.608935 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application flush_context.execute() Oct 13 10:58:46.608935 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 13 10:58:46.608935 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rec.execute(self) Oct 13 10:58:46.608935 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 13 10:58:46.608935 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 13 10:58:46.609805 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 13 10:58:46.609805 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 13 10:58:46.609805 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 13 10:58:46.609805 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 13 10:58:46.609805 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 13 10:58:46.609805 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 13 10:58:46.609805 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 13 10:58:46.609805 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 13 10:58:46.609805 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 13 10:58:46.609805 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 13 10:58:46.609805 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 13 10:58:46.609805 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 13 10:58:46.609805 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 13 10:58:46.609805 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 13 10:58:46.609805 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 13 10:58:46.609805 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception Oct 13 10:58:46.610644 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 13 10:58:46.610644 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 13 10:58:46.610644 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 13 10:58:46.610644 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 13 10:58:46.610644 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 13 10:58:46.610644 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application result = self._query(query) Oct 13 10:58:46.610644 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 13 10:58:46.610644 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application conn.query(q) Oct 13 10:58:46.610644 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 13 10:58:46.610644 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 13 10:58:46.610644 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 13 10:58:46.610644 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application result.read() Oct 13 10:58:46.610644 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 13 10:58:46.610644 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 13 10:58:46.610644 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 13 10:58:46.610644 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 13 10:58:46.611462 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 13 10:58:46.611462 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 13 10:58:46.611462 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 13 10:58:46.611462 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 13 10:58:46.611462 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 13 10:58:46.611462 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 13 10:58:46.611462 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [parameters: {'user_id': '9f7002ba46144b20930f57c85f92e30a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 13 10:58:46.611462 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 13 10:58:46.611462 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:46.611462 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 10:58:46.611462 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:46.611462 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:46.611462 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:46.611462 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:46.611462 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:46.613774 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:46.613774 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:46.613774 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:46.613774 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:46.613774 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:46.613774 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:46.613774 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:46.613774 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 13 10:58:46.613774 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 13 10:58:46.613774 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:46.613774 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:46.613774 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 10:58:46.613774 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:46.613774 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 10:58:46.613774 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:46.613774 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 13 10:58:46.613774 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 13 10:58:46.614928 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 13 10:58:46.614928 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 13 10:58:46.614928 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 13 10:58:46.614928 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 13 10:58:46.614928 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 13 10:58:46.614928 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:46.616981 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 377/757] 10.222.0.25 () {60 vars in 1131 bytes} [Thu Oct 13 10:58:46 2022] POST /identity/v3/users => generated 160 bytes in 188 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:46.622929 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97bf4c5-d620-471d-99c2-d2882e726b83 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:46.728211 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:46.732341 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97bf4c5-d620-471d-99c2-d2882e726b83 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:46.767878 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5f4c19-e7db-4c37-a747-6d5055abc5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:46.769048 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5f4c19-e7db-4c37-a747-6d5055abc5c4 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:46.769327 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5f4c19-e7db-4c37-a747-6d5055abc5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:46.769601 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5f4c19-e7db-4c37-a747-6d5055abc5c4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:46.776966 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5f4c19-e7db-4c37-a747-6d5055abc5c4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:46.778431 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5f4c19-e7db-4c37-a747-6d5055abc5c4 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:46.790421 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-3c5f4c19-e7db-4c37-a747-6d5055abc5c4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 13 10:58:46.790421 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:46.790421 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:46.790421 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:46.790421 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:46.790421 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:46.790421 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:46.790421 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:46.790421 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:46.790421 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:46.790421 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:46.790421 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:46.790421 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 10:58:46.790421 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 10:58:46.790421 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 10:58:46.790421 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 10:58:46.792505 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:46.792505 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:46.792505 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 10:58:46.792505 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:46.792505 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 10:58:46.792505 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:46.792505 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:46.792505 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:46.792505 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:46.792505 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:46.792505 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:46.792505 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:46.792505 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:46.792505 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:46.792505 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:46.792505 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:46.792505 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:46.792505 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:46.794777 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:46.794777 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:46.794777 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 10:58:46.794777 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 10:58:46.794777 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 10:58:46.794777 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 10:58:46.794777 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 10:58:46.794777 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 10:58:46.794777 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 13 10:58:46.794777 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:46.794777 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 381/758] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 10:58:46 2022] GET /identity/v3/users/cinder => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:46.801476 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd61665-d630-4907-b2ff-0cdb5018741f None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:46.914824 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd61665-d630-4907-b2ff-0cdb5018741f None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:46.949611 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd9a3a-3c34-4bbc-a661-819775896d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:46.950745 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd9a3a-3c34-4bbc-a661-819775896d65 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:46.951224 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd9a3a-3c34-4bbc-a661-819775896d65 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:46.951691 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd9a3a-3c34-4bbc-a661-819775896d65 None admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:46.952578 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bd9a3a-3c34-4bbc-a661-819775896d65 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:46.953097 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bd9a3a-3c34-4bbc-a661-819775896d65 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:46.954968 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bd9a3a-3c34-4bbc-a661-819775896d65 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:46.995936 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 378/759] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Oct 13 10:58:46 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:47.539329 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f808fa-a532-4417-920a-062b9dc80daf None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:47.539750 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f808fa-a532-4417-920a-062b9dc80daf None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:47.539926 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f808fa-a532-4417-920a-062b9dc80daf None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:47.541353 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 382/760] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:58:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:47.546445 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d546f-32d4-43c5-8890-e0bbd17a605e None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:47.546737 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d546f-32d4-43c5-8890-e0bbd17a605e None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:47.547018 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d546f-32d4-43c5-8890-e0bbd17a605e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:47.565707 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-943d546f-32d4-43c5-8890-e0bbd17a605e None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:47.567241 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-943d546f-32d4-43c5-8890-e0bbd17a605e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:47.582222 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:47.637981 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 379/761] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:47 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 10:58:47.907487 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f808fa-a532-4417-920a-062b9dc80daf None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:48.010095 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f808fa-a532-4417-920a-062b9dc80daf None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:48.044172 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1bcc30-7413-44fe-8cba-de1351d8be30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:48.044792 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1bcc30-7413-44fe-8cba-de1351d8be30 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:48.045066 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1bcc30-7413-44fe-8cba-de1351d8be30 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:48.045331 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1bcc30-7413-44fe-8cba-de1351d8be30 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:48.045907 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1bcc30-7413-44fe-8cba-de1351d8be30 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:48.047300 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1bcc30-7413-44fe-8cba-de1351d8be30 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:48.056121 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-7d1bcc30-7413-44fe-8cba-de1351d8be30 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 13 10:58:48.056121 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:48.056121 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 10:58:48.056121 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 10:58:48.056121 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 10:58:48.056121 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 10:58:48.056121 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 10:58:48.056121 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:48.056121 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 13 10:58:48.056121 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:48.056121 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 10:58:48.056121 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:48.056121 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:48.056121 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:48.056121 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:48.056121 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:48.056121 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:48.057118 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:48.057118 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:48.057118 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:48.057118 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:48.057118 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:48.057118 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:48.057118 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 10:58:48.057118 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 10:58:48.057118 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 10:58:48.057118 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 10:58:48.057118 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:48.057118 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:48.057118 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:48.057118 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:48.057118 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:48.057118 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:48.058005 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:48.058005 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:48.058005 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:48.058005 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:48.058005 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:48.058005 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:48.058005 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:48.058005 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:48.058005 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:48.058005 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:48.058005 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 10:58:48.058005 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:48.058005 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 13 10:58:48.058005 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:48.062116 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 383/762] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Oct 13 10:58:47 2022] GET /identity/v3/services/compute => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:48.063263 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d546f-32d4-43c5-8890-e0bbd17a605e None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:48.168199 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d546f-32d4-43c5-8890-e0bbd17a605e None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:48.203062 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e24e42b-b7a5-4786-9b9c-2a6d16412997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:48.203670 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24e42b-b7a5-4786-9b9c-2a6d16412997 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:48.203944 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24e42b-b7a5-4786-9b9c-2a6d16412997 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:48.204209 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24e42b-b7a5-4786-9b9c-2a6d16412997 None admin] PATH_INFO: `/v3/services` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:48.204834 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e24e42b-b7a5-4786-9b9c-2a6d16412997 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:48.205131 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e24e42b-b7a5-4786-9b9c-2a6d16412997 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:48.207025 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e24e42b-b7a5-4786-9b9c-2a6d16412997 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:48.216305 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 380/763] 10.222.0.25 () {56 vars in 1112 bytes} [Thu Oct 13 10:58:48 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:48.217508 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1bcc30-7413-44fe-8cba-de1351d8be30 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:48.243482 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:48.264845 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5385f7bc-6655-420e-9823-102178667472 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:48.265164 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5385f7bc-6655-420e-9823-102178667472 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:48.265399 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5385f7bc-6655-420e-9823-102178667472 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:48.266760 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 381/764] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:58:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:48.272199 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d45f0-6d27-48de-bf77-c0e075d4d13d None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:48.272482 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d45f0-6d27-48de-bf77-c0e075d4d13d None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:48.272760 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d45f0-6d27-48de-bf77-c0e075d4d13d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:48.290218 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-0e2d45f0-6d27-48de-bf77-c0e075d4d13d None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:48.291421 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-0e2d45f0-6d27-48de-bf77-c0e075d4d13d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:48.301528 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:48.324049 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1bcc30-7413-44fe-8cba-de1351d8be30 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:48.360643 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70acdd49-27c5-444f-9eac-99c00e6dc9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:48.361251 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70acdd49-27c5-444f-9eac-99c00e6dc9ad None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:48.361528 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70acdd49-27c5-444f-9eac-99c00e6dc9ad None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:48.361800 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70acdd49-27c5-444f-9eac-99c00e6dc9ad None admin] PATH_INFO: `/v3/services` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:48.363238 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70acdd49-27c5-444f-9eac-99c00e6dc9ad None admin] RBAC: Adding query filter params (type=compute) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:48.363529 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70acdd49-27c5-444f-9eac-99c00e6dc9ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:48.364895 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70acdd49-27c5-444f-9eac-99c00e6dc9ad None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:48.366426 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 382/765] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:48 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 13 10:58:48.369911 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 384/766] 10.222.0.25 () {56 vars in 1112 bytes} [Thu Oct 13 10:58:48 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:48.377986 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2d45f0-6d27-48de-bf77-c0e075d4d13d None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:48.478409 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2d45f0-6d27-48de-bf77-c0e075d4d13d None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:48.511335 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5f3c9d-f3b8-4ec9-818a-0ea265cde3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:48.511943 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f3c9d-f3b8-4ec9-818a-0ea265cde3d1 None admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:48.512219 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f3c9d-f3b8-4ec9-818a-0ea265cde3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:48.512488 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f3c9d-f3b8-4ec9-818a-0ea265cde3d1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:48.513163 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5f3c9d-f3b8-4ec9-818a-0ea265cde3d1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:48.514547 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5f3c9d-f3b8-4ec9-818a-0ea265cde3d1 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:48.529629 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:48.532851 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08283b08-1393-494e-99f1-112872cc2014 None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:48.533148 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08283b08-1393-494e-99f1-112872cc2014 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:48.533421 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08283b08-1393-494e-99f1-112872cc2014 None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:48.535613 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 385/767] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:58:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 10:58:48.540410 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d14ad-6020-400e-8840-d76eda313e49 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:48.540734 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d14ad-6020-400e-8840-d76eda313e49 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:48.541021 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d14ad-6020-400e-8840-d76eda313e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:48.542112 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 383/768] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 10:58:48 2022] POST /identity/v3/endpoints => generated 334 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 10:58:48.560986 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-982d14ad-6020-400e-8840-d76eda313e49 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:48.562256 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-982d14ad-6020-400e-8840-d76eda313e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:48.644416 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5f3c9d-f3b8-4ec9-818a-0ea265cde3d1 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:48.646713 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 386/769] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:48 2022] POST /identity/v3/auth/tokens => generated 1822 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 10:58:48.755777 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5f3c9d-f3b8-4ec9-818a-0ea265cde3d1 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:48.791186 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36569b43-4bac-4820-b325-bf49bb86cd78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:48.791938 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36569b43-4bac-4820-b325-bf49bb86cd78 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:48.792218 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36569b43-4bac-4820-b325-bf49bb86cd78 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:48.792490 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36569b43-4bac-4820-b325-bf49bb86cd78 None admin] PATH_INFO: `/v3/services/image` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:48.793112 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36569b43-4bac-4820-b325-bf49bb86cd78 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:48.794533 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36569b43-4bac-4820-b325-bf49bb86cd78 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:48.803522 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-36569b43-4bac-4820-b325-bf49bb86cd78 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 13 10:58:48.803522 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:48.803522 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 10:58:48.803522 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 10:58:48.803522 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 10:58:48.803522 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 10:58:48.803522 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 10:58:48.803522 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:48.803522 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 13 10:58:48.803522 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:48.803522 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 10:58:48.803522 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:48.803522 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:48.803522 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:48.803522 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:48.803522 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:48.803522 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:48.804540 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:48.804540 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:48.804540 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:48.804540 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:48.804540 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:48.804540 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:48.804540 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 10:58:48.804540 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 10:58:48.804540 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 10:58:48.804540 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 10:58:48.804540 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:48.804540 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:48.804540 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:48.804540 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:48.804540 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:48.804540 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:48.805380 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:48.805380 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:48.805380 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:48.805380 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:48.805380 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:48.805380 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:48.805380 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:48.805380 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:48.805380 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:48.805380 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:48.805380 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 10:58:48.805380 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:48.805380 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 13 10:58:48.805380 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:48.805380 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 384/770] 10.222.0.25 () {56 vars in 1105 bytes} [Thu Oct 13 10:58:48 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 10:58:48.810540 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982d14ad-6020-400e-8840-d76eda313e49 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:48.826238 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:48.914095 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36569b43-4bac-4820-b325-bf49bb86cd78 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:48.914551 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982d14ad-6020-400e-8840-d76eda313e49 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:48.951367 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eddb7a0-1c85-4fa0-869b-82c2151baf71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:48.952186 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eddb7a0-1c85-4fa0-869b-82c2151baf71 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:48.952617 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eddb7a0-1c85-4fa0-869b-82c2151baf71 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:48.952891 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eddb7a0-1c85-4fa0-869b-82c2151baf71 None admin] PATH_INFO: `/v3/services` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:48.953528 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eddb7a0-1c85-4fa0-869b-82c2151baf71 None admin] RBAC: Adding query filter params (name=image) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:48.953835 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eddb7a0-1c85-4fa0-869b-82c2151baf71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:48.955258 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eddb7a0-1c85-4fa0-869b-82c2151baf71 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:48.965405 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 387/771] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:48 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:48.966608 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eddb7a0-1c85-4fa0-869b-82c2151baf71 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:48.981103 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:49.023408 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36569b43-4bac-4820-b325-bf49bb86cd78 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:49.047913 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:49.060419 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a5743e-c65f-426c-96d1-4eea4d1fee5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:49.061049 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5743e-c65f-426c-96d1-4eea4d1fee5a None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:49.061326 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5743e-c65f-426c-96d1-4eea4d1fee5a None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:49.061598 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5743e-c65f-426c-96d1-4eea4d1fee5a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:49.062202 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a5743e-c65f-426c-96d1-4eea4d1fee5a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:49.063558 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a5743e-c65f-426c-96d1-4eea4d1fee5a None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:49.071960 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eddb7a0-1c85-4fa0-869b-82c2151baf71 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:49.073060 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-19a5743e-c65f-426c-96d1-4eea4d1fee5a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 13 10:58:49.073060 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:49.073060 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 10:58:49.073060 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 10:58:49.073060 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 10:58:49.073060 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 10:58:49.073060 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 10:58:49.073060 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:49.073060 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 13 10:58:49.073060 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:49.073060 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 10:58:49.073060 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:49.073060 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:49.073060 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:49.073060 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:49.073060 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:49.073060 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:49.074073 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:49.074073 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:49.074073 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:49.074073 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:49.074073 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:49.074073 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:49.074073 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 10:58:49.074073 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 10:58:49.074073 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 10:58:49.074073 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 10:58:49.074073 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:49.074073 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:49.074073 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:49.074073 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:49.074073 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:49.074073 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:49.074911 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:49.074911 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:49.074911 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:49.074911 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:49.074911 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:49.074911 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:49.074911 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:49.074911 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:49.074911 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:49.074911 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:49.074911 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 10:58:49.074911 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:49.074911 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 13 10:58:49.074911 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:49.074911 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 385/772] 10.222.0.25 () {56 vars in 1126 bytes} [Thu Oct 13 10:58:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 10:58:49.079961 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a5743e-c65f-426c-96d1-4eea4d1fee5a None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:49.110381 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea8cc20-26ce-451c-a34e-67f83925c511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:49.110967 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea8cc20-26ce-451c-a34e-67f83925c511 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:49.111243 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea8cc20-26ce-451c-a34e-67f83925c511 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:49.111694 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea8cc20-26ce-451c-a34e-67f83925c511 None admin] PATH_INFO: `/v3/services` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:49.112667 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea8cc20-26ce-451c-a34e-67f83925c511 None admin] RBAC: Adding query filter params (type=image) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:49.112969 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea8cc20-26ce-451c-a34e-67f83925c511 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:49.114324 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea8cc20-26ce-451c-a34e-67f83925c511 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:49.119535 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 388/773] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:48 2022] GET /identity/v3/services?type=image => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:49.124972 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea8cc20-26ce-451c-a34e-67f83925c511 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:49.187527 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a5743e-c65f-426c-96d1-4eea4d1fee5a None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:49.213428 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:49.221725 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ca5d10-2ab0-4ba6-9a1b-052aec3fa682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:49.222361 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca5d10-2ab0-4ba6-9a1b-052aec3fa682 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:49.222639 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca5d10-2ab0-4ba6-9a1b-052aec3fa682 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:49.222916 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca5d10-2ab0-4ba6-9a1b-052aec3fa682 None admin] PATH_INFO: `/v3/services` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:49.223551 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ca5d10-2ab0-4ba6-9a1b-052aec3fa682 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:49.223854 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ca5d10-2ab0-4ba6-9a1b-052aec3fa682 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:49.225205 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ca5d10-2ab0-4ba6-9a1b-052aec3fa682 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:49.230212 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 386/774] 10.222.0.25 () {56 vars in 1122 bytes} [Thu Oct 13 10:58:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:58:49.235721 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ca5d10-2ab0-4ba6-9a1b-052aec3fa682 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:49.236566 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea8cc20-26ce-451c-a34e-67f83925c511 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:49.272359 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceae67fa-7ace-492b-ac0a-2860a3e821d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:49.272964 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae67fa-7ace-492b-ac0a-2860a3e821d7 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:49.273242 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae67fa-7ace-492b-ac0a-2860a3e821d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:49.273564 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae67fa-7ace-492b-ac0a-2860a3e821d7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:49.274238 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceae67fa-7ace-492b-ac0a-2860a3e821d7 None admin] RBAC: Adding query filter params (interface=public, service_id=cd1059f06e0e4affafa5bb5286d794cd, region_id=RegionOne) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:49.274546 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceae67fa-7ace-492b-ac0a-2860a3e821d7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:49.275898 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceae67fa-7ace-492b-ac0a-2860a3e821d7 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:49.280884 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 389/775] 10.222.0.25 () {56 vars in 1251 bytes} [Thu Oct 13 10:58:49 2022] GET /identity/v3/endpoints?service_id=cd1059f06e0e4affafa5bb5286d794cd&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:58:49.287066 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceae67fa-7ace-492b-ac0a-2860a3e821d7 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:49.290701 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:49.348336 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ca5d10-2ab0-4ba6-9a1b-052aec3fa682 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:49.388903 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a94917-5d35-48bd-895d-8579fa96ced2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:49.389778 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a94917-5d35-48bd-895d-8579fa96ced2 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:49.390089 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a94917-5d35-48bd-895d-8579fa96ced2 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:49.390366 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a94917-5d35-48bd-895d-8579fa96ced2 None admin] PATH_INFO: `/v3/services` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:49.390997 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a94917-5d35-48bd-895d-8579fa96ced2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:49.391168 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceae67fa-7ace-492b-ac0a-2860a3e821d7 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:49.391325 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a94917-5d35-48bd-895d-8579fa96ced2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:49.392913 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a94917-5d35-48bd-895d-8579fa96ced2 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:49.398655 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 387/776] 10.222.0.25 () {56 vars in 1122 bytes} [Thu Oct 13 10:58:49 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:58:49.404448 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a94917-5d35-48bd-895d-8579fa96ced2 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:49.426436 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665bb599-222d-49f0-87b2-b1aac55e4144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:49.427044 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665bb599-222d-49f0-87b2-b1aac55e4144 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:49.427324 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665bb599-222d-49f0-87b2-b1aac55e4144 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:49.427599 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665bb599-222d-49f0-87b2-b1aac55e4144 None admin] PATH_INFO: `/v3/services` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:49.428318 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665bb599-222d-49f0-87b2-b1aac55e4144 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:49.429694 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665bb599-222d-49f0-87b2-b1aac55e4144 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:49.436793 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 390/777] 10.222.0.25 () {56 vars in 1087 bytes} [Thu Oct 13 10:58:49 2022] GET /identity/v3/services => generated 1957 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 13 10:58:49.470098 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:49.523807 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a94917-5d35-48bd-895d-8579fa96ced2 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:49.559403 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e726d5ae-3626-4844-821a-3717d33191d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:49.560034 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726d5ae-3626-4844-821a-3717d33191d2 None admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:49.560317 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726d5ae-3626-4844-821a-3717d33191d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:49.560595 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726d5ae-3626-4844-821a-3717d33191d2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:49.561276 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e726d5ae-3626-4844-821a-3717d33191d2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:49.562691 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e726d5ae-3626-4844-821a-3717d33191d2 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:49.585984 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 388/778] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 10:58:49 2022] POST /identity/v3/endpoints => generated 325 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 10:58:50.765517 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2decc-8c48-42d7-875c-a05f69e55acd None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:50.766103 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2decc-8c48-42d7-875c-a05f69e55acd None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:50.766103 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2decc-8c48-42d7-875c-a05f69e55acd None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:50.767552 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 391/779] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:58:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:50.772497 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f269e-a382-4f50-8d89-08fd92f06d60 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:50.772916 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f269e-a382-4f50-8d89-08fd92f06d60 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:50.773111 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f269e-a382-4f50-8d89-08fd92f06d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:50.791736 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-333f269e-a382-4f50-8d89-08fd92f06d60 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:50.792931 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-333f269e-a382-4f50-8d89-08fd92f06d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:50.867851 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 389/780] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:50 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 13 10:58:51.132606 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c2decc-8c48-42d7-875c-a05f69e55acd None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:51.202724 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:51.239683 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c2decc-8c48-42d7-875c-a05f69e55acd None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:51.273172 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d724c4a-0296-4b58-8d7f-1c22fc26d5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:51.273803 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d724c4a-0296-4b58-8d7f-1c22fc26d5e7 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:51.274103 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d724c4a-0296-4b58-8d7f-1c22fc26d5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:51.274372 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d724c4a-0296-4b58-8d7f-1c22fc26d5e7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:51.284872 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d724c4a-0296-4b58-8d7f-1c22fc26d5e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:58:51.289619 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-5d724c4a-0296-4b58-8d7f-1c22fc26d5e7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 13 10:58:51.289619 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:51.289619 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:51.289619 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:51.289619 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:51.289619 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:51.289619 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:51.289619 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:51.289619 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:51.289619 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:51.289619 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:51.289619 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:51.289619 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:58:51.289619 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:58:51.289619 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:58:51.289619 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:58:51.290738 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:58:51.290738 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:58:51.290738 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:58:51.290738 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:58:51.290738 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:51.290738 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:51.290738 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:51.290738 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:51.290738 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:51.290738 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:51.290738 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:51.290738 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:51.290738 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:51.290738 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:51.290738 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:51.290738 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:51.291743 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:51.291743 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:51.291743 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:51.291743 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:51.291743 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:58:51.291743 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:58:51.291743 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:58:51.291743 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:58:51.291743 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:58:51.291743 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:58:51.291743 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 13 10:58:51.291743 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:51.294263 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 392/781] 10.222.0.25 () {56 vars in 1120 bytes} [Thu Oct 13 10:58:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:51.296596 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f269e-a382-4f50-8d89-08fd92f06d60 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:51.338918 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:51.396904 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f269e-a382-4f50-8d89-08fd92f06d60 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:51.429827 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8d1f6e-0e00-4c80-aae9-92089fbd093a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:51.430456 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d1f6e-0e00-4c80-aae9-92089fbd093a None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:51.430730 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d1f6e-0e00-4c80-aae9-92089fbd093a None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:51.430998 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d1f6e-0e00-4c80-aae9-92089fbd093a None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:51.431649 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8d1f6e-0e00-4c80-aae9-92089fbd093a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:51.431950 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8d1f6e-0e00-4c80-aae9-92089fbd093a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:51.433302 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8d1f6e-0e00-4c80-aae9-92089fbd093a None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:51.441424 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 390/782] 10.222.0.25 () {56 vars in 1115 bytes} [Thu Oct 13 10:58:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:51.446886 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d724c4a-0296-4b58-8d7f-1c22fc26d5e7 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:51.552734 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d724c4a-0296-4b58-8d7f-1c22fc26d5e7 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:51.578897 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:51.588343 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca8cd2-2170-41be-bc50-bab24b35544e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:51.588966 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca8cd2-2170-41be-bc50-bab24b35544e None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:51.589241 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca8cd2-2170-41be-bc50-bab24b35544e None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:51.589509 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca8cd2-2170-41be-bc50-bab24b35544e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:51.600324 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffca8cd2-2170-41be-bc50-bab24b35544e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:51.601795 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffca8cd2-2170-41be-bc50-bab24b35544e None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:51.602663 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafae4ce-8c65-4b2a-b2ad-614fb0b127e1 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:51.602956 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafae4ce-8c65-4b2a-b2ad-614fb0b127e1 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:51.603236 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafae4ce-8c65-4b2a-b2ad-614fb0b127e1 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:51.604829 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 391/783] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:58:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 10:58:51.610638 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f1c08-e10c-485b-a453-9198078c6201 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:51.610923 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f1c08-e10c-485b-a453-9198078c6201 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:51.611205 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f1c08-e10c-485b-a453-9198078c6201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:51.620255 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-ffca8cd2-2170-41be-bc50-bab24b35544e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:51.620255 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:51.620255 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:51.620255 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:51.620255 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:51.620255 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:51.620255 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:51.620255 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:51.620255 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:51.620255 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:51.620255 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:51.620255 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:51.620255 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:51.620255 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:51.620255 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:51.620255 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:51.621299 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:51.621299 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:51.621299 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:51.621299 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:51.621299 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:51.621299 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:51.621299 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:51.621299 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:51.621299 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:51.621299 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:51.621299 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:51.621299 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:51.621299 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:51.621299 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:51.621299 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:51.621299 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:51.621299 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:51.622241 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:51.622241 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:51.622241 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:51.624786 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 393/784] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:51.628021 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca8cd2-2170-41be-bc50-bab24b35544e None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:51.631843 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-854f1c08-e10c-485b-a453-9198078c6201 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:51.633076 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-854f1c08-e10c-485b-a453-9198078c6201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:51.709601 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 392/785] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:51 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 13 10:58:51.726832 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bec8b1-a748-4404-aff1-854f31e81234 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:51.727118 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bec8b1-a748-4404-aff1-854f31e81234 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:51.727399 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bec8b1-a748-4404-aff1-854f31e81234 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:51.728711 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 393/786] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:58:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 10:58:51.733597 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685eadc-d5d4-4a00-80ce-19fc997499f7 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:51.733883 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685eadc-d5d4-4a00-80ce-19fc997499f7 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:51.734207 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685eadc-d5d4-4a00-80ce-19fc997499f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:51.736185 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca8cd2-2170-41be-bc50-bab24b35544e None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:51.753217 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-8685eadc-d5d4-4a00-80ce-19fc997499f7 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:51.754436 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-8685eadc-d5d4-4a00-80ce-19fc997499f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:51.777712 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1c3dc3-e9d2-4186-9630-cb95711e2585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:51.778655 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c3dc3-e9d2-4186-9630-cb95711e2585 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:51.778941 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c3dc3-e9d2-4186-9630-cb95711e2585 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:51.779220 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c3dc3-e9d2-4186-9630-cb95711e2585 None admin] PATH_INFO: `/v3/domains` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:51.779872 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1c3dc3-e9d2-4186-9630-cb95711e2585 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:51.780185 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1c3dc3-e9d2-4186-9630-cb95711e2585 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:51.781609 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1c3dc3-e9d2-4186-9630-cb95711e2585 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:51.781736 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:51.798679 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 394/787] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:58:51.799805 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1c3dc3-e9d2-4186-9630-cb95711e2585 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:51.823590 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 394/788] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:51 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 13 10:58:51.852926 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:51.915156 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1c3dc3-e9d2-4186-9630-cb95711e2585 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:51.950821 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93985992-1742-48a8-a740-b855c6fd9106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:51.951461 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93985992-1742-48a8-a740-b855c6fd9106 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:51.951748 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93985992-1742-48a8-a740-b855c6fd9106 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:51.952022 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93985992-1742-48a8-a740-b855c6fd9106 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:51.959023 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93985992-1742-48a8-a740-b855c6fd9106 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:51.960509 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93985992-1742-48a8-a740-b855c6fd9106 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:51.971928 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-93985992-1742-48a8-a740-b855c6fd9106 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 13 10:58:51.971928 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:51.971928 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:51.971928 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:51.971928 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:51.971928 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:51.971928 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:51.971928 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:51.971928 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:51.971928 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:51.971928 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:51.971928 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:51.971928 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 10:58:51.971928 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 10:58:51.971928 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 10:58:51.971928 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 10:58:51.972875 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:51.972875 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:51.972875 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 10:58:51.972875 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:51.972875 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 10:58:51.972875 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:51.972875 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:51.972875 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:51.972875 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:51.972875 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:51.972875 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:51.972875 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:51.972875 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:51.972875 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:51.972875 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:51.972875 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:51.972875 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:51.972875 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:51.973821 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:51.973821 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:51.973821 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 10:58:51.973821 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 10:58:51.973821 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 10:58:51.973821 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 10:58:51.973821 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 10:58:51.973821 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 10:58:51.973821 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 13 10:58:51.973821 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:51.977829 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 395/789] 10.222.0.25 () {56 vars in 1093 bytes} [Thu Oct 13 10:58:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:51.979101 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685eadc-d5d4-4a00-80ce-19fc997499f7 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:51.986461 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93985992-1742-48a8-a740-b855c6fd9106 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:52.085340 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:52.088761 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93985992-1742-48a8-a740-b855c6fd9106 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:52.090615 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685eadc-d5d4-4a00-80ce-19fc997499f7 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:52.124146 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c39fc3f-cda4-486b-afe7-fdd8043fe149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:52.124736 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36f507d-4293-41bd-a82c-cfbd899d6b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:52.124860 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39fc3f-cda4-486b-afe7-fdd8043fe149 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:52.125043 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39fc3f-cda4-486b-afe7-fdd8043fe149 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:52.125314 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39fc3f-cda4-486b-afe7-fdd8043fe149 None admin] PATH_INFO: `/v3/services/image` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:52.125414 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f507d-4293-41bd-a82c-cfbd899d6b00 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:52.125599 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f507d-4293-41bd-a82c-cfbd899d6b00 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:52.125871 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f507d-4293-41bd-a82c-cfbd899d6b00 None admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:52.126003 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c39fc3f-cda4-486b-afe7-fdd8043fe149 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:52.126627 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36f507d-4293-41bd-a82c-cfbd899d6b00 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:52.126930 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36f507d-4293-41bd-a82c-cfbd899d6b00 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:52.127253 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c39fc3f-cda4-486b-afe7-fdd8043fe149 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:52.129037 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36f507d-4293-41bd-a82c-cfbd899d6b00 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:52.136473 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-3c39fc3f-cda4-486b-afe7-fdd8043fe149 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 13 10:58:52.136473 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:52.136473 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 10:58:52.136473 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 10:58:52.136473 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 10:58:52.136473 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 10:58:52.136473 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 10:58:52.136473 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:52.136473 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 13 10:58:52.136473 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:52.136473 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 10:58:52.136473 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:52.136473 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:52.136473 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:52.136473 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:52.136473 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:52.136473 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:52.137651 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:52.137651 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:52.137651 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:52.137651 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:52.137651 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:52.137651 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:52.137651 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 10:58:52.137651 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 10:58:52.137651 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 10:58:52.137651 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 10:58:52.137651 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:52.137651 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:52.137651 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:52.137651 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:52.137651 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:52.137651 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:52.138737 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:52.138737 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:52.138737 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:52.138737 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:52.138737 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:52.138737 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:52.138737 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:52.138737 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:52.138737 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:52.138737 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:52.138737 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 10:58:52.138737 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:52.138737 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 13 10:58:52.138737 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:52.138737 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 396/790] 10.222.0.25 () {56 vars in 1105 bytes} [Thu Oct 13 10:58:51 2022] GET /identity/v3/services/image => generated 86 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 10:58:52.139717 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c39fc3f-cda4-486b-afe7-fdd8043fe149 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:52.154526 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 395/791] 10.222.0.25 () {56 vars in 1133 bytes} [Thu Oct 13 10:58:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:52.154526 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36f507d-4293-41bd-a82c-cfbd899d6b00 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:52.173531 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:52.235979 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c39fc3f-cda4-486b-afe7-fdd8043fe149 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:52.245680 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36f507d-4293-41bd-a82c-cfbd899d6b00 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:52.269277 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082537b2-20f7-43f9-913d-22c7108ccde5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:52.269901 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082537b2-20f7-43f9-913d-22c7108ccde5 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:52.270206 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082537b2-20f7-43f9-913d-22c7108ccde5 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:52.270482 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082537b2-20f7-43f9-913d-22c7108ccde5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:52.271591 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082537b2-20f7-43f9-913d-22c7108ccde5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:52.273013 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082537b2-20f7-43f9-913d-22c7108ccde5 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:52.274609 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 397/792] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:52.275361 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082537b2-20f7-43f9-913d-22c7108ccde5 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:52.282011 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852be10f-7431-40bc-b1d7-b3456746c630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:52.282617 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852be10f-7431-40bc-b1d7-b3456746c630 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:52.282892 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852be10f-7431-40bc-b1d7-b3456746c630 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:52.283163 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852be10f-7431-40bc-b1d7-b3456746c630 None admin] PATH_INFO: `/v3/services` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:52.284292 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852be10f-7431-40bc-b1d7-b3456746c630 None admin] RBAC: Adding query filter params (name=image) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:52.284591 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852be10f-7431-40bc-b1d7-b3456746c630 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:52.285922 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852be10f-7431-40bc-b1d7-b3456746c630 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:52.290997 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 396/793] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:52 2022] GET /identity/v3/services?name=image => generated 122 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:52.291667 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852be10f-7431-40bc-b1d7-b3456746c630 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:52.310671 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:52.373454 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:52.378377 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082537b2-20f7-43f9-913d-22c7108ccde5 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:52.388457 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852be10f-7431-40bc-b1d7-b3456746c630 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:52.411584 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33651a48-20f9-4eeb-a5ef-e668f9a9b724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:52.412311 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33651a48-20f9-4eeb-a5ef-e668f9a9b724 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:52.412664 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33651a48-20f9-4eeb-a5ef-e668f9a9b724 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:52.412941 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33651a48-20f9-4eeb-a5ef-e668f9a9b724 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:52.422054 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f7ff32-1d6b-412b-b509-0b3966975b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:52.422647 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f7ff32-1d6b-412b-b509-0b3966975b10 None admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:52.422924 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f7ff32-1d6b-412b-b509-0b3966975b10 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:52.423195 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f7ff32-1d6b-412b-b509-0b3966975b10 None admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:52.423284 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33651a48-20f9-4eeb-a5ef-e668f9a9b724 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:52.423835 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f7ff32-1d6b-412b-b509-0b3966975b10 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:52.425181 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33651a48-20f9-4eeb-a5ef-e668f9a9b724 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:52.425813 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f7ff32-1d6b-412b-b509-0b3966975b10 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:52.439140 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-33651a48-20f9-4eeb-a5ef-e668f9a9b724 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:52.439140 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:52.439140 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:52.439140 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:52.439140 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:52.439140 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:52.439140 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:52.439140 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:52.439140 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:52.439140 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:52.439140 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:52.439140 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:52.439140 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:52.439140 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:52.439140 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:52.439140 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:52.440310 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:52.440310 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:52.440310 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:52.440310 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:52.440310 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:52.440310 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:52.440310 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:52.440310 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:52.440310 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:52.440310 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:52.440310 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:52.440310 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:52.440310 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:52.440310 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:52.440310 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:52.440310 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:52.440310 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:52.441419 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:52.441419 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:52.441419 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:52.441419 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 398/794] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:52.441419 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33651a48-20f9-4eeb-a5ef-e668f9a9b724 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:52.469970 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 397/795] 10.222.0.25 () {60 vars in 1141 bytes} [Thu Oct 13 10:58:52 2022] POST /identity/v3/projects => generated 311 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 10:58:52.469970 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f7ff32-1d6b-412b-b509-0b3966975b10 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:52.538393 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:52.558445 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33651a48-20f9-4eeb-a5ef-e668f9a9b724 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:52.586304 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f7ff32-1d6b-412b-b509-0b3966975b10 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:52.595131 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a27205c-5727-4948-ac98-7033cd7b2536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:52.595898 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27205c-5727-4948-ac98-7033cd7b2536 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:52.596837 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27205c-5727-4948-ac98-7033cd7b2536 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:52.597227 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27205c-5727-4948-ac98-7033cd7b2536 None admin] PATH_INFO: `/v3/services` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:52.597934 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a27205c-5727-4948-ac98-7033cd7b2536 None admin] RBAC: Adding query filter params (type=image) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:52.598357 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a27205c-5727-4948-ac98-7033cd7b2536 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:52.599853 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a27205c-5727-4948-ac98-7033cd7b2536 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:52.609975 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 399/796] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:52 2022] GET /identity/v3/services?type=image => generated 350 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:52.611206 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a27205c-5727-4948-ac98-7033cd7b2536 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:52.633168 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa46dacd-5f05-4642-835b-8a42c2526f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:52.634103 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa46dacd-5f05-4642-835b-8a42c2526f38 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:52.634557 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa46dacd-5f05-4642-835b-8a42c2526f38 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:52.634835 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa46dacd-5f05-4642-835b-8a42c2526f38 None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:52.635506 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa46dacd-5f05-4642-835b-8a42c2526f38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:52.636037 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa46dacd-5f05-4642-835b-8a42c2526f38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:52.638048 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa46dacd-5f05-4642-835b-8a42c2526f38 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:52.646197 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:52.657784 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 398/797] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:52.658779 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa46dacd-5f05-4642-835b-8a42c2526f38 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:52.726564 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a27205c-5727-4948-ac98-7033cd7b2536 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:52.763197 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8188545f-2e98-4f0e-b73f-dedd94ca8b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:52.763891 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188545f-2e98-4f0e-b73f-dedd94ca8b87 None admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:52.764235 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188545f-2e98-4f0e-b73f-dedd94ca8b87 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:52.764570 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188545f-2e98-4f0e-b73f-dedd94ca8b87 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:52.765305 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8188545f-2e98-4f0e-b73f-dedd94ca8b87 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:52.766763 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8188545f-2e98-4f0e-b73f-dedd94ca8b87 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:52.771946 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa46dacd-5f05-4642-835b-8a42c2526f38 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:52.786503 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 400/798] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 10:58:52 2022] POST /identity/v3/endpoints => generated 327 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 10:58:52.827415 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fcd62e-8ea4-4243-b5d0-960f86197365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:52.828077 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fcd62e-8ea4-4243-b5d0-960f86197365 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:52.828261 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fcd62e-8ea4-4243-b5d0-960f86197365 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:52.828527 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fcd62e-8ea4-4243-b5d0-960f86197365 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:52.836216 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fcd62e-8ea4-4243-b5d0-960f86197365 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:52.837701 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fcd62e-8ea4-4243-b5d0-960f86197365 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:52.850349 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-e8fcd62e-8ea4-4243-b5d0-960f86197365 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:58:52.850349 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:52.850349 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:52.850349 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:52.850349 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:52.850349 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:52.850349 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:52.850349 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:52.850349 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:52.850349 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:52.850349 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:52.850349 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:52.850349 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 10:58:52.850349 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 10:58:52.850349 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 10:58:52.851293 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 10:58:52.851293 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:52.851293 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:52.851293 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:52.851293 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:52.851293 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:52.851293 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:52.851293 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:52.851293 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:52.851293 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:52.851293 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:52.851293 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:52.851293 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:52.851293 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:52.851293 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:52.851293 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:52.851293 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:52.857395 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 10:58:52.857395 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 10:58:52.857395 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 10:58:52.857395 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 10:58:52.857395 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 10:58:52.857395 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 10:58:52.857395 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:58:52.857395 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:52.857395 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 399/799] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Oct 13 10:58:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:52.859223 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8188545f-2e98-4f0e-b73f-dedd94ca8b87 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:52.865041 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:52.974058 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8188545f-2e98-4f0e-b73f-dedd94ca8b87 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:53.011202 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816acef7-5afb-4007-aecf-a881a533eb6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:53.011810 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816acef7-5afb-4007-aecf-a881a533eb6d None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:53.012089 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816acef7-5afb-4007-aecf-a881a533eb6d None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:53.012358 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816acef7-5afb-4007-aecf-a881a533eb6d None admin] PATH_INFO: `/v3/projects` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:53.013046 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816acef7-5afb-4007-aecf-a881a533eb6d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:53.013346 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816acef7-5afb-4007-aecf-a881a533eb6d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:53.014792 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816acef7-5afb-4007-aecf-a881a533eb6d None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:53.027866 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 401/800] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Oct 13 10:58:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:53.035172 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fcd62e-8ea4-4243-b5d0-960f86197365 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:53.092074 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:53.138210 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fcd62e-8ea4-4243-b5d0-960f86197365 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:53.172500 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295af154-b0d6-4d0e-bdb7-0adff32fbc04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:53.173213 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295af154-b0d6-4d0e-bdb7-0adff32fbc04 None admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:53.173492 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295af154-b0d6-4d0e-bdb7-0adff32fbc04 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:53.173820 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295af154-b0d6-4d0e-bdb7-0adff32fbc04 None admin] PATH_INFO: `/v3/projects/85bfac5f03e24fb3870a59a6b52dba6e/users/78384fbffdd346578855e7214b335d8e/roles/fba8d2d3d7964167b2f43a7eb6f5e8b7` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:53.176047 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295af154-b0d6-4d0e-bdb7-0adff32fbc04 None admin] RBAC: Authorizing `identity:create_grant(project_id=85bfac5f03e24fb3870a59a6b52dba6e, user_id=78384fbffdd346578855e7214b335d8e, role_id=fba8d2d3d7964167b2f43a7eb6f5e8b7)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:53.177476 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295af154-b0d6-4d0e-bdb7-0adff32fbc04 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:53.192481 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 400/801] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Oct 13 10:58:53 2022] PUT /identity/v3/projects/85bfac5f03e24fb3870a59a6b52dba6e/users/78384fbffdd346578855e7214b335d8e/roles/fba8d2d3d7964167b2f43a7eb6f5e8b7 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 10:58:54.647886 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38172c7f-cace-4252-9dde-9681300988cd None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:54.648418 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38172c7f-cace-4252-9dde-9681300988cd None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:54.648418 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38172c7f-cace-4252-9dde-9681300988cd None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:54.649774 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 402/802] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:58:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:54.654968 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c053bb-c57f-4c3b-be25-688755aa4fe9 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:54.655765 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c053bb-c57f-4c3b-be25-688755aa4fe9 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:54.656241 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c053bb-c57f-4c3b-be25-688755aa4fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:54.675706 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-75c053bb-c57f-4c3b-be25-688755aa4fe9 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:54.677222 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-75c053bb-c57f-4c3b-be25-688755aa4fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:54.745934 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 401/803] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 10:58:54.977177 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e9d2b-ae4a-4bb2-9466-bb4cf11132fd None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:54.977503 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e9d2b-ae4a-4bb2-9466-bb4cf11132fd None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:54.977721 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e9d2b-ae4a-4bb2-9466-bb4cf11132fd None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:54.979194 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 403/804] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:58:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:54.984247 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde34df2-50a2-4afc-845c-d3517fa630ea None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:54.984534 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde34df2-50a2-4afc-845c-d3517fa630ea None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:54.984811 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde34df2-50a2-4afc-845c-d3517fa630ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:55.003005 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-cde34df2-50a2-4afc-845c-d3517fa630ea None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:55.004172 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-cde34df2-50a2-4afc-845c-d3517fa630ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:55.012688 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1e9d2b-ae4a-4bb2-9466-bb4cf11132fd None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:55.047308 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:55.077563 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 402/805] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 10:58:55.083330 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:55.123478 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1e9d2b-ae4a-4bb2-9466-bb4cf11132fd None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:55.157712 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fbe7fc-5f65-45df-b3d4-925c51dbad6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:55.158367 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fbe7fc-5f65-45df-b3d4-925c51dbad6d None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:55.158699 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fbe7fc-5f65-45df-b3d4-925c51dbad6d None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:55.159470 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fbe7fc-5f65-45df-b3d4-925c51dbad6d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:55.160589 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fbe7fc-5f65-45df-b3d4-925c51dbad6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:55.162040 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fbe7fc-5f65-45df-b3d4-925c51dbad6d None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:55.163821 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 404/806] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:55.169358 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde34df2-50a2-4afc-845c-d3517fa630ea None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:55.272265 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde34df2-50a2-4afc-845c-d3517fa630ea None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:55.308766 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbcd00f-a8d2-450b-b8c4-ff2af1b6cdcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:55.309374 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbcd00f-a8d2-450b-b8c4-ff2af1b6cdcb None admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:55.309654 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbcd00f-a8d2-450b-b8c4-ff2af1b6cdcb None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:55.309929 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbcd00f-a8d2-450b-b8c4-ff2af1b6cdcb None admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:55.310617 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbcd00f-a8d2-450b-b8c4-ff2af1b6cdcb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:55.312053 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbcd00f-a8d2-450b-b8c4-ff2af1b6cdcb None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:55.322807 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be0621-3854-42ab-a9f6-9f75af20b432 None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:55.323092 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be0621-3854-42ab-a9f6-9f75af20b432 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:55.323362 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be0621-3854-42ab-a9f6-9f75af20b432 None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:55.324769 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 405/807] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:58:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:55.331646 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5bce66-1c3a-47c8-8640-3faed5b00ee0 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:55.331933 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5bce66-1c3a-47c8-8640-3faed5b00ee0 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:55.332209 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5bce66-1c3a-47c8-8640-3faed5b00ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:55.336715 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 403/808] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Oct 13 10:58:55 2022] POST /identity/v3/users => generated 285 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 10:58:55.355435 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-ef5bce66-1c3a-47c8-8640-3faed5b00ee0 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:55.355637 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbcd00f-a8d2-450b-b8c4-ff2af1b6cdcb None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:55.356685 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-ef5bce66-1c3a-47c8-8640-3faed5b00ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:55.392866 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:55.432255 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 406/809] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 13 10:58:55.481476 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbcd00f-a8d2-450b-b8c4-ff2af1b6cdcb None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:55.522568 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a0aa72-c931-4031-9024-da969b540c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:55.523279 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a0aa72-c931-4031-9024-da969b540c28 None admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:55.523670 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a0aa72-c931-4031-9024-da969b540c28 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:55.524002 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a0aa72-c931-4031-9024-da969b540c28 None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:55.524731 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a0aa72-c931-4031-9024-da969b540c28 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:55.526112 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a0aa72-c931-4031-9024-da969b540c28 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:55.535232 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.sql.core [None req-53a0aa72-c931-4031-9024-da969b540c28 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 13 10:58:55.535232 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 13 10:58:55.535232 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [parameters: {'id': '22bffa94792944bc92f7a28142de69a8', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 13 10:58:55.535232 dv-cinder-861001-1-smb devstack@keystone.service[81550]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81550) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 13 10:58:55.542962 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-53a0aa72-c931-4031-9024-da969b540c28 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 13 10:58:55.542962 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:55.542962 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 13 10:58:55.542962 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 13 10:58:55.542962 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 13 10:58:55.542962 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 13 10:58:55.542962 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 13 10:58:55.542962 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application result = self._query(query) Oct 13 10:58:55.542962 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 13 10:58:55.542962 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application conn.query(q) Oct 13 10:58:55.542962 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 13 10:58:55.542962 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 13 10:58:55.542962 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 13 10:58:55.542962 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application result.read() Oct 13 10:58:55.543779 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 13 10:58:55.543779 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 13 10:58:55.543779 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 13 10:58:55.543779 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 13 10:58:55.543779 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 13 10:58:55.543779 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 13 10:58:55.543779 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 13 10:58:55.543779 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 13 10:58:55.543779 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 13 10:58:55.543779 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:55.543779 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 13 10:58:55.543779 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:55.543779 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:55.543779 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 13 10:58:55.543779 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 13 10:58:55.543779 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 13 10:58:55.543779 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 13 10:58:55.543779 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 13 10:58:55.544683 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application next(self.gen) Oct 13 10:58:55.544683 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 13 10:58:55.544683 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application yield resource Oct 13 10:58:55.544683 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 13 10:58:55.544683 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application next(self.gen) Oct 13 10:58:55.544683 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 13 10:58:55.544683 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self.session.rollback() Oct 13 10:58:55.544683 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 13 10:58:55.544683 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self.force_reraise() Oct 13 10:58:55.544683 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 13 10:58:55.544683 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise self.value Oct 13 10:58:55.544683 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 13 10:58:55.544683 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 13 10:58:55.544683 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 13 10:58:55.544683 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application session.commit() Oct 13 10:58:55.544683 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 13 10:58:55.544683 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 13 10:58:55.545553 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 13 10:58:55.545553 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self._prepare_impl() Oct 13 10:58:55.545553 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 13 10:58:55.545553 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self.session.flush() Oct 13 10:58:55.545553 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 13 10:58:55.545553 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self._flush(objects) Oct 13 10:58:55.545553 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 13 10:58:55.545553 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 13 10:58:55.545553 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 13 10:58:55.545553 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application compat.raise_( Oct 13 10:58:55.545553 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 13 10:58:55.545553 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception Oct 13 10:58:55.545553 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 13 10:58:55.545553 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application flush_context.execute() Oct 13 10:58:55.545553 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 13 10:58:55.545553 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rec.execute(self) Oct 13 10:58:55.545553 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 13 10:58:55.547062 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 13 10:58:55.547062 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 13 10:58:55.547062 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 13 10:58:55.547062 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 13 10:58:55.547062 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 13 10:58:55.547062 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 13 10:58:55.547062 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 13 10:58:55.547062 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 13 10:58:55.547062 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 13 10:58:55.547062 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 13 10:58:55.547062 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 13 10:58:55.547062 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 13 10:58:55.547062 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 13 10:58:55.547062 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 13 10:58:55.547062 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 13 10:58:55.547820 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 13 10:58:55.547820 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception Oct 13 10:58:55.547820 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 13 10:58:55.547820 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 13 10:58:55.547820 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 13 10:58:55.547820 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 13 10:58:55.547820 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 13 10:58:55.547820 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application result = self._query(query) Oct 13 10:58:55.547820 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 13 10:58:55.547820 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application conn.query(q) Oct 13 10:58:55.547820 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 13 10:58:55.547820 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 13 10:58:55.547820 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 13 10:58:55.547820 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application result.read() Oct 13 10:58:55.547820 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 13 10:58:55.547820 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 13 10:58:55.547820 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 13 10:58:55.548682 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 13 10:58:55.548682 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 13 10:58:55.548682 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 13 10:58:55.548682 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 13 10:58:55.548682 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 13 10:58:55.548682 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 13 10:58:55.548682 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 13 10:58:55.548682 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [parameters: {'id': '22bffa94792944bc92f7a28142de69a8', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 13 10:58:55.548682 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 13 10:58:55.548682 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:55.548682 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 10:58:55.548682 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:55.548682 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:55.548682 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 13 10:58:55.548682 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 13 10:58:55.549517 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 13 10:58:55.549517 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 13 10:58:55.549517 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 13 10:58:55.549517 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:55.549517 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 10:58:55.549517 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:55.549517 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:55.549517 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:55.549517 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:55.549517 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:55.549517 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:55.549517 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:55.549517 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:55.549517 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:55.549517 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:55.549517 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:55.549517 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:55.550519 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 13 10:58:55.550519 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 13 10:58:55.550519 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:55.550519 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:55.550519 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 13 10:58:55.550519 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 13 10:58:55.550519 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:55.550519 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:55.550519 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 13 10:58:55.550519 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 13 10:58:55.550519 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 13 10:58:55.550519 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:55.550519 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 404/810] 10.222.0.25 () {60 vars in 1137 bytes} [Thu Oct 13 10:58:55 2022] POST /identity/v3/domains => generated 190 bytes in 189 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 13 10:58:55.552478 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5bce66-1c3a-47c8-8640-3faed5b00ee0 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:55.618033 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:55.657836 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5bce66-1c3a-47c8-8640-3faed5b00ee0 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:55.692176 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2f0f7a-d676-40ad-a1c1-dfea934e03d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:55.692804 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2f0f7a-d676-40ad-a1c1-dfea934e03d2 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:55.693084 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2f0f7a-d676-40ad-a1c1-dfea934e03d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:55.693358 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2f0f7a-d676-40ad-a1c1-dfea934e03d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:55.703444 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2f0f7a-d676-40ad-a1c1-dfea934e03d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:55.704893 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2f0f7a-d676-40ad-a1c1-dfea934e03d2 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:55.705025 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a0aa72-c931-4031-9024-da969b540c28 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:55.723811 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-6a2f0f7a-d676-40ad-a1c1-dfea934e03d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:55.723811 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:55.723811 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:55.723811 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:55.723811 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:55.723811 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:55.723811 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:55.723811 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:55.723811 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:55.723811 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:55.723811 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:55.723811 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:55.723811 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:55.723811 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:55.723811 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:55.723811 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:55.724945 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:55.724945 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:55.724945 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:55.724945 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:55.724945 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:55.724945 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:55.724945 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:55.724945 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:55.724945 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:55.724945 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:55.724945 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:55.724945 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:55.724945 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:55.724945 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:55.724945 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:55.724945 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:55.724945 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:55.726074 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:55.726074 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:55.726074 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:55.727442 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 407/811] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 10:58:55.733328 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2f0f7a-d676-40ad-a1c1-dfea934e03d2 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:55.802856 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:55.810671 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a0aa72-c931-4031-9024-da969b540c28 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:55.848532 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e8cf05-056d-4f63-b5de-69c49e8b78c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:55.849184 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e8cf05-056d-4f63-b5de-69c49e8b78c0 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:55.849463 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e8cf05-056d-4f63-b5de-69c49e8b78c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:55.849737 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e8cf05-056d-4f63-b5de-69c49e8b78c0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:55.861574 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e8cf05-056d-4f63-b5de-69c49e8b78c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:58:55.867033 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-46e8cf05-056d-4f63-b5de-69c49e8b78c0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 13 10:58:55.867033 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:55.867033 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:55.867033 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:55.867033 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:55.867033 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:55.867033 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:55.867033 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:55.867033 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:55.867033 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:55.867033 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:55.867033 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:55.867033 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:58:55.867033 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:58:55.867033 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:58:55.867033 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:58:55.868184 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:58:55.868184 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:58:55.868184 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:58:55.868184 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:58:55.868184 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:55.868184 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:55.868184 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:55.868184 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:55.868184 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:55.868184 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:55.868184 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:55.868184 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:55.868184 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:55.868184 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:55.868184 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:55.868184 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:55.870745 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:55.870745 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:55.870745 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:55.870745 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:55.870745 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:58:55.870745 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:58:55.870745 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:58:55.870745 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:58:55.870745 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:58:55.870745 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:58:55.870745 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 13 10:58:55.870745 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:55.870745 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 405/812] 10.222.0.25 () {56 vars in 1120 bytes} [Thu Oct 13 10:58:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 10:58:55.875274 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e8cf05-056d-4f63-b5de-69c49e8b78c0 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:55.961033 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2f0f7a-d676-40ad-a1c1-dfea934e03d2 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:55.976096 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:55.982850 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e8cf05-056d-4f63-b5de-69c49e8b78c0 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:55.999386 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d0ce01-606a-4188-87ae-4e8736f2db74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:56.000211 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d0ce01-606a-4188-87ae-4e8736f2db74 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:56.000336 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d0ce01-606a-4188-87ae-4e8736f2db74 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:56.000528 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d0ce01-606a-4188-87ae-4e8736f2db74 None admin] PATH_INFO: `/v3/domains` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:56.001169 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d0ce01-606a-4188-87ae-4e8736f2db74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:56.001469 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d0ce01-606a-4188-87ae-4e8736f2db74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:56.003417 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d0ce01-606a-4188-87ae-4e8736f2db74 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:56.015298 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 408/813] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:58:56.025091 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702fda7b-4268-49e2-b750-0e1c756a099d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:56.025758 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702fda7b-4268-49e2-b750-0e1c756a099d None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:56.026181 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702fda7b-4268-49e2-b750-0e1c756a099d None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:56.026455 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702fda7b-4268-49e2-b750-0e1c756a099d None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:56.027148 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702fda7b-4268-49e2-b750-0e1c756a099d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:56.027452 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702fda7b-4268-49e2-b750-0e1c756a099d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:56.028968 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702fda7b-4268-49e2-b750-0e1c756a099d None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:56.040713 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 406/814] 10.222.0.25 () {56 vars in 1115 bytes} [Thu Oct 13 10:58:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:58:56.047086 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d0ce01-606a-4188-87ae-4e8736f2db74 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:56.156677 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d0ce01-606a-4188-87ae-4e8736f2db74 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:56.200648 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ccda55-e3ec-4ab5-a0e6-99a52ee15ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:56.201291 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ccda55-e3ec-4ab5-a0e6-99a52ee15ecf None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:56.201566 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ccda55-e3ec-4ab5-a0e6-99a52ee15ecf None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:56.201849 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ccda55-e3ec-4ab5-a0e6-99a52ee15ecf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:56.214341 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ccda55-e3ec-4ab5-a0e6-99a52ee15ecf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:56.215776 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ccda55-e3ec-4ab5-a0e6-99a52ee15ecf None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:56.230260 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-96ccda55-e3ec-4ab5-a0e6-99a52ee15ecf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:56.230260 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:56.230260 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:56.230260 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:56.230260 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:56.230260 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:56.230260 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:56.230260 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:56.230260 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:56.230260 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:56.230260 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:56.230260 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:56.230260 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:56.230260 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:56.230260 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:56.230260 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:56.231295 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:56.231295 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:56.231295 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:56.231295 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:56.231295 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:56.231295 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:56.231295 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:56.231295 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:56.231295 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:56.231295 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:56.231295 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:56.231295 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:56.231295 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:56.231295 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:56.231295 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:56.231295 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:56.231295 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:56.232403 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:56.232403 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:56.232403 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:56.232403 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 409/815] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:56.239294 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702fda7b-4268-49e2-b750-0e1c756a099d None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:56.259850 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:56.347236 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702fda7b-4268-49e2-b750-0e1c756a099d None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:56.379548 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4acfe28-7b7a-4b60-b2b6-81fdbca70b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:56.380145 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4acfe28-7b7a-4b60-b2b6-81fdbca70b50 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:56.380422 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4acfe28-7b7a-4b60-b2b6-81fdbca70b50 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:56.380693 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4acfe28-7b7a-4b60-b2b6-81fdbca70b50 None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:56.381324 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4acfe28-7b7a-4b60-b2b6-81fdbca70b50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:56.381625 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4acfe28-7b7a-4b60-b2b6-81fdbca70b50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:56.383049 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4acfe28-7b7a-4b60-b2b6-81fdbca70b50 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:56.395127 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 407/816] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:56.400767 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ccda55-e3ec-4ab5-a0e6-99a52ee15ecf None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:56.427756 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:56.496925 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ccda55-e3ec-4ab5-a0e6-99a52ee15ecf None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:56.529668 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef9457c-032f-45bc-9312-c13b607fefbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:56.530314 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef9457c-032f-45bc-9312-c13b607fefbb None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:56.530592 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef9457c-032f-45bc-9312-c13b607fefbb None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:56.530862 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef9457c-032f-45bc-9312-c13b607fefbb None admin] PATH_INFO: `/v3/users/nova` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:56.538386 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef9457c-032f-45bc-9312-c13b607fefbb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:56.540179 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef9457c-032f-45bc-9312-c13b607fefbb None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:56.551421 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-bef9457c-032f-45bc-9312-c13b607fefbb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 13 10:58:56.551421 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:56.551421 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:56.551421 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:56.551421 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:56.551421 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:56.551421 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:56.551421 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:56.551421 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:56.551421 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:56.551421 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:56.551421 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:56.551421 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 10:58:56.551421 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 10:58:56.551421 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 10:58:56.551421 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 10:58:56.552429 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:56.552429 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:56.552429 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 10:58:56.552429 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:56.552429 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 10:58:56.552429 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:56.552429 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:56.552429 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:56.552429 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:56.552429 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:56.552429 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:56.552429 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:56.552429 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:56.552429 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:56.552429 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:56.552429 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:56.552429 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:56.552429 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:56.553362 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:56.553362 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:56.553362 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 10:58:56.553362 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 10:58:56.553362 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 10:58:56.553362 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 10:58:56.553362 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 10:58:56.553362 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 10:58:56.553362 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 13 10:58:56.553362 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:58:56.553362 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 410/817] 10.222.0.25 () {56 vars in 1093 bytes} [Thu Oct 13 10:58:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:56.558342 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4acfe28-7b7a-4b60-b2b6-81fdbca70b50 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:56.631793 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:56.654328 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4acfe28-7b7a-4b60-b2b6-81fdbca70b50 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:56.687951 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dad68f1-283d-4a7f-b97e-f23496ad9e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:56.688453 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad68f1-283d-4a7f-b97e-f23496ad9e26 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:56.688728 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad68f1-283d-4a7f-b97e-f23496ad9e26 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:56.688998 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad68f1-283d-4a7f-b97e-f23496ad9e26 None admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:56.689713 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dad68f1-283d-4a7f-b97e-f23496ad9e26 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:56.690077 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dad68f1-283d-4a7f-b97e-f23496ad9e26 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:56.691590 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dad68f1-283d-4a7f-b97e-f23496ad9e26 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:56.708668 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 408/818] 10.222.0.25 () {56 vars in 1133 bytes} [Thu Oct 13 10:58:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:56.714509 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef9457c-032f-45bc-9312-c13b607fefbb None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:56.797429 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:56.812784 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef9457c-032f-45bc-9312-c13b607fefbb None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:56.844426 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2677d7-14b2-448b-8226-0b15c2c95551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:56.845020 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2677d7-14b2-448b-8226-0b15c2c95551 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:56.845300 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2677d7-14b2-448b-8226-0b15c2c95551 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:56.845568 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2677d7-14b2-448b-8226-0b15c2c95551 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:56.910398 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2677d7-14b2-448b-8226-0b15c2c95551 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:56.911836 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2677d7-14b2-448b-8226-0b15c2c95551 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:56.990819 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:57.006756 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 411/819] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Oct 13 10:58:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 13 10:58:57.012539 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dad68f1-283d-4a7f-b97e-f23496ad9e26 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:57.108055 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dad68f1-283d-4a7f-b97e-f23496ad9e26 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:57.141175 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea24656-9549-47b1-817d-ec73f086ac44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:57.141803 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea24656-9549-47b1-817d-ec73f086ac44 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:57.142123 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea24656-9549-47b1-817d-ec73f086ac44 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:57.142397 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea24656-9549-47b1-817d-ec73f086ac44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:57.144252 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:57.153365 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea24656-9549-47b1-817d-ec73f086ac44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:57.154835 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea24656-9549-47b1-817d-ec73f086ac44 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:57.169328 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-8ea24656-9549-47b1-817d-ec73f086ac44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:57.169328 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:57.169328 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:57.169328 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:57.169328 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:57.169328 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:57.169328 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:57.169328 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:57.169328 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:57.169328 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:57.169328 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:57.169328 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:57.169328 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:57.169328 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:57.169328 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:57.169328 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:57.175602 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:57.175602 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:57.175602 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:57.175602 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:57.175602 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:57.175602 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:57.175602 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:57.175602 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:57.175602 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:57.175602 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:57.175602 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:57.175602 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:57.175602 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:57.175602 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:57.175602 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:57.175602 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:57.175602 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:57.176732 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:57.176732 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:57.176732 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:57.176732 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 409/820] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 10:58:57.178348 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2677d7-14b2-448b-8226-0b15c2c95551 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:57.274294 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2677d7-14b2-448b-8226-0b15c2c95551 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:57.307154 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3c63d8-ca2b-4ef7-b7aa-43cceb77ae15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:57.307747 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c63d8-ca2b-4ef7-b7aa-43cceb77ae15 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:57.308023 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c63d8-ca2b-4ef7-b7aa-43cceb77ae15 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:57.308291 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c63d8-ca2b-4ef7-b7aa-43cceb77ae15 None admin] PATH_INFO: `/v3/domains` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:57.308932 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3c63d8-ca2b-4ef7-b7aa-43cceb77ae15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:57.309232 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3c63d8-ca2b-4ef7-b7aa-43cceb77ae15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:57.310602 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3c63d8-ca2b-4ef7-b7aa-43cceb77ae15 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:57.321362 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 412/821] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:57.327140 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea24656-9549-47b1-817d-ec73f086ac44 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:57.423622 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea24656-9549-47b1-817d-ec73f086ac44 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:57.459504 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c325a81d-8c10-4c2f-9767-1ee2f86e96c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:57.460145 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325a81d-8c10-4c2f-9767-1ee2f86e96c2 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:57.460424 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325a81d-8c10-4c2f-9767-1ee2f86e96c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:57.460698 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325a81d-8c10-4c2f-9767-1ee2f86e96c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:57.467512 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c325a81d-8c10-4c2f-9767-1ee2f86e96c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:57.468947 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c325a81d-8c10-4c2f-9767-1ee2f86e96c2 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:57.480443 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-c325a81d-8c10-4c2f-9767-1ee2f86e96c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:58:57.480443 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:57.480443 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:57.480443 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:57.480443 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:57.480443 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:57.480443 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:57.480443 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:57.480443 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:57.480443 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:57.480443 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:57.480443 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:57.480443 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 10:58:57.480443 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 10:58:57.480443 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 10:58:57.481450 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 10:58:57.481450 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:57.481450 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:57.481450 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:57.481450 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:57.481450 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:57.481450 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:57.481450 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:57.481450 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:57.481450 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:57.481450 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:57.481450 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:57.481450 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:57.481450 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:57.481450 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:57.481450 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:57.481450 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:57.487578 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 10:58:57.487578 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 10:58:57.487578 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 10:58:57.487578 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 10:58:57.487578 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 10:58:57.487578 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 10:58:57.487578 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:58:57.487578 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:57.487578 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 410/822] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Oct 13 10:58:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:57.488122 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3c63d8-ca2b-4ef7-b7aa-43cceb77ae15 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:57.535002 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:57.547483 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2087682f-78bc-4075-a535-93faa91754e3 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:57.547766 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2087682f-78bc-4075-a535-93faa91754e3 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:57.548041 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2087682f-78bc-4075-a535-93faa91754e3 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:57.549429 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 411/823] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:58:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 10:58:57.554374 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3283d1b1-2fbc-496b-8239-dc6ad8bed167 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:57.554651 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3283d1b1-2fbc-496b-8239-dc6ad8bed167 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:57.554922 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3283d1b1-2fbc-496b-8239-dc6ad8bed167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:57.572911 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-3283d1b1-2fbc-496b-8239-dc6ad8bed167 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:57.574147 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-3283d1b1-2fbc-496b-8239-dc6ad8bed167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:57.587698 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3c63d8-ca2b-4ef7-b7aa-43cceb77ae15 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:57.615252 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:57.620003 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d52f308-de26-4204-9da8-842c94ed750b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:57.620600 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d52f308-de26-4204-9da8-842c94ed750b None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:57.620874 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d52f308-de26-4204-9da8-842c94ed750b None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:57.621139 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d52f308-de26-4204-9da8-842c94ed750b None admin] PATH_INFO: `/v3/projects` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:57.621816 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d52f308-de26-4204-9da8-842c94ed750b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:57.622147 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d52f308-de26-4204-9da8-842c94ed750b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:57.623586 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d52f308-de26-4204-9da8-842c94ed750b None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:57.635764 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 413/824] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Oct 13 10:58:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:58:57.640393 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 412/825] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 13 10:58:57.641885 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d52f308-de26-4204-9da8-842c94ed750b None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:57.737234 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d52f308-de26-4204-9da8-842c94ed750b None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:57.743988 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:57.771700 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a70f563-c183-47ae-951e-3dee8c3fc303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:57.772291 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a70f563-c183-47ae-951e-3dee8c3fc303 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:57.772565 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a70f563-c183-47ae-951e-3dee8c3fc303 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:57.772832 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a70f563-c183-47ae-951e-3dee8c3fc303 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:57.773546 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a70f563-c183-47ae-951e-3dee8c3fc303 None admin] RBAC: Adding query filter params (role.id=fba8d2d3d7964167b2f43a7eb6f5e8b7, scope.project.id=85bfac5f03e24fb3870a59a6b52dba6e, user.id=78384fbffdd346578855e7214b335d8e) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:57.773851 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a70f563-c183-47ae-951e-3dee8c3fc303 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:57.775280 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a70f563-c183-47ae-951e-3dee8c3fc303 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:57.780728 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 414/826] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Oct 13 10:58:57 2022] GET /identity/v3/role_assignments?user.id=78384fbffdd346578855e7214b335d8e&scope.project.id=85bfac5f03e24fb3870a59a6b52dba6e&role.id=fba8d2d3d7964167b2f43a7eb6f5e8b7 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:57.909877 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3283d1b1-2fbc-496b-8239-dc6ad8bed167 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:58.009174 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3283d1b1-2fbc-496b-8239-dc6ad8bed167 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:58.047240 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e11ef4-7266-4605-b743-e93ade4e0e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:58.047879 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e11ef4-7266-4605-b743-e93ade4e0e77 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:58.048157 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e11ef4-7266-4605-b743-e93ade4e0e77 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:58.048436 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e11ef4-7266-4605-b743-e93ade4e0e77 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:58.059545 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e11ef4-7266-4605-b743-e93ade4e0e77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:58:58.064302 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-a1e11ef4-7266-4605-b743-e93ade4e0e77 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 10:58:58.064302 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:58.064302 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:58.064302 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:58.064302 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:58.064302 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:58.064302 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:58.064302 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:58.064302 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:58.064302 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:58.064302 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:58.064302 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:58.064302 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:58:58.064302 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:58:58.064302 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:58:58.064302 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:58:58.065461 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:58:58.065461 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:58:58.065461 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:58:58.065461 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:58:58.065461 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:58.065461 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:58.065461 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:58.065461 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:58.065461 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:58.065461 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:58.065461 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:58.065461 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:58.065461 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:58.065461 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:58.065461 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:58.065461 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:58.066801 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:58.066801 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:58.066801 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:58.066801 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:58.066801 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:58:58.066801 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:58:58.066801 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:58:58.066801 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:58:58.066801 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:58:58.066801 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:58:58.066801 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 10:58:58.066801 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:58:58.066801 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 413/827] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Oct 13 10:58:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:58.071450 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a70f563-c183-47ae-951e-3dee8c3fc303 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:58.170937 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a70f563-c183-47ae-951e-3dee8c3fc303 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:58.207002 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1740b56e-e040-4c35-9dae-5097c62e2b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:58.207617 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1740b56e-e040-4c35-9dae-5097c62e2b7c None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:58.207889 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1740b56e-e040-4c35-9dae-5097c62e2b7c None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:58.208153 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1740b56e-e040-4c35-9dae-5097c62e2b7c None admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:58.208813 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1740b56e-e040-4c35-9dae-5097c62e2b7c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:58.209111 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1740b56e-e040-4c35-9dae-5097c62e2b7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:58.210492 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1740b56e-e040-4c35-9dae-5097c62e2b7c None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:58.219250 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 415/828] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 10:58:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:58.225124 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e11ef4-7266-4605-b743-e93ade4e0e77 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:58.261863 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:58.328985 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e11ef4-7266-4605-b743-e93ade4e0e77 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:58.362769 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e32e9-d879-4a8f-b88d-4a6c6bfe8b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:58.363406 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e32e9-d879-4a8f-b88d-4a6c6bfe8b89 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:58.363684 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e32e9-d879-4a8f-b88d-4a6c6bfe8b89 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:58.363964 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e32e9-d879-4a8f-b88d-4a6c6bfe8b89 None admin] PATH_INFO: `/v3/users/ba635ccf93594aa1bf0763d95e39ac8f` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:58.377420 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3e32e9-d879-4a8f-b88d-4a6c6bfe8b89 None admin] RBAC: Authorizing `identity:get_user(user_id=ba635ccf93594aa1bf0763d95e39ac8f)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:58.378936 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3e32e9-d879-4a8f-b88d-4a6c6bfe8b89 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:58.380604 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 414/829] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Oct 13 10:58:58 2022] GET /identity/v3/users/ba635ccf93594aa1bf0763d95e39ac8f => generated 285 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:58.386475 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1740b56e-e040-4c35-9dae-5097c62e2b7c None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:58.418337 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:58.487941 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1740b56e-e040-4c35-9dae-5097c62e2b7c None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:58.523590 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a6077f-344c-4d5a-9258-ad5e9206554e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:58.524281 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a6077f-344c-4d5a-9258-ad5e9206554e None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:58.524558 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a6077f-344c-4d5a-9258-ad5e9206554e None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:58.524851 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a6077f-344c-4d5a-9258-ad5e9206554e None admin] PATH_INFO: `/v3/projects/91aa56e4651f4360a43f720e36deb520` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:58.526080 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a6077f-344c-4d5a-9258-ad5e9206554e None admin] RBAC: Authorizing `identity:get_project(project_id=91aa56e4651f4360a43f720e36deb520)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:58.527501 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a6077f-344c-4d5a-9258-ad5e9206554e None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:58.529421 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 416/830] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Oct 13 10:58:58 2022] GET /identity/v3/projects/91aa56e4651f4360a43f720e36deb520 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:58.535671 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e32e9-d879-4a8f-b88d-4a6c6bfe8b89 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:58.630031 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:58.636876 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e32e9-d879-4a8f-b88d-4a6c6bfe8b89 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:58.669210 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731a80dc-e343-4feb-b307-57724ac39315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:58.669856 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a80dc-e343-4feb-b307-57724ac39315 None admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:58.670161 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a80dc-e343-4feb-b307-57724ac39315 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:58.670434 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a80dc-e343-4feb-b307-57724ac39315 None admin] PATH_INFO: `/v3/projects/91aa56e4651f4360a43f720e36deb520/users/ba635ccf93594aa1bf0763d95e39ac8f/roles/ea564961b1db4eb4a1d4d880964611b2` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:58.672286 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731a80dc-e343-4feb-b307-57724ac39315 None admin] RBAC: Authorizing `identity:create_grant(project_id=91aa56e4651f4360a43f720e36deb520, user_id=ba635ccf93594aa1bf0763d95e39ac8f, role_id=ea564961b1db4eb4a1d4d880964611b2)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:58.673699 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731a80dc-e343-4feb-b307-57724ac39315 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:58.687300 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 415/831] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Oct 13 10:58:58 2022] PUT /identity/v3/projects/91aa56e4651f4360a43f720e36deb520/users/ba635ccf93594aa1bf0763d95e39ac8f/roles/ea564961b1db4eb4a1d4d880964611b2 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 10:59:00.753736 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd1ce3-7e1d-4216-b991-7fa2d0eb7cb5 None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:00.754358 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd1ce3-7e1d-4216-b991-7fa2d0eb7cb5 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:00.754358 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd1ce3-7e1d-4216-b991-7fa2d0eb7cb5 None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:00.755656 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 417/832] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:59:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:59:00.761011 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6b9c8-7762-45a7-aec3-d1608875f880 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:00.761399 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6b9c8-7762-45a7-aec3-d1608875f880 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:00.761556 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6b9c8-7762-45a7-aec3-d1608875f880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:00.779083 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-e4f6b9c8-7762-45a7-aec3-d1608875f880 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:59:00.780274 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-e4f6b9c8-7762-45a7-aec3-d1608875f880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:59:00.842728 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 416/833] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:59:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 10:59:01.106468 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fd1ce3-7e1d-4216-b991-7fa2d0eb7cb5 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:01.200393 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:01.204629 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fd1ce3-7e1d-4216-b991-7fa2d0eb7cb5 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:01.237514 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849936b9-b9ca-4360-9681-fefb61c745d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:01.238149 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849936b9-b9ca-4360-9681-fefb61c745d9 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:01.238430 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849936b9-b9ca-4360-9681-fefb61c745d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:01.238702 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849936b9-b9ca-4360-9681-fefb61c745d9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:01.249449 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849936b9-b9ca-4360-9681-fefb61c745d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:59:01.254808 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-849936b9-b9ca-4360-9681-fefb61c745d9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 10:59:01.254808 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:59:01.254808 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:59:01.254808 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:59:01.254808 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:59:01.254808 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:59:01.254808 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:59:01.254808 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:59:01.254808 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:59:01.254808 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:59:01.254808 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:59:01.254808 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:59:01.254808 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:59:01.254808 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:59:01.254808 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:59:01.254808 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:59:01.255864 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:59:01.255864 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:59:01.255864 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:59:01.255864 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:59:01.255864 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:59:01.255864 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:59:01.255864 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:59:01.255864 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:59:01.255864 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:59:01.255864 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:59:01.255864 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:59:01.255864 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:59:01.255864 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:59:01.255864 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:59:01.255864 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:59:01.255864 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:59:01.256858 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:59:01.256858 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:59:01.256858 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:59:01.256858 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:59:01.256858 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:59:01.256858 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:59:01.256858 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:59:01.256858 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:59:01.256858 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:59:01.256858 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:59:01.256858 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 10:59:01.256858 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:59:01.256858 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 418/834] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Oct 13 10:59:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:59:01.261701 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f6b9c8-7762-45a7-aec3-d1608875f880 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:01.340824 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:01.357194 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f6b9c8-7762-45a7-aec3-d1608875f880 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:01.389649 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ec66a6-e995-45e4-a560-4492649c5d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:01.390267 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec66a6-e995-45e4-a560-4492649c5d34 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:01.390549 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec66a6-e995-45e4-a560-4492649c5d34 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:01.390821 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec66a6-e995-45e4-a560-4492649c5d34 None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:01.391480 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ec66a6-e995-45e4-a560-4492649c5d34 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:59:01.391786 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ec66a6-e995-45e4-a560-4492649c5d34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:01.393168 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ec66a6-e995-45e4-a560-4492649c5d34 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:01.400800 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 417/835] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 10:59:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:59:01.406473 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849936b9-b9ca-4360-9681-fefb61c745d9 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:01.501082 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849936b9-b9ca-4360-9681-fefb61c745d9 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:01.532195 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3074eb02-0493-4ea5-b598-93c7948d8d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:01.532797 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3074eb02-0493-4ea5-b598-93c7948d8d31 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:01.533073 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3074eb02-0493-4ea5-b598-93c7948d8d31 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:01.533342 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3074eb02-0493-4ea5-b598-93c7948d8d31 None admin] PATH_INFO: `/v3/users/ba635ccf93594aa1bf0763d95e39ac8f` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:01.535004 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3074eb02-0493-4ea5-b598-93c7948d8d31 None admin] RBAC: Authorizing `identity:get_user(user_id=ba635ccf93594aa1bf0763d95e39ac8f)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:01.536388 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3074eb02-0493-4ea5-b598-93c7948d8d31 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:01.537892 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 419/836] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Oct 13 10:59:01 2022] GET /identity/v3/users/ba635ccf93594aa1bf0763d95e39ac8f => generated 285 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:59:01.543375 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ec66a6-e995-45e4-a560-4492649c5d34 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:01.638289 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ec66a6-e995-45e4-a560-4492649c5d34 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:01.669811 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd10097a-1c32-4708-96f9-26b1e5db5475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:01.670428 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10097a-1c32-4708-96f9-26b1e5db5475 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:01.670707 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10097a-1c32-4708-96f9-26b1e5db5475 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:01.670980 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10097a-1c32-4708-96f9-26b1e5db5475 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:01.685539 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:01.734186 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd10097a-1c32-4708-96f9-26b1e5db5475 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:01.735618 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd10097a-1c32-4708-96f9-26b1e5db5475 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:01.945330 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 418/837] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Oct 13 10:59:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 13 10:59:01.951294 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3074eb02-0493-4ea5-b598-93c7948d8d31 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:01.979387 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:02.047037 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3074eb02-0493-4ea5-b598-93c7948d8d31 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:02.078483 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f883e0da-c5f6-4711-8346-688419ecba9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:02.079085 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f883e0da-c5f6-4711-8346-688419ecba9a None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:02.079359 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f883e0da-c5f6-4711-8346-688419ecba9a None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:02.079625 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f883e0da-c5f6-4711-8346-688419ecba9a None admin] PATH_INFO: `/v3/projects/91aa56e4651f4360a43f720e36deb520` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:02.080792 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f883e0da-c5f6-4711-8346-688419ecba9a None admin] RBAC: Authorizing `identity:get_project(project_id=91aa56e4651f4360a43f720e36deb520)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:02.082213 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f883e0da-c5f6-4711-8346-688419ecba9a None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:02.083763 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 420/838] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Oct 13 10:59:01 2022] GET /identity/v3/projects/91aa56e4651f4360a43f720e36deb520 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:59:02.089722 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd10097a-1c32-4708-96f9-26b1e5db5475 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:02.133591 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:02.184301 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd10097a-1c32-4708-96f9-26b1e5db5475 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:02.217138 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c981548-38b2-40ec-b14d-a1b2fa8a44c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:02.217979 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c981548-38b2-40ec-b14d-a1b2fa8a44c3 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:02.218248 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c981548-38b2-40ec-b14d-a1b2fa8a44c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:02.218519 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c981548-38b2-40ec-b14d-a1b2fa8a44c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:02.219237 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c981548-38b2-40ec-b14d-a1b2fa8a44c3 None admin] RBAC: Adding query filter params (role.id=ea564961b1db4eb4a1d4d880964611b2, scope.project.id=91aa56e4651f4360a43f720e36deb520, user.id=ba635ccf93594aa1bf0763d95e39ac8f) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:59:02.219544 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c981548-38b2-40ec-b14d-a1b2fa8a44c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:02.221482 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c981548-38b2-40ec-b14d-a1b2fa8a44c3 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:02.227018 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 419/839] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Oct 13 10:59:02 2022] GET /identity/v3/role_assignments?user.id=ba635ccf93594aa1bf0763d95e39ac8f&scope.project.id=91aa56e4651f4360a43f720e36deb520&role.id=ea564961b1db4eb4a1d4d880964611b2 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:59:04.343277 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d36382-5df0-480a-b4a9-0cb080c68593 None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:04.343810 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d36382-5df0-480a-b4a9-0cb080c68593 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:04.343810 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d36382-5df0-480a-b4a9-0cb080c68593 None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:04.345132 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 421/840] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:59:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:59:04.350845 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533bb984-a05e-455a-8cda-97c5dbb8f29e None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:04.351218 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533bb984-a05e-455a-8cda-97c5dbb8f29e None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:04.351402 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533bb984-a05e-455a-8cda-97c5dbb8f29e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:04.369832 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-533bb984-a05e-455a-8cda-97c5dbb8f29e None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:59:04.371056 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-533bb984-a05e-455a-8cda-97c5dbb8f29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:59:04.433875 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 420/841] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:59:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 10:59:04.701675 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d36382-5df0-480a-b4a9-0cb080c68593 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:04.792597 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:04.799345 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d36382-5df0-480a-b4a9-0cb080c68593 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:04.831394 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eade264-9709-4ce1-bf7b-9cec32f3af44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:04.832006 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eade264-9709-4ce1-bf7b-9cec32f3af44 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:04.832280 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eade264-9709-4ce1-bf7b-9cec32f3af44 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:04.832545 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eade264-9709-4ce1-bf7b-9cec32f3af44 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:04.833642 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eade264-9709-4ce1-bf7b-9cec32f3af44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:04.835072 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eade264-9709-4ce1-bf7b-9cec32f3af44 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:04.836588 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 422/842] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 10:59:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:59:04.842262 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533bb984-a05e-455a-8cda-97c5dbb8f29e None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:04.882277 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:04.937487 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533bb984-a05e-455a-8cda-97c5dbb8f29e None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:04.969238 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef86316-c3c3-4249-bef0-c6b8cb132321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:04.969778 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef86316-c3c3-4249-bef0-c6b8cb132321 None admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:04.970098 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef86316-c3c3-4249-bef0-c6b8cb132321 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:04.970372 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef86316-c3c3-4249-bef0-c6b8cb132321 None admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:04.971580 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef86316-c3c3-4249-bef0-c6b8cb132321 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:04.972985 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef86316-c3c3-4249-bef0-c6b8cb132321 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:04.993602 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 421/843] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Oct 13 10:59:04 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 10:59:07.136361 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb50a21-341a-4452-b4d5-9b1cfa6e0417 None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:07.136896 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb50a21-341a-4452-b4d5-9b1cfa6e0417 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:07.136896 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb50a21-341a-4452-b4d5-9b1cfa6e0417 None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:07.138171 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 423/844] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:59:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:59:07.143718 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e2db3-7388-4e5d-b72b-d890305c7538 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:07.144144 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e2db3-7388-4e5d-b72b-d890305c7538 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:07.144253 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e2db3-7388-4e5d-b72b-d890305c7538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:07.162223 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-c62e2db3-7388-4e5d-b72b-d890305c7538 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:59:07.163389 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-c62e2db3-7388-4e5d-b72b-d890305c7538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:59:07.225209 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 422/845] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:59:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 10:59:07.495429 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb50a21-341a-4452-b4d5-9b1cfa6e0417 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:07.593863 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb50a21-341a-4452-b4d5-9b1cfa6e0417 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:07.626652 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4761690-b9de-4fd0-9a3c-0c0458e3d11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:07.627759 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4761690-b9de-4fd0-9a3c-0c0458e3d11f None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:07.628055 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4761690-b9de-4fd0-9a3c-0c0458e3d11f None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:07.628312 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4761690-b9de-4fd0-9a3c-0c0458e3d11f None admin] PATH_INFO: `/v3/roles/84a5ec3770b4453bb7c3ff5b9af0bd17` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:07.629686 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4761690-b9de-4fd0-9a3c-0c0458e3d11f None admin] RBAC: Authorizing `identity:get_role(role_id=84a5ec3770b4453bb7c3ff5b9af0bd17)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:07.631063 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4761690-b9de-4fd0-9a3c-0c0458e3d11f None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:07.632338 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 424/846] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Oct 13 10:59:07 2022] GET /identity/v3/roles/84a5ec3770b4453bb7c3ff5b9af0bd17 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:59:07.638163 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e2db3-7388-4e5d-b72b-d890305c7538 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:07.663609 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:07.732770 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e2db3-7388-4e5d-b72b-d890305c7538 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:07.765264 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eebdb3-380e-4ce9-99fe-1e77fa421e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:07.765816 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eebdb3-380e-4ce9-99fe-1e77fa421e36 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:07.766121 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eebdb3-380e-4ce9-99fe-1e77fa421e36 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:07.766395 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eebdb3-380e-4ce9-99fe-1e77fa421e36 None admin] PATH_INFO: `/v3/users/fb0e62ed1d974b69b068ad09af84a4f2` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:07.778506 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eebdb3-380e-4ce9-99fe-1e77fa421e36 None admin] RBAC: Authorizing `identity:get_user(user_id=fb0e62ed1d974b69b068ad09af84a4f2)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:07.779912 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eebdb3-380e-4ce9-99fe-1e77fa421e36 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:07.781443 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 423/847] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Oct 13 10:59:07 2022] GET /identity/v3/users/fb0e62ed1d974b69b068ad09af84a4f2 => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:59:07.787505 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4761690-b9de-4fd0-9a3c-0c0458e3d11f None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:07.818380 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:07.884384 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4761690-b9de-4fd0-9a3c-0c0458e3d11f None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:07.916487 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01b7959-c874-496e-b14f-da2bf30cb910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:07.917108 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b7959-c874-496e-b14f-da2bf30cb910 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:07.917387 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b7959-c874-496e-b14f-da2bf30cb910 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:07.917661 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b7959-c874-496e-b14f-da2bf30cb910 None admin] PATH_INFO: `/v3/projects/91aa56e4651f4360a43f720e36deb520` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:07.918797 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01b7959-c874-496e-b14f-da2bf30cb910 None admin] RBAC: Authorizing `identity:get_project(project_id=91aa56e4651f4360a43f720e36deb520)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:07.920212 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01b7959-c874-496e-b14f-da2bf30cb910 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:07.921810 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 425/848] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Oct 13 10:59:07 2022] GET /identity/v3/projects/91aa56e4651f4360a43f720e36deb520 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:59:07.928298 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eebdb3-380e-4ce9-99fe-1e77fa421e36 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:08.008704 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:08.024034 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eebdb3-380e-4ce9-99fe-1e77fa421e36 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:08.056193 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e9844a-86c7-4f8e-b4fc-4eb8efc5da68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:08.056828 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e9844a-86c7-4f8e-b4fc-4eb8efc5da68 None admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:08.057099 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e9844a-86c7-4f8e-b4fc-4eb8efc5da68 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:08.057368 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e9844a-86c7-4f8e-b4fc-4eb8efc5da68 None admin] PATH_INFO: `/v3/projects/91aa56e4651f4360a43f720e36deb520/users/fb0e62ed1d974b69b068ad09af84a4f2/roles/84a5ec3770b4453bb7c3ff5b9af0bd17` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:08.059470 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e9844a-86c7-4f8e-b4fc-4eb8efc5da68 None admin] RBAC: Authorizing `identity:create_grant(project_id=91aa56e4651f4360a43f720e36deb520, user_id=fb0e62ed1d974b69b068ad09af84a4f2, role_id=84a5ec3770b4453bb7c3ff5b9af0bd17)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:08.060873 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e9844a-86c7-4f8e-b4fc-4eb8efc5da68 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:08.073144 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 424/849] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Oct 13 10:59:07 2022] PUT /identity/v3/projects/91aa56e4651f4360a43f720e36deb520/users/fb0e62ed1d974b69b068ad09af84a4f2/roles/84a5ec3770b4453bb7c3ff5b9af0bd17 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 10:59:10.171305 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad19b2a-cbb1-458c-9f73-7218f3d1b1cf None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:10.171821 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad19b2a-cbb1-458c-9f73-7218f3d1b1cf None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:10.171933 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad19b2a-cbb1-458c-9f73-7218f3d1b1cf None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:10.173197 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 426/850] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:59:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:59:10.178868 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782bd53-02e9-436f-afa9-0e61ba41ee82 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:10.179294 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782bd53-02e9-436f-afa9-0e61ba41ee82 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:10.179415 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782bd53-02e9-436f-afa9-0e61ba41ee82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:10.197429 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-a782bd53-02e9-436f-afa9-0e61ba41ee82 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:59:10.198644 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-a782bd53-02e9-436f-afa9-0e61ba41ee82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:59:10.265356 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 425/851] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:59:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 10:59:10.532987 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad19b2a-cbb1-458c-9f73-7218f3d1b1cf None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:10.626699 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:10.631249 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad19b2a-cbb1-458c-9f73-7218f3d1b1cf None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:10.663246 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9b28f9-25b8-4206-b8b5-061d33c2c01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:10.663856 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b28f9-25b8-4206-b8b5-061d33c2c01e None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:10.664139 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b28f9-25b8-4206-b8b5-061d33c2c01e None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:10.664410 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b28f9-25b8-4206-b8b5-061d33c2c01e None admin] PATH_INFO: `/v3/roles/84a5ec3770b4453bb7c3ff5b9af0bd17` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:10.665776 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9b28f9-25b8-4206-b8b5-061d33c2c01e None admin] RBAC: Authorizing `identity:get_role(role_id=84a5ec3770b4453bb7c3ff5b9af0bd17)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:10.667147 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9b28f9-25b8-4206-b8b5-061d33c2c01e None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:10.668411 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 427/852] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Oct 13 10:59:10 2022] GET /identity/v3/roles/84a5ec3770b4453bb7c3ff5b9af0bd17 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:59:10.674727 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a782bd53-02e9-436f-afa9-0e61ba41ee82 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:10.744170 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:10.769427 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a782bd53-02e9-436f-afa9-0e61ba41ee82 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:10.801103 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b49237-1a58-4f26-ac6b-5bde8e046b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:10.801657 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b49237-1a58-4f26-ac6b-5bde8e046b1a None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:10.801928 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b49237-1a58-4f26-ac6b-5bde8e046b1a None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:10.802225 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b49237-1a58-4f26-ac6b-5bde8e046b1a None admin] PATH_INFO: `/v3/users/fb0e62ed1d974b69b068ad09af84a4f2` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:10.803310 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b49237-1a58-4f26-ac6b-5bde8e046b1a None admin] RBAC: Authorizing `identity:get_user(user_id=fb0e62ed1d974b69b068ad09af84a4f2)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:10.804705 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b49237-1a58-4f26-ac6b-5bde8e046b1a None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:10.806264 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 426/853] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Oct 13 10:59:10 2022] GET /identity/v3/users/fb0e62ed1d974b69b068ad09af84a4f2 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:59:10.811792 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9b28f9-25b8-4206-b8b5-061d33c2c01e None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:10.907426 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9b28f9-25b8-4206-b8b5-061d33c2c01e None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:10.941693 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a374ee-be17-4d62-a3b9-944b88080c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:10.942305 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a374ee-be17-4d62-a3b9-944b88080c6b None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:10.942579 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a374ee-be17-4d62-a3b9-944b88080c6b None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:10.943162 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a374ee-be17-4d62-a3b9-944b88080c6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:10.974681 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:11.006715 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a374ee-be17-4d62-a3b9-944b88080c6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:11.008129 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a374ee-be17-4d62-a3b9-944b88080c6b None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:11.099782 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 428/854] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Oct 13 10:59:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 13 10:59:11.105567 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b49237-1a58-4f26-ac6b-5bde8e046b1a None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:11.199441 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b49237-1a58-4f26-ac6b-5bde8e046b1a None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:11.231383 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee5bf40-3f57-4422-9957-2c82fcef6587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:11.231991 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5bf40-3f57-4422-9957-2c82fcef6587 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:11.232269 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5bf40-3f57-4422-9957-2c82fcef6587 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:11.232539 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5bf40-3f57-4422-9957-2c82fcef6587 None admin] PATH_INFO: `/v3/projects/91aa56e4651f4360a43f720e36deb520` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:11.233635 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee5bf40-3f57-4422-9957-2c82fcef6587 None admin] RBAC: Authorizing `identity:get_project(project_id=91aa56e4651f4360a43f720e36deb520)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:11.235075 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee5bf40-3f57-4422-9957-2c82fcef6587 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:11.237535 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 427/855] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Oct 13 10:59:11 2022] GET /identity/v3/projects/91aa56e4651f4360a43f720e36deb520 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:59:11.244264 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a374ee-be17-4d62-a3b9-944b88080c6b None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:11.306840 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:11.338751 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a374ee-be17-4d62-a3b9-944b88080c6b None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:11.371568 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2231c88a-35c8-4b3f-962c-e83e48a665f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:11.372099 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2231c88a-35c8-4b3f-962c-e83e48a665f1 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:11.372377 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2231c88a-35c8-4b3f-962c-e83e48a665f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:11.372643 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2231c88a-35c8-4b3f-962c-e83e48a665f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:11.373355 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2231c88a-35c8-4b3f-962c-e83e48a665f1 None admin] RBAC: Adding query filter params (role.id=84a5ec3770b4453bb7c3ff5b9af0bd17, scope.project.id=91aa56e4651f4360a43f720e36deb520, user.id=fb0e62ed1d974b69b068ad09af84a4f2) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:59:11.373660 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2231c88a-35c8-4b3f-962c-e83e48a665f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:11.375079 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2231c88a-35c8-4b3f-962c-e83e48a665f1 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:11.380517 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 429/856] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Oct 13 10:59:11 2022] GET /identity/v3/role_assignments?user.id=fb0e62ed1d974b69b068ad09af84a4f2&scope.project.id=91aa56e4651f4360a43f720e36deb520&role.id=84a5ec3770b4453bb7c3ff5b9af0bd17 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:59:13.486325 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd54154-8907-4c96-87aa-6b35c0d70786 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:13.488986 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd54154-8907-4c96-87aa-6b35c0d70786 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:13.488986 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd54154-8907-4c96-87aa-6b35c0d70786 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:13.489173 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 428/857] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:59:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:59:13.494549 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134d089e-3ff8-46c5-a962-7e991776220b None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:13.495018 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134d089e-3ff8-46c5-a962-7e991776220b None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:13.495115 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134d089e-3ff8-46c5-a962-7e991776220b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:13.512673 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-134d089e-3ff8-46c5-a962-7e991776220b None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:59:13.513841 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-134d089e-3ff8-46c5-a962-7e991776220b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:59:13.576387 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 430/858] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:59:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 10:59:13.843927 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd54154-8907-4c96-87aa-6b35c0d70786 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:13.855816 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:13.942467 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd54154-8907-4c96-87aa-6b35c0d70786 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:13.973585 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e98c6-7b19-4bd2-8037-592d77f10318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:13.974226 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e98c6-7b19-4bd2-8037-592d77f10318 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:13.974500 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e98c6-7b19-4bd2-8037-592d77f10318 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:13.974765 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e98c6-7b19-4bd2-8037-592d77f10318 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:13.975844 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32e98c6-7b19-4bd2-8037-592d77f10318 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:13.977249 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32e98c6-7b19-4bd2-8037-592d77f10318 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:13.978813 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 429/859] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 10:59:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:59:13.984542 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134d089e-3ff8-46c5-a962-7e991776220b None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:14.043833 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:14.080301 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134d089e-3ff8-46c5-a962-7e991776220b None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:14.113250 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9747e181-71de-426f-9f8b-c2f77b7d88de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:14.113782 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9747e181-71de-426f-9f8b-c2f77b7d88de None admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:14.114091 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9747e181-71de-426f-9f8b-c2f77b7d88de None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:14.114367 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9747e181-71de-426f-9f8b-c2f77b7d88de None admin] PATH_INFO: `/v3/projects` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:14.115014 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9747e181-71de-426f-9f8b-c2f77b7d88de None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:14.116425 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9747e181-71de-426f-9f8b-c2f77b7d88de None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:14.140740 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 431/860] 10.222.0.25 () {60 vars in 1141 bytes} [Thu Oct 13 10:59:13 2022] POST /identity/v3/projects => generated 311 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 10:59:16.275319 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ffcd6a-823c-4cc6-85c9-bd288ebe8821 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:16.275879 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ffcd6a-823c-4cc6-85c9-bd288ebe8821 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:16.275879 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ffcd6a-823c-4cc6-85c9-bd288ebe8821 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:16.277185 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 430/861] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:59:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:59:16.282632 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff1d22-798f-4e0b-972e-50d5372774aa None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:16.283055 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff1d22-798f-4e0b-972e-50d5372774aa None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:16.283841 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff1d22-798f-4e0b-972e-50d5372774aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:16.301485 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-faff1d22-798f-4e0b-972e-50d5372774aa None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:59:16.302710 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-faff1d22-798f-4e0b-972e-50d5372774aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:59:16.366419 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 432/862] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:59:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 10:59:16.631362 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ffcd6a-823c-4cc6-85c9-bd288ebe8821 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:16.706125 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:16.727438 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ffcd6a-823c-4cc6-85c9-bd288ebe8821 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:16.758608 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249a95cd-0392-4eb8-b929-fc94a2d4429f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:16.759210 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a95cd-0392-4eb8-b929-fc94a2d4429f None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:16.759482 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a95cd-0392-4eb8-b929-fc94a2d4429f None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:16.759750 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a95cd-0392-4eb8-b929-fc94a2d4429f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:16.760819 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249a95cd-0392-4eb8-b929-fc94a2d4429f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:16.762254 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249a95cd-0392-4eb8-b929-fc94a2d4429f None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:16.763761 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 431/863] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 10:59:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:59:16.769769 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff1d22-798f-4e0b-972e-50d5372774aa None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:16.813464 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:16.865061 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff1d22-798f-4e0b-972e-50d5372774aa None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:16.899423 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e3b742-664f-4da9-9aea-a8a3ed2356c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:16.899965 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e3b742-664f-4da9-9aea-a8a3ed2356c9 None admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:16.900242 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e3b742-664f-4da9-9aea-a8a3ed2356c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:16.900514 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e3b742-664f-4da9-9aea-a8a3ed2356c9 None admin] PATH_INFO: `/v3/users` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:16.901167 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e3b742-664f-4da9-9aea-a8a3ed2356c9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:16.902615 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e3b742-664f-4da9-9aea-a8a3ed2356c9 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:16.923255 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 433/864] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Oct 13 10:59:16 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 10:59:19.082628 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153c20d-fda3-4897-b5b6-35f3d7b3a38f None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:19.083174 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153c20d-fda3-4897-b5b6-35f3d7b3a38f None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:19.083174 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153c20d-fda3-4897-b5b6-35f3d7b3a38f None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:19.084491 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 432/865] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:59:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:59:19.089686 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe61b328-7b7c-4bb6-b610-814eb0b21029 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:19.090106 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe61b328-7b7c-4bb6-b610-814eb0b21029 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:19.090263 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe61b328-7b7c-4bb6-b610-814eb0b21029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:19.108558 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-fe61b328-7b7c-4bb6-b610-814eb0b21029 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:59:19.109750 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-fe61b328-7b7c-4bb6-b610-814eb0b21029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:59:19.173571 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 434/866] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:59:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 10:59:19.446730 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7153c20d-fda3-4897-b5b6-35f3d7b3a38f None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:19.543868 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7153c20d-fda3-4897-b5b6-35f3d7b3a38f None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:19.575508 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fb1cb3-a0f8-42c6-bb79-3e5f5ce88cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:19.576115 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb1cb3-a0f8-42c6-bb79-3e5f5ce88cd1 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:19.576386 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb1cb3-a0f8-42c6-bb79-3e5f5ce88cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:19.576652 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb1cb3-a0f8-42c6-bb79-3e5f5ce88cd1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:19.586658 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fb1cb3-a0f8-42c6-bb79-3e5f5ce88cd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:59:19.591333 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-35fb1cb3-a0f8-42c6-bb79-3e5f5ce88cd1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 10:59:19.591333 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:59:19.591333 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:59:19.591333 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:59:19.591333 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:59:19.591333 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:59:19.591333 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:59:19.591333 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:59:19.591333 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:59:19.591333 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:59:19.591333 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:59:19.591333 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:59:19.591333 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:59:19.591333 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:59:19.591333 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:59:19.591333 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:59:19.592435 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:59:19.592435 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:59:19.592435 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:59:19.592435 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:59:19.592435 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:59:19.592435 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:59:19.592435 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:59:19.592435 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:59:19.592435 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:59:19.592435 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:59:19.592435 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:59:19.592435 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 10:59:19.592435 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:59:19.592435 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:59:19.592435 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:59:19.592435 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:59:19.593330 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:59:19.593330 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:59:19.593330 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:59:19.593330 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:59:19.593330 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:59:19.593330 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:59:19.593330 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:59:19.593330 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:59:19.593330 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:59:19.593330 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:59:19.593330 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 10:59:19.593330 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:59:19.593330 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 433/867] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Oct 13 10:59:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:59:19.598441 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe61b328-7b7c-4bb6-b610-814eb0b21029 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:19.627379 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:19.696319 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe61b328-7b7c-4bb6-b610-814eb0b21029 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:19.728283 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c613a8ed-d16b-43ab-afa3-b365ec9aa1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:19.728825 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c613a8ed-d16b-43ab-afa3-b365ec9aa1f7 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:19.729105 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c613a8ed-d16b-43ab-afa3-b365ec9aa1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:19.729376 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c613a8ed-d16b-43ab-afa3-b365ec9aa1f7 None admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:19.730070 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c613a8ed-d16b-43ab-afa3-b365ec9aa1f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:59:19.730383 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c613a8ed-d16b-43ab-afa3-b365ec9aa1f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:19.731734 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c613a8ed-d16b-43ab-afa3-b365ec9aa1f7 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:19.740183 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 435/868] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 10:59:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:59:19.746375 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fb1cb3-a0f8-42c6-bb79-3e5f5ce88cd1 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:19.755181 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:19.841003 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fb1cb3-a0f8-42c6-bb79-3e5f5ce88cd1 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:19.873273 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6830b98f-78db-443b-b354-3e02bd564e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:19.873884 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830b98f-78db-443b-b354-3e02bd564e05 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:19.874188 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830b98f-78db-443b-b354-3e02bd564e05 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:19.874462 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830b98f-78db-443b-b354-3e02bd564e05 None admin] PATH_INFO: `/v3/users/bec16b155df34653b2fffdbb51e9c8a9` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:19.887662 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6830b98f-78db-443b-b354-3e02bd564e05 None admin] RBAC: Authorizing `identity:get_user(user_id=bec16b155df34653b2fffdbb51e9c8a9)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:19.889098 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6830b98f-78db-443b-b354-3e02bd564e05 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:19.890754 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 434/869] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Oct 13 10:59:19 2022] GET /identity/v3/users/bec16b155df34653b2fffdbb51e9c8a9 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:59:19.896509 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c613a8ed-d16b-43ab-afa3-b365ec9aa1f7 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:19.983508 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:19.993323 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c613a8ed-d16b-43ab-afa3-b365ec9aa1f7 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:20.025139 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cfd6f3-09da-46f6-9742-4416939c45f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:20.025754 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cfd6f3-09da-46f6-9742-4416939c45f3 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:20.026124 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cfd6f3-09da-46f6-9742-4416939c45f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:20.026402 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cfd6f3-09da-46f6-9742-4416939c45f3 None admin] PATH_INFO: `/v3/projects/209ee74a12f3427da73aaa60377beb68` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:20.027503 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cfd6f3-09da-46f6-9742-4416939c45f3 None admin] RBAC: Authorizing `identity:get_project(project_id=209ee74a12f3427da73aaa60377beb68)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:20.028912 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cfd6f3-09da-46f6-9742-4416939c45f3 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:20.030548 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 436/870] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Oct 13 10:59:19 2022] GET /identity/v3/projects/209ee74a12f3427da73aaa60377beb68 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:59:20.036792 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6830b98f-78db-443b-b354-3e02bd564e05 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:20.094527 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:20.130754 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6830b98f-78db-443b-b354-3e02bd564e05 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:20.162911 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a000d70-e5b8-4d80-adcd-8e20a48bc579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:20.163550 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a000d70-e5b8-4d80-adcd-8e20a48bc579 None admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:20.163829 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a000d70-e5b8-4d80-adcd-8e20a48bc579 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:20.164105 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a000d70-e5b8-4d80-adcd-8e20a48bc579 None admin] PATH_INFO: `/v3/projects/209ee74a12f3427da73aaa60377beb68/users/bec16b155df34653b2fffdbb51e9c8a9/roles/ea564961b1db4eb4a1d4d880964611b2` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:20.166011 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a000d70-e5b8-4d80-adcd-8e20a48bc579 None admin] RBAC: Authorizing `identity:create_grant(project_id=209ee74a12f3427da73aaa60377beb68, user_id=bec16b155df34653b2fffdbb51e9c8a9, role_id=ea564961b1db4eb4a1d4d880964611b2)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:20.167434 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a000d70-e5b8-4d80-adcd-8e20a48bc579 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:20.180083 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 435/871] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Oct 13 10:59:20 2022] PUT /identity/v3/projects/209ee74a12f3427da73aaa60377beb68/users/bec16b155df34653b2fffdbb51e9c8a9/roles/ea564961b1db4eb4a1d4d880964611b2 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 10:59:22.260081 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdcd532-0b35-4521-b433-a3228ddde197 None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:22.260618 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdcd532-0b35-4521-b433-a3228ddde197 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:22.260618 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdcd532-0b35-4521-b433-a3228ddde197 None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:22.261964 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 437/872] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:59:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:59:22.267819 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f38341d-fec0-496f-9c32-86af196a8593 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:22.268253 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f38341d-fec0-496f-9c32-86af196a8593 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:22.268350 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f38341d-fec0-496f-9c32-86af196a8593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:22.286293 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-7f38341d-fec0-496f-9c32-86af196a8593 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:59:22.287464 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-7f38341d-fec0-496f-9c32-86af196a8593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:59:22.351033 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 436/873] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:59:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 10:59:22.615155 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdcd532-0b35-4521-b433-a3228ddde197 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:22.710861 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdcd532-0b35-4521-b433-a3228ddde197 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:22.743171 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd051d16-751b-476f-bb9e-1b96df0ea451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:22.743772 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd051d16-751b-476f-bb9e-1b96df0ea451 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:22.744047 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd051d16-751b-476f-bb9e-1b96df0ea451 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:22.744312 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd051d16-751b-476f-bb9e-1b96df0ea451 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:22.753789 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd051d16-751b-476f-bb9e-1b96df0ea451 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:59:22.758499 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-dd051d16-751b-476f-bb9e-1b96df0ea451 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 10:59:22.758499 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:59:22.758499 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:59:22.758499 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:59:22.758499 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:59:22.758499 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:59:22.758499 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:59:22.758499 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:59:22.758499 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:59:22.758499 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:59:22.758499 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:59:22.758499 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:59:22.758499 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:59:22.758499 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:59:22.758499 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:59:22.758499 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:59:22.759585 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:59:22.759585 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:59:22.759585 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:59:22.759585 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:59:22.759585 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:59:22.759585 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:59:22.759585 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:59:22.759585 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:59:22.759585 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:59:22.759585 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:59:22.759585 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:59:22.759585 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:59:22.759585 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:59:22.759585 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:59:22.759585 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:59:22.759585 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:59:22.760772 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:59:22.760772 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:59:22.760772 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:59:22.760772 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:59:22.760772 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:59:22.760772 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:59:22.760772 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:59:22.760772 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:59:22.760772 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:59:22.760772 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:59:22.760772 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 10:59:22.760772 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:59:22.760772 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 438/874] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Oct 13 10:59:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:59:22.765325 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f38341d-fec0-496f-9c32-86af196a8593 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:22.817529 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:22.860886 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f38341d-fec0-496f-9c32-86af196a8593 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:22.893663 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba05f1fb-2862-45e2-b4fe-4eaf7565f218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:22.894306 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba05f1fb-2862-45e2-b4fe-4eaf7565f218 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:22.894584 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba05f1fb-2862-45e2-b4fe-4eaf7565f218 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:22.894857 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba05f1fb-2862-45e2-b4fe-4eaf7565f218 None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:22.895512 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba05f1fb-2862-45e2-b4fe-4eaf7565f218 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:59:22.895815 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba05f1fb-2862-45e2-b4fe-4eaf7565f218 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:22.897177 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba05f1fb-2862-45e2-b4fe-4eaf7565f218 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:22.904958 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 437/875] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 10:59:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:59:22.911362 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd051d16-751b-476f-bb9e-1b96df0ea451 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:22.932597 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:23.007258 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd051d16-751b-476f-bb9e-1b96df0ea451 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:23.040154 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a937eb-616d-480b-86a7-0adfc61ce66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:23.040762 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a937eb-616d-480b-86a7-0adfc61ce66a None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:23.041038 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a937eb-616d-480b-86a7-0adfc61ce66a None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:23.041307 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a937eb-616d-480b-86a7-0adfc61ce66a None admin] PATH_INFO: `/v3/users/bec16b155df34653b2fffdbb51e9c8a9` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:23.042434 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a937eb-616d-480b-86a7-0adfc61ce66a None admin] RBAC: Authorizing `identity:get_user(user_id=bec16b155df34653b2fffdbb51e9c8a9)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:23.043839 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a937eb-616d-480b-86a7-0adfc61ce66a None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:23.045365 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 439/876] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Oct 13 10:59:22 2022] GET /identity/v3/users/bec16b155df34653b2fffdbb51e9c8a9 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:59:23.051215 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba05f1fb-2862-45e2-b4fe-4eaf7565f218 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:23.145990 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba05f1fb-2862-45e2-b4fe-4eaf7565f218 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:23.160634 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:23.177348 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefa44d8-8b25-4af7-83b4-03c4a71fd5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:23.177934 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa44d8-8b25-4af7-83b4-03c4a71fd5f6 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:23.178232 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa44d8-8b25-4af7-83b4-03c4a71fd5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:23.178499 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa44d8-8b25-4af7-83b4-03c4a71fd5f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:23.241338 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefa44d8-8b25-4af7-83b4-03c4a71fd5f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:23.242780 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefa44d8-8b25-4af7-83b4-03c4a71fd5f6 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:23.332959 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 438/877] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Oct 13 10:59:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 13 10:59:23.338845 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a937eb-616d-480b-86a7-0adfc61ce66a None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:23.421547 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:23.434320 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a937eb-616d-480b-86a7-0adfc61ce66a None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:23.466086 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c173dd-54b3-45ee-a696-447d4794caf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:23.466695 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c173dd-54b3-45ee-a696-447d4794caf0 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:23.466972 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c173dd-54b3-45ee-a696-447d4794caf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:23.467240 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c173dd-54b3-45ee-a696-447d4794caf0 None admin] PATH_INFO: `/v3/projects/209ee74a12f3427da73aaa60377beb68` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:23.468333 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c173dd-54b3-45ee-a696-447d4794caf0 None admin] RBAC: Authorizing `identity:get_project(project_id=209ee74a12f3427da73aaa60377beb68)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:23.469741 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c173dd-54b3-45ee-a696-447d4794caf0 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:23.471952 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 440/878] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Oct 13 10:59:23 2022] GET /identity/v3/projects/209ee74a12f3427da73aaa60377beb68 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:59:23.477834 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefa44d8-8b25-4af7-83b4-03c4a71fd5f6 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:23.494522 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:23.571048 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefa44d8-8b25-4af7-83b4-03c4a71fd5f6 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:23.603376 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f597d7b5-cd93-4fef-b090-b3aa61f75226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:23.603958 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597d7b5-cd93-4fef-b090-b3aa61f75226 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:23.604235 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597d7b5-cd93-4fef-b090-b3aa61f75226 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:23.604505 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597d7b5-cd93-4fef-b090-b3aa61f75226 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:23.605216 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f597d7b5-cd93-4fef-b090-b3aa61f75226 None admin] RBAC: Adding query filter params (role.id=ea564961b1db4eb4a1d4d880964611b2, scope.project.id=209ee74a12f3427da73aaa60377beb68, user.id=bec16b155df34653b2fffdbb51e9c8a9) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:59:23.605524 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f597d7b5-cd93-4fef-b090-b3aa61f75226 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:23.606946 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f597d7b5-cd93-4fef-b090-b3aa61f75226 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:23.612707 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 439/879] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Oct 13 10:59:23 2022] GET /identity/v3/role_assignments?user.id=bec16b155df34653b2fffdbb51e9c8a9&scope.project.id=209ee74a12f3427da73aaa60377beb68&role.id=ea564961b1db4eb4a1d4d880964611b2 => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:59:25.723528 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aac933-a9b2-4f90-9e1a-de0d50d3db1e None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:25.724086 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aac933-a9b2-4f90-9e1a-de0d50d3db1e None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:25.724086 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aac933-a9b2-4f90-9e1a-de0d50d3db1e None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:25.725388 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 441/880] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:59:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:59:25.730731 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5c29f-a9c3-4a92-becd-1b12c677714f None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:25.731103 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5c29f-a9c3-4a92-becd-1b12c677714f None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:25.731279 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5c29f-a9c3-4a92-becd-1b12c677714f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:25.748972 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-79c5c29f-a9c3-4a92-becd-1b12c677714f None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:59:25.750173 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-79c5c29f-a9c3-4a92-becd-1b12c677714f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:59:25.813361 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 440/881] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:59:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 10:59:26.085933 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aac933-a9b2-4f90-9e1a-de0d50d3db1e None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:26.183650 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aac933-a9b2-4f90-9e1a-de0d50d3db1e None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:26.215794 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86911f35-d800-4670-82b5-6ed2ec20bc59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:26.216392 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86911f35-d800-4670-82b5-6ed2ec20bc59 None admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:26.216673 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86911f35-d800-4670-82b5-6ed2ec20bc59 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:26.216945 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86911f35-d800-4670-82b5-6ed2ec20bc59 None admin] PATH_INFO: `/v3/domains` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:26.217622 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86911f35-d800-4670-82b5-6ed2ec20bc59 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:26.219000 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86911f35-d800-4670-82b5-6ed2ec20bc59 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:26.234798 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 442/882] 10.222.0.25 () {60 vars in 1138 bytes} [Thu Oct 13 10:59:26 2022] POST /identity/v3/domains => generated 267 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 10:59:28.387269 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3edac61-fb61-43ff-b31b-bcae726f6e6f None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:28.387862 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3edac61-fb61-43ff-b31b-bcae726f6e6f None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:28.387862 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3edac61-fb61-43ff-b31b-bcae726f6e6f None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:28.389122 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 441/883] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:59:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:59:28.394398 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528e1e5-be3b-4461-b308-92bfdd6ec588 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:28.394832 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528e1e5-be3b-4461-b308-92bfdd6ec588 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:28.394941 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528e1e5-be3b-4461-b308-92bfdd6ec588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:28.412961 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-a528e1e5-be3b-4461-b308-92bfdd6ec588 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:59:28.414169 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-a528e1e5-be3b-4461-b308-92bfdd6ec588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:59:28.424914 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:28.478442 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 443/884] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:59:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 10:59:28.742071 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3edac61-fb61-43ff-b31b-bcae726f6e6f None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:28.753966 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:28.839773 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3edac61-fb61-43ff-b31b-bcae726f6e6f None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:28.872190 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd23290-dea5-499f-a01b-6c0e965ea05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:28.872803 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd23290-dea5-499f-a01b-6c0e965ea05c None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:28.873080 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd23290-dea5-499f-a01b-6c0e965ea05c None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:28.873354 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd23290-dea5-499f-a01b-6c0e965ea05c None admin] PATH_INFO: `/v3/domains/06846aa0261f459a97b3b7661876edd2` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:28.883473 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd23290-dea5-499f-a01b-6c0e965ea05c None admin] RBAC: Authorizing `identity:get_domain(domain_id=06846aa0261f459a97b3b7661876edd2)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:28.884910 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd23290-dea5-499f-a01b-6c0e965ea05c None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:28.886527 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 442/885] 10.222.0.25 () {56 vars in 1183 bytes} [Thu Oct 13 10:59:28 2022] GET /identity/v3/domains/06846aa0261f459a97b3b7661876edd2 => generated 267 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:59:28.892748 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a528e1e5-be3b-4461-b308-92bfdd6ec588 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:28.986537 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a528e1e5-be3b-4461-b308-92bfdd6ec588 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:29.019084 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c1521-ea92-4fad-ae37-f9d87b73c02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:29.019620 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c1521-ea92-4fad-ae37-f9d87b73c02e None admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:29.019900 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c1521-ea92-4fad-ae37-f9d87b73c02e None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:29.020174 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c1521-ea92-4fad-ae37-f9d87b73c02e None admin] PATH_INFO: `/v3/projects` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:29.020825 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479c1521-ea92-4fad-ae37-f9d87b73c02e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:29.022262 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479c1521-ea92-4fad-ae37-f9d87b73c02e None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:29.042750 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:29.050745 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 444/886] 10.222.0.25 () {60 vars in 1141 bytes} [Thu Oct 13 10:59:28 2022] POST /identity/v3/projects => generated 361 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 10:59:31.214795 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b56c6-dc61-494f-a53a-3d25503f877e None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:31.215315 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b56c6-dc61-494f-a53a-3d25503f877e None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:31.215428 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b56c6-dc61-494f-a53a-3d25503f877e None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:31.216681 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 443/887] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:59:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:59:31.222485 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c315207-6884-4493-9483-c6cdc2e348dc None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:31.222940 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c315207-6884-4493-9483-c6cdc2e348dc None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:31.223038 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c315207-6884-4493-9483-c6cdc2e348dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:31.241048 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-7c315207-6884-4493-9483-c6cdc2e348dc None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:59:31.242259 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-7c315207-6884-4493-9483-c6cdc2e348dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:59:31.306005 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 445/888] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:59:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 10:59:31.583904 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503b56c6-dc61-494f-a53a-3d25503f877e None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:31.651115 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:31.683102 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503b56c6-dc61-494f-a53a-3d25503f877e None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:31.714546 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9474e0db-3b0e-43e6-911f-5c17998e5320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:31.715168 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474e0db-3b0e-43e6-911f-5c17998e5320 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:31.715453 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474e0db-3b0e-43e6-911f-5c17998e5320 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:31.715726 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474e0db-3b0e-43e6-911f-5c17998e5320 None admin] PATH_INFO: `/v3/domains/06846aa0261f459a97b3b7661876edd2` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:31.716854 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9474e0db-3b0e-43e6-911f-5c17998e5320 None admin] RBAC: Authorizing `identity:get_domain(domain_id=06846aa0261f459a97b3b7661876edd2)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:31.718436 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9474e0db-3b0e-43e6-911f-5c17998e5320 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:31.719938 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 444/889] 10.222.0.25 () {56 vars in 1183 bytes} [Thu Oct 13 10:59:31 2022] GET /identity/v3/domains/06846aa0261f459a97b3b7661876edd2 => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:59:31.726179 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c315207-6884-4493-9483-c6cdc2e348dc None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:31.818152 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c315207-6884-4493-9483-c6cdc2e348dc None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:31.843096 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:31.850899 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e9cfa0-183e-433f-ab79-606ac1e28cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:31.851488 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9cfa0-183e-433f-ab79-606ac1e28cdb None admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:31.851765 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9cfa0-183e-433f-ab79-606ac1e28cdb None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:31.852034 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9cfa0-183e-433f-ab79-606ac1e28cdb None admin] PATH_INFO: `/v3/users` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:31.852669 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e9cfa0-183e-433f-ab79-606ac1e28cdb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:31.854102 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e9cfa0-183e-433f-ab79-606ac1e28cdb None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:31.874421 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 446/890] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Oct 13 10:59:31 2022] POST /identity/v3/users => generated 311 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 10:59:34.008771 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93104d3-1b6c-405a-98db-26e6ecb1c420 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:34.009298 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93104d3-1b6c-405a-98db-26e6ecb1c420 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:34.009298 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93104d3-1b6c-405a-98db-26e6ecb1c420 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:34.010660 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 445/891] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:59:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:59:34.015671 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e27d13-104a-4241-b746-22c028df4adc None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:34.016057 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e27d13-104a-4241-b746-22c028df4adc None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:34.016220 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e27d13-104a-4241-b746-22c028df4adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:34.034925 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-44e27d13-104a-4241-b746-22c028df4adc None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:59:34.036097 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-44e27d13-104a-4241-b746-22c028df4adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:59:34.100151 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 447/892] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:59:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 10:59:34.368348 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93104d3-1b6c-405a-98db-26e6ecb1c420 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:34.464615 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93104d3-1b6c-405a-98db-26e6ecb1c420 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:34.495430 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd4e4a7-d46b-4723-9574-ed9d85ee2329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:34.496035 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd4e4a7-d46b-4723-9574-ed9d85ee2329 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:34.496308 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd4e4a7-d46b-4723-9574-ed9d85ee2329 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:34.496577 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd4e4a7-d46b-4723-9574-ed9d85ee2329 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:34.503376 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:34.507940 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd4e4a7-d46b-4723-9574-ed9d85ee2329 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:59:34.513493 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-9fd4e4a7-d46b-4723-9574-ed9d85ee2329 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 10:59:34.513493 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:59:34.513493 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:59:34.513493 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:59:34.513493 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:59:34.513493 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:59:34.513493 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:59:34.513493 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:59:34.513493 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:59:34.513493 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:59:34.513493 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:59:34.513493 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:59:34.513493 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:59:34.513493 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:59:34.513493 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:59:34.513493 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:59:34.518129 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:59:34.518129 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:59:34.518129 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:59:34.518129 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:59:34.518129 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:59:34.518129 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:59:34.518129 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:59:34.518129 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:59:34.518129 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:59:34.518129 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:59:34.518129 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:59:34.518129 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 10:59:34.518129 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:59:34.518129 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:59:34.518129 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:59:34.518129 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:59:34.519240 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:59:34.519240 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:59:34.519240 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:59:34.519240 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:59:34.519240 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:59:34.519240 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:59:34.519240 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:59:34.519240 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:59:34.519240 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:59:34.519240 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:59:34.519240 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 10:59:34.519240 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 10:59:34.519240 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 446/893] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Oct 13 10:59:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:59:34.521080 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e27d13-104a-4241-b746-22c028df4adc None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:34.614757 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e27d13-104a-4241-b746-22c028df4adc None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:34.628403 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:34.648672 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5721dcb8-f577-4ca5-85a3-164a7c98a21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:34.649264 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5721dcb8-f577-4ca5-85a3-164a7c98a21a None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:34.649542 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5721dcb8-f577-4ca5-85a3-164a7c98a21a None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:34.649816 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5721dcb8-f577-4ca5-85a3-164a7c98a21a None admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:34.650512 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5721dcb8-f577-4ca5-85a3-164a7c98a21a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:59:34.650810 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5721dcb8-f577-4ca5-85a3-164a7c98a21a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:34.652150 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5721dcb8-f577-4ca5-85a3-164a7c98a21a None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:34.659800 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 448/894] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 10:59:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:59:34.665386 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd4e4a7-d46b-4723-9574-ed9d85ee2329 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:34.761899 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd4e4a7-d46b-4723-9574-ed9d85ee2329 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:34.792810 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554e847b-1cd6-477b-adee-f4c9d7e22b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:34.793419 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e847b-1cd6-477b-adee-f4c9d7e22b70 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:34.793696 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e847b-1cd6-477b-adee-f4c9d7e22b70 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:34.793994 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e847b-1cd6-477b-adee-f4c9d7e22b70 None admin] PATH_INFO: `/v3/users/e4b7d74d9ee54dc7863b068d693d461c` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:34.806803 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554e847b-1cd6-477b-adee-f4c9d7e22b70 None admin] RBAC: Authorizing `identity:get_user(user_id=e4b7d74d9ee54dc7863b068d693d461c)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:34.808220 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554e847b-1cd6-477b-adee-f4c9d7e22b70 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:34.809770 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 447/895] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Oct 13 10:59:34 2022] GET /identity/v3/users/e4b7d74d9ee54dc7863b068d693d461c => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:59:34.815926 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5721dcb8-f577-4ca5-85a3-164a7c98a21a None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:34.909870 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5721dcb8-f577-4ca5-85a3-164a7c98a21a None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:34.941995 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573b0299-12a0-47be-b14f-d7efdc55f41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:34.942608 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b0299-12a0-47be-b14f-d7efdc55f41e None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:34.942885 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b0299-12a0-47be-b14f-d7efdc55f41e None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:34.943155 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b0299-12a0-47be-b14f-d7efdc55f41e None admin] PATH_INFO: `/v3/projects/7c824f34c62e44108e3aba1944cd6147` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:34.944252 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573b0299-12a0-47be-b14f-d7efdc55f41e None admin] RBAC: Authorizing `identity:get_project(project_id=7c824f34c62e44108e3aba1944cd6147)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:34.945656 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573b0299-12a0-47be-b14f-d7efdc55f41e None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:34.947258 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 449/896] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Oct 13 10:59:34 2022] GET /identity/v3/projects/7c824f34c62e44108e3aba1944cd6147 => generated 361 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:59:34.953051 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554e847b-1cd6-477b-adee-f4c9d7e22b70 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:35.006429 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:35.047819 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554e847b-1cd6-477b-adee-f4c9d7e22b70 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:35.081515 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d05298-c9e8-468b-b515-8f775cdab360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:35.082174 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d05298-c9e8-468b-b515-8f775cdab360 None admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:35.082449 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d05298-c9e8-468b-b515-8f775cdab360 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:35.082727 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d05298-c9e8-468b-b515-8f775cdab360 None admin] PATH_INFO: `/v3/projects/7c824f34c62e44108e3aba1944cd6147/users/e4b7d74d9ee54dc7863b068d693d461c/roles/ea564961b1db4eb4a1d4d880964611b2` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:35.084571 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d05298-c9e8-468b-b515-8f775cdab360 None admin] RBAC: Authorizing `identity:create_grant(project_id=7c824f34c62e44108e3aba1944cd6147, user_id=e4b7d74d9ee54dc7863b068d693d461c, role_id=ea564961b1db4eb4a1d4d880964611b2)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:35.085996 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d05298-c9e8-468b-b515-8f775cdab360 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:35.097751 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 448/897] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Oct 13 10:59:34 2022] PUT /identity/v3/projects/7c824f34c62e44108e3aba1944cd6147/users/e4b7d74d9ee54dc7863b068d693d461c/roles/ea564961b1db4eb4a1d4d880964611b2 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 10:59:37.185718 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc597a18-5603-4059-9948-77f84e9432cf None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:37.186281 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc597a18-5603-4059-9948-77f84e9432cf None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:37.186281 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc597a18-5603-4059-9948-77f84e9432cf None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:37.187615 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 450/898] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 10:59:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:59:37.192953 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc1a3ff-c943-477e-9a48-b3f39e225750 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:37.193338 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc1a3ff-c943-477e-9a48-b3f39e225750 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:37.193501 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc1a3ff-c943-477e-9a48-b3f39e225750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:37.211492 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-fdc1a3ff-c943-477e-9a48-b3f39e225750 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:59:37.212661 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-fdc1a3ff-c943-477e-9a48-b3f39e225750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:59:37.274820 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 449/899] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 10:59:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 10:59:37.539861 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc597a18-5603-4059-9948-77f84e9432cf None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:37.584646 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:37.637998 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc597a18-5603-4059-9948-77f84e9432cf None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:37.670205 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b10f4-6f34-48bb-9594-35ba083f9560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:37.670807 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b10f4-6f34-48bb-9594-35ba083f9560 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:37.671084 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b10f4-6f34-48bb-9594-35ba083f9560 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:37.671356 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b10f4-6f34-48bb-9594-35ba083f9560 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:37.681458 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1b10f4-6f34-48bb-9594-35ba083f9560 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:59:37.686201 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-7d1b10f4-6f34-48bb-9594-35ba083f9560 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 10:59:37.686201 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:59:37.686201 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:59:37.686201 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:59:37.686201 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:59:37.686201 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:59:37.686201 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:59:37.686201 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:59:37.686201 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:59:37.686201 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:59:37.686201 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:59:37.686201 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:59:37.686201 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:59:37.686201 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:59:37.686201 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:59:37.686201 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:59:37.687279 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:59:37.687279 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:59:37.687279 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:59:37.687279 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:59:37.687279 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:59:37.687279 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:59:37.687279 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:59:37.687279 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:59:37.687279 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:59:37.687279 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:59:37.687279 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:59:37.687279 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 10:59:37.687279 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:59:37.687279 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:59:37.687279 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:59:37.687279 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:59:37.688280 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:59:37.688280 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:59:37.688280 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:59:37.688280 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:59:37.688280 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:59:37.688280 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:59:37.688280 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:59:37.688280 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:59:37.688280 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:59:37.688280 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:59:37.688280 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 10:59:37.688280 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 10:59:37.688280 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 451/900] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Oct 13 10:59:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:59:37.693767 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc1a3ff-c943-477e-9a48-b3f39e225750 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:37.737024 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:37.787397 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc1a3ff-c943-477e-9a48-b3f39e225750 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:37.820653 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceadac3d-7949-46cc-b9c1-995694b6e816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:37.821176 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceadac3d-7949-46cc-b9c1-995694b6e816 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:37.821449 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceadac3d-7949-46cc-b9c1-995694b6e816 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:37.821712 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceadac3d-7949-46cc-b9c1-995694b6e816 None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:37.822388 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceadac3d-7949-46cc-b9c1-995694b6e816 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:59:37.822682 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceadac3d-7949-46cc-b9c1-995694b6e816 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:37.824020 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceadac3d-7949-46cc-b9c1-995694b6e816 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:37.831566 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 450/901] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 10:59:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:59:37.837393 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b10f4-6f34-48bb-9594-35ba083f9560 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:37.932960 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b10f4-6f34-48bb-9594-35ba083f9560 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:37.935184 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:37.965759 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3a027b-d0db-49c4-aa2f-f7fadcf7c9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:37.966401 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3a027b-d0db-49c4-aa2f-f7fadcf7c9e9 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:37.966675 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3a027b-d0db-49c4-aa2f-f7fadcf7c9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:37.966942 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3a027b-d0db-49c4-aa2f-f7fadcf7c9e9 None admin] PATH_INFO: `/v3/users/e4b7d74d9ee54dc7863b068d693d461c` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:37.968034 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3a027b-d0db-49c4-aa2f-f7fadcf7c9e9 None admin] RBAC: Authorizing `identity:get_user(user_id=e4b7d74d9ee54dc7863b068d693d461c)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:37.969443 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3a027b-d0db-49c4-aa2f-f7fadcf7c9e9 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:37.971574 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 452/902] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Oct 13 10:59:37 2022] GET /identity/v3/users/e4b7d74d9ee54dc7863b068d693d461c => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:59:37.977287 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceadac3d-7949-46cc-b9c1-995694b6e816 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:38.071483 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceadac3d-7949-46cc-b9c1-995694b6e816 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:38.079691 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:38.104889 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d13937-9f51-4530-9885-cf482cbb1a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:38.105476 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d13937-9f51-4530-9885-cf482cbb1a5a None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:38.105748 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d13937-9f51-4530-9885-cf482cbb1a5a None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:38.106057 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d13937-9f51-4530-9885-cf482cbb1a5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:38.168642 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d13937-9f51-4530-9885-cf482cbb1a5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:38.170074 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d13937-9f51-4530-9885-cf482cbb1a5a None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:38.261483 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 451/903] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Oct 13 10:59:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 13 10:59:38.267252 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3a027b-d0db-49c4-aa2f-f7fadcf7c9e9 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:38.361807 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3a027b-d0db-49c4-aa2f-f7fadcf7c9e9 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:38.393845 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cb20aa-14bd-4521-bfb4-b0614337b872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:38.394492 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb20aa-14bd-4521-bfb4-b0614337b872 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:38.394769 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb20aa-14bd-4521-bfb4-b0614337b872 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:38.395041 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb20aa-14bd-4521-bfb4-b0614337b872 None admin] PATH_INFO: `/v3/projects/7c824f34c62e44108e3aba1944cd6147` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:38.396152 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cb20aa-14bd-4521-bfb4-b0614337b872 None admin] RBAC: Authorizing `identity:get_project(project_id=7c824f34c62e44108e3aba1944cd6147)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:38.397572 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cb20aa-14bd-4521-bfb4-b0614337b872 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:38.399211 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 453/904] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Oct 13 10:59:38 2022] GET /identity/v3/projects/7c824f34c62e44108e3aba1944cd6147 => generated 361 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:59:38.405311 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d13937-9f51-4530-9885-cf482cbb1a5a None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:38.415502 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:38.499571 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d13937-9f51-4530-9885-cf482cbb1a5a None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:38.531769 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ded152-41d3-4f79-bf93-7f836ee2e52e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:38.532372 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ded152-41d3-4f79-bf93-7f836ee2e52e None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:38.533209 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ded152-41d3-4f79-bf93-7f836ee2e52e None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:38.533480 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ded152-41d3-4f79-bf93-7f836ee2e52e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:38.534217 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ded152-41d3-4f79-bf93-7f836ee2e52e None admin] RBAC: Adding query filter params (role.id=ea564961b1db4eb4a1d4d880964611b2, scope.project.id=7c824f34c62e44108e3aba1944cd6147, user.id=e4b7d74d9ee54dc7863b068d693d461c) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:59:38.534523 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ded152-41d3-4f79-bf93-7f836ee2e52e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:38.535921 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ded152-41d3-4f79-bf93-7f836ee2e52e None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:38.541393 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 452/905] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Oct 13 10:59:38 2022] GET /identity/v3/role_assignments?user.id=e4b7d74d9ee54dc7863b068d693d461c&scope.project.id=7c824f34c62e44108e3aba1944cd6147&role.id=ea564961b1db4eb4a1d4d880964611b2 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:59:48.389771 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=80 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:48.538896 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=64 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:00:33.293307 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ab72a-6e25-46a4-9dd6-8be69fd7af1c None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:33.293919 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ab72a-6e25-46a4-9dd6-8be69fd7af1c None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:33.293919 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ab72a-6e25-46a4-9dd6-8be69fd7af1c None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:33.295654 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 454/906] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 11:00:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:00:33.301510 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da972d-5fbb-4d36-bc92-625eaa9970dc None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:33.302113 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da972d-5fbb-4d36-bc92-625eaa9970dc None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:33.302113 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da972d-5fbb-4d36-bc92-625eaa9970dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:33.323092 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-d1da972d-5fbb-4d36-bc92-625eaa9970dc None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:00:33.324322 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-d1da972d-5fbb-4d36-bc92-625eaa9970dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:00:33.416530 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 453/907] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 11:00:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 11:00:33.712935 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68ab72a-6e25-46a4-9dd6-8be69fd7af1c None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:33.830602 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68ab72a-6e25-46a4-9dd6-8be69fd7af1c None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:33.874404 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d19c79c-cd1e-4025-a4e6-df0df858da51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:33.875554 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19c79c-cd1e-4025-a4e6-df0df858da51 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:33.876021 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19c79c-cd1e-4025-a4e6-df0df858da51 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:33.876454 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19c79c-cd1e-4025-a4e6-df0df858da51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:33.891265 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d19c79c-cd1e-4025-a4e6-df0df858da51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:33.892740 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d19c79c-cd1e-4025-a4e6-df0df858da51 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:33.915180 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-1d19c79c-cd1e-4025-a4e6-df0df858da51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 11:00:33.915180 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 11:00:33.915180 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 11:00:33.915180 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 11:00:33.915180 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 11:00:33.915180 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 11:00:33.915180 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 11:00:33.915180 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 11:00:33.915180 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 11:00:33.915180 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 11:00:33.915180 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 11:00:33.915180 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 11:00:33.915180 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 11:00:33.915180 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 11:00:33.915180 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 11:00:33.915180 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 11:00:33.918255 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 11:00:33.918255 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 11:00:33.918255 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 11:00:33.918255 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 11:00:33.918255 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 11:00:33.918255 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 11:00:33.918255 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 11:00:33.918255 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 11:00:33.918255 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 11:00:33.918255 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 11:00:33.918255 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 11:00:33.918255 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 11:00:33.918255 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 11:00:33.918255 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 11:00:33.918255 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 11:00:33.918255 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 11:00:33.918255 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 11:00:33.919662 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 11:00:33.919662 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 11:00:33.919662 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 11:00:33.919662 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 455/908] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 11:00:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 11:00:33.924275 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da972d-5fbb-4d36-bc92-625eaa9970dc None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:34.076651 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da972d-5fbb-4d36-bc92-625eaa9970dc None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:34.117081 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:00:34.126073 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac7c72b-73b0-490c-945f-cd3a70bb89d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:34.126718 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac7c72b-73b0-490c-945f-cd3a70bb89d3 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:34.126983 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac7c72b-73b0-490c-945f-cd3a70bb89d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:34.127257 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac7c72b-73b0-490c-945f-cd3a70bb89d3 None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:34.127908 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac7c72b-73b0-490c-945f-cd3a70bb89d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:00:34.128221 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac7c72b-73b0-490c-945f-cd3a70bb89d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:34.129716 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac7c72b-73b0-490c-945f-cd3a70bb89d3 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:34.145991 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 454/909] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 11:00:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 11:00:34.150041 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d19c79c-cd1e-4025-a4e6-df0df858da51 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:34.220703 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:00:34.282021 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d19c79c-cd1e-4025-a4e6-df0df858da51 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:34.318234 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e8f014-0428-4359-a519-de9743215bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:34.318950 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8f014-0428-4359-a519-de9743215bf0 None admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:34.319242 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8f014-0428-4359-a519-de9743215bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:34.319517 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8f014-0428-4359-a519-de9743215bf0 None admin] PATH_INFO: `/v3/users` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:34.320196 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e8f014-0428-4359-a519-de9743215bf0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:34.321683 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e8f014-0428-4359-a519-de9743215bf0 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:34.351501 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 456/910] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Oct 13 11:00:34 2022] POST /identity/v3/users => generated 251 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:00:36.868819 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db320b-2abd-4cf7-b3b2-64e34d0e4ac7 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:36.869505 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db320b-2abd-4cf7-b3b2-64e34d0e4ac7 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:36.869505 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db320b-2abd-4cf7-b3b2-64e34d0e4ac7 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:36.870991 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 455/911] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 11:00:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:00:36.879233 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb2bb7-6519-42a2-8219-ec54f58d38fc None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:36.879233 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb2bb7-6519-42a2-8219-ec54f58d38fc None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:36.879233 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb2bb7-6519-42a2-8219-ec54f58d38fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:36.898856 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-22bb2bb7-6519-42a2-8219-ec54f58d38fc None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:00:36.900068 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-22bb2bb7-6519-42a2-8219-ec54f58d38fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:00:36.983101 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 457/912] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 11:00:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 11:00:37.284189 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7db320b-2abd-4cf7-b3b2-64e34d0e4ac7 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:37.409510 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7db320b-2abd-4cf7-b3b2-64e34d0e4ac7 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:37.449116 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48a7ba4-4f10-4449-9a6d-3ec72b619c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:37.449758 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a7ba4-4f10-4449-9a6d-3ec72b619c52 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:37.450052 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a7ba4-4f10-4449-9a6d-3ec72b619c52 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:37.450326 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a7ba4-4f10-4449-9a6d-3ec72b619c52 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:37.464340 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48a7ba4-4f10-4449-9a6d-3ec72b619c52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 11:00:37.469586 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-e48a7ba4-4f10-4449-9a6d-3ec72b619c52 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 13 11:00:37.469586 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 11:00:37.469586 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 11:00:37.469586 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 11:00:37.469586 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 11:00:37.469586 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 11:00:37.469586 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 11:00:37.469586 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 11:00:37.469586 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 11:00:37.469586 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 11:00:37.469586 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 11:00:37.469586 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 11:00:37.469586 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 11:00:37.469586 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 11:00:37.469586 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 11:00:37.469586 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 11:00:37.470717 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 11:00:37.470717 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 11:00:37.470717 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 11:00:37.470717 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 11:00:37.470717 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 11:00:37.470717 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 11:00:37.470717 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 11:00:37.470717 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 11:00:37.470717 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 11:00:37.470717 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 11:00:37.470717 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 11:00:37.470717 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 11:00:37.470717 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 11:00:37.470717 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 11:00:37.470717 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 11:00:37.470717 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 11:00:37.471568 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 11:00:37.471568 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 11:00:37.471568 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 11:00:37.471568 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 11:00:37.471568 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 11:00:37.471568 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 11:00:37.471568 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 11:00:37.471568 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 11:00:37.471568 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 11:00:37.471568 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 11:00:37.471568 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 13 11:00:37.471568 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 11:00:37.477420 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb2bb7-6519-42a2-8219-ec54f58d38fc None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:37.478150 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 456/913] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Oct 13 11:00:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 11:00:37.524586 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:00:37.601578 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb2bb7-6519-42a2-8219-ec54f58d38fc None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:37.641575 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0e8621-cb37-4a98-a1df-53b8beaae988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:37.642400 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e8621-cb37-4a98-a1df-53b8beaae988 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:37.642983 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e8621-cb37-4a98-a1df-53b8beaae988 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:37.643079 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e8621-cb37-4a98-a1df-53b8beaae988 None admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:37.643701 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0e8621-cb37-4a98-a1df-53b8beaae988 None admin] RBAC: Adding query filter params (name=service) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:00:37.644008 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0e8621-cb37-4a98-a1df-53b8beaae988 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:37.645463 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0e8621-cb37-4a98-a1df-53b8beaae988 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:37.654249 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 458/914] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Oct 13 11:00:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:00:37.660312 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48a7ba4-4f10-4449-9a6d-3ec72b619c52 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:37.717611 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:00:37.805764 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48a7ba4-4f10-4449-9a6d-3ec72b619c52 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:37.864876 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7601b4bf-cc2d-4e98-843e-b9a09af7990a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:37.866082 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601b4bf-cc2d-4e98-843e-b9a09af7990a None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:37.866545 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601b4bf-cc2d-4e98-843e-b9a09af7990a None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:37.867012 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601b4bf-cc2d-4e98-843e-b9a09af7990a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:37.885771 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7601b4bf-cc2d-4e98-843e-b9a09af7990a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:37.888930 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7601b4bf-cc2d-4e98-843e-b9a09af7990a None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:37.912336 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-7601b4bf-cc2d-4e98-843e-b9a09af7990a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 11:00:37.912336 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 11:00:37.912336 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 11:00:37.912336 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 11:00:37.912336 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 11:00:37.912336 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 11:00:37.912336 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 11:00:37.912336 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 11:00:37.912336 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 11:00:37.912336 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 11:00:37.912336 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 11:00:37.912336 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 11:00:37.912336 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 11:00:37.912336 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 11:00:37.912336 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 11:00:37.912336 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 11:00:37.913381 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 11:00:37.913381 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 11:00:37.913381 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 11:00:37.913381 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 11:00:37.913381 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 11:00:37.913381 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 11:00:37.913381 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 11:00:37.913381 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 11:00:37.913381 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 11:00:37.913381 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 11:00:37.913381 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 11:00:37.913381 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 11:00:37.913381 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 11:00:37.913381 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 11:00:37.913381 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 11:00:37.913381 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 11:00:37.913381 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 11:00:37.914308 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 11:00:37.914308 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 11:00:37.914308 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 11:00:37.918215 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 457/915] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 11:00:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 11:00:37.920108 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0e8621-cb37-4a98-a1df-53b8beaae988 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:38.034243 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:00:38.038418 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0e8621-cb37-4a98-a1df-53b8beaae988 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:38.081907 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cc71c1-75a3-49f8-81b3-5b85896dea34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:38.082549 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc71c1-75a3-49f8-81b3-5b85896dea34 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:38.082829 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc71c1-75a3-49f8-81b3-5b85896dea34 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:38.083110 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc71c1-75a3-49f8-81b3-5b85896dea34 None admin] PATH_INFO: `/v3/domains` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:38.083746 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cc71c1-75a3-49f8-81b3-5b85896dea34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:00:38.084049 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cc71c1-75a3-49f8-81b3-5b85896dea34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:38.085468 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cc71c1-75a3-49f8-81b3-5b85896dea34 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:38.098545 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 459/916] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 11:00:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:00:38.103988 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7601b4bf-cc2d-4e98-843e-b9a09af7990a None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:38.214525 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7601b4bf-cc2d-4e98-843e-b9a09af7990a None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:38.216038 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:00:38.251938 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee4eed4-cb37-4846-8399-ae97d410b352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:38.252615 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee4eed4-cb37-4846-8399-ae97d410b352 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:38.252907 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee4eed4-cb37-4846-8399-ae97d410b352 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:38.253146 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee4eed4-cb37-4846-8399-ae97d410b352 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:38.261089 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee4eed4-cb37-4846-8399-ae97d410b352 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:38.262618 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee4eed4-cb37-4846-8399-ae97d410b352 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:38.274463 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-bee4eed4-cb37-4846-8399-ae97d410b352 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 13 11:00:38.274463 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 11:00:38.274463 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 11:00:38.274463 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 11:00:38.274463 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 11:00:38.274463 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 11:00:38.274463 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 11:00:38.274463 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 11:00:38.274463 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 11:00:38.274463 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 11:00:38.274463 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 11:00:38.274463 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 11:00:38.274463 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 11:00:38.274463 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 11:00:38.274463 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 11:00:38.274463 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 11:00:38.275755 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 11:00:38.275755 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 11:00:38.275755 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 11:00:38.275755 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 11:00:38.275755 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 11:00:38.275755 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 11:00:38.275755 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 11:00:38.275755 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 11:00:38.275755 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 11:00:38.275755 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 11:00:38.275755 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 11:00:38.275755 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 11:00:38.275755 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 11:00:38.275755 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 11:00:38.275755 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 11:00:38.275755 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 11:00:38.275755 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 11:00:38.275755 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 11:00:38.276872 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 11:00:38.276872 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 11:00:38.276872 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 11:00:38.276872 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 11:00:38.276872 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 11:00:38.276872 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 11:00:38.276872 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 11:00:38.276872 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 11:00:38.276872 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 13 11:00:38.276872 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 11:00:38.282099 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cc71c1-75a3-49f8-81b3-5b85896dea34 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:38.282331 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 458/917] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 11:00:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 11:00:38.387768 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cc71c1-75a3-49f8-81b3-5b85896dea34 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:38.423794 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132d22fd-db85-4e54-b40b-04fdb1b12fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:38.424432 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d22fd-db85-4e54-b40b-04fdb1b12fc1 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:38.424711 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d22fd-db85-4e54-b40b-04fdb1b12fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:38.425026 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d22fd-db85-4e54-b40b-04fdb1b12fc1 None admin] PATH_INFO: `/v3/users` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:38.425790 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132d22fd-db85-4e54-b40b-04fdb1b12fc1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:00:38.428565 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132d22fd-db85-4e54-b40b-04fdb1b12fc1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:38.428565 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132d22fd-db85-4e54-b40b-04fdb1b12fc1 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:38.451429 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 460/918] 10.222.0.25 () {56 vars in 1143 bytes} [Thu Oct 13 11:00:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:00:38.453818 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee4eed4-cb37-4846-8399-ae97d410b352 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:38.570312 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee4eed4-cb37-4846-8399-ae97d410b352 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:38.607084 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70d07b2-81bb-4cb6-8a8a-ed8ec1803a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:38.607712 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d07b2-81bb-4cb6-8a8a-ed8ec1803a0c None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:38.607986 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d07b2-81bb-4cb6-8a8a-ed8ec1803a0c None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:38.608255 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d07b2-81bb-4cb6-8a8a-ed8ec1803a0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:38.619475 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70d07b2-81bb-4cb6-8a8a-ed8ec1803a0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:38.620985 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70d07b2-81bb-4cb6-8a8a-ed8ec1803a0c None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:38.637671 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-a70d07b2-81bb-4cb6-8a8a-ed8ec1803a0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 11:00:38.637671 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 11:00:38.637671 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 11:00:38.637671 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 11:00:38.637671 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 11:00:38.637671 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 11:00:38.637671 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 11:00:38.637671 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 11:00:38.637671 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 11:00:38.637671 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 11:00:38.637671 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 11:00:38.637671 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 11:00:38.637671 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 11:00:38.637671 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 11:00:38.637671 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 11:00:38.637671 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 11:00:38.638948 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 11:00:38.638948 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 11:00:38.638948 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 11:00:38.638948 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 11:00:38.638948 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 11:00:38.638948 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 11:00:38.638948 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 11:00:38.638948 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 11:00:38.638948 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 11:00:38.638948 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 11:00:38.638948 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 11:00:38.638948 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 11:00:38.638948 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 11:00:38.638948 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 11:00:38.638948 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 11:00:38.638948 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 11:00:38.638948 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 11:00:38.640576 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 11:00:38.640576 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 11:00:38.640576 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 11:00:38.643972 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 459/919] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 11:00:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 11:00:38.645700 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132d22fd-db85-4e54-b40b-04fdb1b12fc1 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:38.666837 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:00:38.754654 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132d22fd-db85-4e54-b40b-04fdb1b12fc1 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:38.795846 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb030f9b-9641-45c6-9079-2f542c9933e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:38.797096 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb030f9b-9641-45c6-9079-2f542c9933e5 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:38.797374 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb030f9b-9641-45c6-9079-2f542c9933e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:38.797743 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb030f9b-9641-45c6-9079-2f542c9933e5 None admin] PATH_INFO: `/v3/domains` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:38.798507 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb030f9b-9641-45c6-9079-2f542c9933e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:00:38.798893 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb030f9b-9641-45c6-9079-2f542c9933e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:38.800958 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb030f9b-9641-45c6-9079-2f542c9933e5 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:38.819373 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 461/920] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 11:00:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:00:38.823111 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70d07b2-81bb-4cb6-8a8a-ed8ec1803a0c None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:38.841604 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:00:38.935857 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70d07b2-81bb-4cb6-8a8a-ed8ec1803a0c None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:38.976553 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1da3e1-c027-4a39-8bad-a31af7bbeba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:38.977208 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1da3e1-c027-4a39-8bad-a31af7bbeba9 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:38.977592 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1da3e1-c027-4a39-8bad-a31af7bbeba9 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:38.977883 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1da3e1-c027-4a39-8bad-a31af7bbeba9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:38.986742 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1da3e1-c027-4a39-8bad-a31af7bbeba9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:38.988542 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1da3e1-c027-4a39-8bad-a31af7bbeba9 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:39.001494 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-2f1da3e1-c027-4a39-8bad-a31af7bbeba9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 11:00:39.001494 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 11:00:39.001494 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 11:00:39.001494 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 11:00:39.001494 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 11:00:39.001494 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 11:00:39.001494 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 11:00:39.001494 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 11:00:39.001494 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 11:00:39.001494 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 11:00:39.001494 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 11:00:39.001494 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 11:00:39.001494 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 11:00:39.001494 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 11:00:39.001494 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 11:00:39.004308 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 11:00:39.004308 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 11:00:39.004308 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 11:00:39.004308 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 11:00:39.004308 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 11:00:39.004308 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 11:00:39.004308 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 11:00:39.004308 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 11:00:39.004308 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 11:00:39.004308 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 11:00:39.004308 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 11:00:39.004308 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 11:00:39.004308 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 11:00:39.004308 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 11:00:39.004308 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 11:00:39.004308 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 11:00:39.004308 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 11:00:39.005741 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 11:00:39.005741 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 11:00:39.005741 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 11:00:39.005741 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 11:00:39.005741 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 11:00:39.005741 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 11:00:39.005741 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 11:00:39.005741 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 11:00:39.005741 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 460/921] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Oct 13 11:00:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 11:00:39.009213 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb030f9b-9641-45c6-9079-2f542c9933e5 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:39.114231 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:00:39.143018 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb030f9b-9641-45c6-9079-2f542c9933e5 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:39.184028 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd86bb6-6801-4a61-b4c5-f63e0356cacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:39.185144 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd86bb6-6801-4a61-b4c5-f63e0356cacf None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:39.185406 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd86bb6-6801-4a61-b4c5-f63e0356cacf None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:39.185852 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd86bb6-6801-4a61-b4c5-f63e0356cacf None admin] PATH_INFO: `/v3/projects` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:39.186668 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd86bb6-6801-4a61-b4c5-f63e0356cacf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:00:39.187030 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd86bb6-6801-4a61-b4c5-f63e0356cacf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:39.188909 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd86bb6-6801-4a61-b4c5-f63e0356cacf None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:39.203669 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 462/922] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Oct 13 11:00:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:00:39.210437 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1da3e1-c027-4a39-8bad-a31af7bbeba9 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:39.291172 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:00:39.317177 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1da3e1-c027-4a39-8bad-a31af7bbeba9 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:39.358124 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f99f186-2664-4f8d-8c69-351e1df9dd16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:39.359452 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99f186-2664-4f8d-8c69-351e1df9dd16 None admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:39.359797 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99f186-2664-4f8d-8c69-351e1df9dd16 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:39.360158 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99f186-2664-4f8d-8c69-351e1df9dd16 None admin] PATH_INFO: `/v3/projects/85bfac5f03e24fb3870a59a6b52dba6e/users/ed4bb75e68a640fc92ddd47fad61a25a/roles/409a58470d23473abb676acf7c1095ae` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:39.378905 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f99f186-2664-4f8d-8c69-351e1df9dd16 None admin] RBAC: Authorizing `identity:create_grant(project_id=85bfac5f03e24fb3870a59a6b52dba6e, user_id=ed4bb75e68a640fc92ddd47fad61a25a, role_id=409a58470d23473abb676acf7c1095ae)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:39.380329 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f99f186-2664-4f8d-8c69-351e1df9dd16 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:39.395670 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 461/923] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Oct 13 11:00:39 2022] PUT /identity/v3/projects/85bfac5f03e24fb3870a59a6b52dba6e/users/ed4bb75e68a640fc92ddd47fad61a25a/roles/409a58470d23473abb676acf7c1095ae => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:00:41.653135 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fddac8-0fd8-40d2-87ac-210c9e2135f0 None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:41.653684 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fddac8-0fd8-40d2-87ac-210c9e2135f0 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:41.653684 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fddac8-0fd8-40d2-87ac-210c9e2135f0 None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:41.655179 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 463/924] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 11:00:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:00:41.660750 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf18fe7-d5f5-455a-8f35-56252b285a87 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:41.661184 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf18fe7-d5f5-455a-8f35-56252b285a87 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:41.661302 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf18fe7-d5f5-455a-8f35-56252b285a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:41.685546 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-fcf18fe7-d5f5-455a-8f35-56252b285a87 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:00:41.686781 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-fcf18fe7-d5f5-455a-8f35-56252b285a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:00:41.772177 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 462/925] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 11:00:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 11:00:42.075430 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fddac8-0fd8-40d2-87ac-210c9e2135f0 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:42.191037 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fddac8-0fd8-40d2-87ac-210c9e2135f0 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:42.231170 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2853e32-a677-49b3-9ae1-5fcf6ae9d388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:42.231802 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2853e32-a677-49b3-9ae1-5fcf6ae9d388 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:42.232079 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2853e32-a677-49b3-9ae1-5fcf6ae9d388 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:42.232348 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2853e32-a677-49b3-9ae1-5fcf6ae9d388 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:42.239551 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:00:42.243830 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2853e32-a677-49b3-9ae1-5fcf6ae9d388 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 11:00:42.249509 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-b2853e32-a677-49b3-9ae1-5fcf6ae9d388 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 13 11:00:42.249509 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 11:00:42.249509 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 11:00:42.249509 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 11:00:42.249509 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 11:00:42.249509 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 11:00:42.249509 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 11:00:42.249509 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 11:00:42.249509 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 11:00:42.249509 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 11:00:42.249509 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 11:00:42.249509 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 11:00:42.249509 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 11:00:42.249509 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 11:00:42.249509 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 11:00:42.249509 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 11:00:42.250987 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 11:00:42.250987 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 11:00:42.250987 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 11:00:42.250987 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 11:00:42.250987 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 11:00:42.250987 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 11:00:42.250987 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 11:00:42.250987 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 11:00:42.250987 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 11:00:42.250987 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 11:00:42.250987 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 11:00:42.250987 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 11:00:42.250987 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 11:00:42.250987 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 11:00:42.250987 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 11:00:42.250987 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 11:00:42.252164 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 11:00:42.252164 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 11:00:42.252164 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 11:00:42.252164 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 11:00:42.252164 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 11:00:42.252164 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 11:00:42.252164 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 11:00:42.252164 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 11:00:42.252164 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 11:00:42.252164 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 11:00:42.252164 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 13 11:00:42.252164 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 11:00:42.252164 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 464/926] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Oct 13 11:00:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 11:00:42.257550 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf18fe7-d5f5-455a-8f35-56252b285a87 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:42.328147 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:00:42.375984 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf18fe7-d5f5-455a-8f35-56252b285a87 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:42.414152 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee321566-6a63-45cc-b9af-4f3b8e59ce28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:42.414773 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee321566-6a63-45cc-b9af-4f3b8e59ce28 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:42.415094 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee321566-6a63-45cc-b9af-4f3b8e59ce28 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:42.415329 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee321566-6a63-45cc-b9af-4f3b8e59ce28 None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:42.416070 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee321566-6a63-45cc-b9af-4f3b8e59ce28 None admin] RBAC: Adding query filter params (name=service) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:00:42.416423 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee321566-6a63-45cc-b9af-4f3b8e59ce28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:42.417895 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee321566-6a63-45cc-b9af-4f3b8e59ce28 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:42.426662 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 463/927] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Oct 13 11:00:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 11:00:42.433063 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2853e32-a677-49b3-9ae1-5fcf6ae9d388 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:42.549743 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2853e32-a677-49b3-9ae1-5fcf6ae9d388 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:42.593994 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e1245-6201-4f9c-b7a5-b1f17d1117dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:42.594618 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e1245-6201-4f9c-b7a5-b1f17d1117dc None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:42.594904 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e1245-6201-4f9c-b7a5-b1f17d1117dc None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:42.595181 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e1245-6201-4f9c-b7a5-b1f17d1117dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:42.608222 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8e1245-6201-4f9c-b7a5-b1f17d1117dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:42.609907 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8e1245-6201-4f9c-b7a5-b1f17d1117dc None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:42.627375 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-8a8e1245-6201-4f9c-b7a5-b1f17d1117dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 11:00:42.627375 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 11:00:42.627375 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 11:00:42.627375 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 11:00:42.627375 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 11:00:42.627375 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 11:00:42.627375 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 11:00:42.627375 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 11:00:42.627375 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 11:00:42.627375 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 11:00:42.627375 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 11:00:42.627375 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 11:00:42.627375 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 11:00:42.627375 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 11:00:42.627375 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 11:00:42.627375 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 11:00:42.628599 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 11:00:42.628599 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 11:00:42.628599 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 11:00:42.628599 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 11:00:42.628599 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 11:00:42.628599 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 11:00:42.628599 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 11:00:42.628599 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 11:00:42.628599 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 11:00:42.628599 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 11:00:42.628599 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 11:00:42.628599 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 11:00:42.628599 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 11:00:42.628599 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 11:00:42.628599 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 11:00:42.628599 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 11:00:42.628599 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 11:00:42.629484 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 11:00:42.629484 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 11:00:42.629484 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 11:00:42.629484 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 465/928] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 11:00:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 11:00:42.634865 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee321566-6a63-45cc-b9af-4f3b8e59ce28 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:42.754107 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee321566-6a63-45cc-b9af-4f3b8e59ce28 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:42.772967 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:00:42.796731 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08177bc6-9017-46f5-9979-9f1f29504047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:42.797392 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08177bc6-9017-46f5-9979-9f1f29504047 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:42.797672 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08177bc6-9017-46f5-9979-9f1f29504047 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:42.798545 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08177bc6-9017-46f5-9979-9f1f29504047 None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:42.799306 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08177bc6-9017-46f5-9979-9f1f29504047 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:00:42.799637 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08177bc6-9017-46f5-9979-9f1f29504047 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:42.801173 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08177bc6-9017-46f5-9979-9f1f29504047 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:42.820888 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 464/929] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 11:00:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 11:00:42.822736 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e1245-6201-4f9c-b7a5-b1f17d1117dc None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:42.881577 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:00:42.938913 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e1245-6201-4f9c-b7a5-b1f17d1117dc None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:42.973954 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab8bcd8-7287-43c3-9dad-1b61291a2426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:42.974618 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab8bcd8-7287-43c3-9dad-1b61291a2426 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:42.974902 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab8bcd8-7287-43c3-9dad-1b61291a2426 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:42.975178 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab8bcd8-7287-43c3-9dad-1b61291a2426 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:42.983097 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab8bcd8-7287-43c3-9dad-1b61291a2426 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:42.985132 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab8bcd8-7287-43c3-9dad-1b61291a2426 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:42.997832 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-1ab8bcd8-7287-43c3-9dad-1b61291a2426 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 13 11:00:42.997832 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 11:00:42.997832 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 11:00:42.997832 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 11:00:42.997832 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 11:00:42.997832 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 11:00:42.997832 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 11:00:42.997832 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 11:00:42.997832 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 11:00:42.997832 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 11:00:42.997832 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 11:00:42.997832 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 11:00:42.997832 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 11:00:42.997832 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 11:00:42.997832 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 11:00:42.997832 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 11:00:42.998843 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 11:00:42.998843 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 11:00:42.998843 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 11:00:42.998843 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 11:00:42.998843 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 11:00:42.998843 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 11:00:42.998843 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 11:00:42.998843 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 11:00:42.998843 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 11:00:42.998843 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 11:00:42.998843 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 11:00:42.998843 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 11:00:42.998843 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 11:00:42.998843 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 11:00:42.998843 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 11:00:42.998843 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 11:00:42.998843 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 11:00:42.998843 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 11:00:43.000456 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 11:00:43.000456 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 11:00:43.000456 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 11:00:43.000456 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 11:00:43.000456 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 11:00:43.000456 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 11:00:43.000456 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 11:00:43.000456 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 11:00:43.000456 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 13 11:00:43.000456 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 11:00:43.000456 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 466/930] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 11:00:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 11:00:43.006173 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08177bc6-9017-46f5-9979-9f1f29504047 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:43.109796 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08177bc6-9017-46f5-9979-9f1f29504047 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:43.149025 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eefdbf2-d18a-4678-a0e9-13f93ac4e8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:43.149574 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eefdbf2-d18a-4678-a0e9-13f93ac4e8c9 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:43.149909 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eefdbf2-d18a-4678-a0e9-13f93ac4e8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:43.150143 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eefdbf2-d18a-4678-a0e9-13f93ac4e8c9 None admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:43.150883 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eefdbf2-d18a-4678-a0e9-13f93ac4e8c9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:00:43.151272 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eefdbf2-d18a-4678-a0e9-13f93ac4e8c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:43.152692 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eefdbf2-d18a-4678-a0e9-13f93ac4e8c9 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:43.170435 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 465/931] 10.222.0.25 () {56 vars in 1143 bytes} [Thu Oct 13 11:00:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 11:00:43.176642 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab8bcd8-7287-43c3-9dad-1b61291a2426 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:43.285146 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab8bcd8-7287-43c3-9dad-1b61291a2426 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:43.295977 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:00:43.320220 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df96579-0b75-47a6-889d-2b1e96686387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:43.320824 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df96579-0b75-47a6-889d-2b1e96686387 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:43.321100 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df96579-0b75-47a6-889d-2b1e96686387 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:43.321370 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df96579-0b75-47a6-889d-2b1e96686387 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:43.405286 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df96579-0b75-47a6-889d-2b1e96686387 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:43.406696 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df96579-0b75-47a6-889d-2b1e96686387 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:43.515621 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 467/932] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Oct 13 11:00:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 13 11:00:43.521706 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eefdbf2-d18a-4678-a0e9-13f93ac4e8c9 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:43.575951 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:00:43.645763 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eefdbf2-d18a-4678-a0e9-13f93ac4e8c9 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:43.685820 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e8931-3063-4fc3-a7c4-f7036f1134df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:43.686493 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e8931-3063-4fc3-a7c4-f7036f1134df None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:43.686774 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e8931-3063-4fc3-a7c4-f7036f1134df None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:43.687631 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e8931-3063-4fc3-a7c4-f7036f1134df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:43.698791 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4e8931-3063-4fc3-a7c4-f7036f1134df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:43.700542 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4e8931-3063-4fc3-a7c4-f7036f1134df None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:43.716712 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-fa4e8931-3063-4fc3-a7c4-f7036f1134df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 11:00:43.716712 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 11:00:43.716712 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 11:00:43.716712 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 11:00:43.716712 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 11:00:43.716712 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 11:00:43.716712 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 11:00:43.716712 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 11:00:43.716712 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 11:00:43.716712 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 11:00:43.716712 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 11:00:43.716712 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 11:00:43.716712 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 11:00:43.716712 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 11:00:43.716712 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 11:00:43.716712 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 11:00:43.717836 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 11:00:43.717836 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 11:00:43.717836 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 11:00:43.717836 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 11:00:43.717836 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 11:00:43.717836 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 11:00:43.717836 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 11:00:43.717836 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 11:00:43.717836 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 11:00:43.717836 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 11:00:43.717836 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 11:00:43.717836 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 11:00:43.717836 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 11:00:43.717836 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 11:00:43.717836 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 11:00:43.717836 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 11:00:43.717836 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 11:00:43.718965 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 11:00:43.718965 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 11:00:43.718965 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 11:00:43.718965 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 466/933] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 11:00:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 11:00:43.723783 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df96579-0b75-47a6-889d-2b1e96686387 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:43.735755 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:00:43.835626 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df96579-0b75-47a6-889d-2b1e96686387 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:43.873521 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e434e055-25cb-4c63-8109-4e483bef3c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:43.874270 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e434e055-25cb-4c63-8109-4e483bef3c88 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:43.875275 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e434e055-25cb-4c63-8109-4e483bef3c88 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:43.875275 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e434e055-25cb-4c63-8109-4e483bef3c88 None admin] PATH_INFO: `/v3/domains` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:43.875919 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e434e055-25cb-4c63-8109-4e483bef3c88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:00:43.876294 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e434e055-25cb-4c63-8109-4e483bef3c88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:43.877956 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e434e055-25cb-4c63-8109-4e483bef3c88 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:43.895307 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 468/934] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 11:00:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:00:43.896476 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e8931-3063-4fc3-a7c4-f7036f1134df None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:43.989913 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:00:44.009006 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e8931-3063-4fc3-a7c4-f7036f1134df None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:44.043469 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09919945-7ba7-4089-9f47-51dc879d8f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:44.044169 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09919945-7ba7-4089-9f47-51dc879d8f16 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:44.044406 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09919945-7ba7-4089-9f47-51dc879d8f16 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:44.044651 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09919945-7ba7-4089-9f47-51dc879d8f16 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:44.051401 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09919945-7ba7-4089-9f47-51dc879d8f16 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:44.052850 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09919945-7ba7-4089-9f47-51dc879d8f16 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:44.066451 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-09919945-7ba7-4089-9f47-51dc879d8f16 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 11:00:44.066451 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 11:00:44.066451 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 11:00:44.066451 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 11:00:44.066451 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 11:00:44.066451 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 11:00:44.066451 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 11:00:44.066451 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 11:00:44.066451 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 11:00:44.066451 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 11:00:44.066451 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 11:00:44.066451 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 11:00:44.066451 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 11:00:44.066451 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 11:00:44.066451 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 11:00:44.069021 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 11:00:44.069021 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 11:00:44.069021 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 11:00:44.069021 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 11:00:44.069021 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 11:00:44.069021 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 11:00:44.069021 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 11:00:44.069021 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 11:00:44.069021 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 11:00:44.069021 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 11:00:44.069021 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 11:00:44.069021 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 11:00:44.069021 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 11:00:44.069021 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 11:00:44.069021 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 11:00:44.069021 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 11:00:44.069021 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 11:00:44.072600 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 11:00:44.072600 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 11:00:44.072600 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 11:00:44.072600 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 11:00:44.072600 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 11:00:44.072600 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 11:00:44.072600 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 11:00:44.072600 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 11:00:44.072600 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 467/935] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Oct 13 11:00:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 11:00:44.073894 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e434e055-25cb-4c63-8109-4e483bef3c88 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:44.155636 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:00:44.194626 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e434e055-25cb-4c63-8109-4e483bef3c88 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:44.232790 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e1b1f9-4ee7-46f8-ac8a-970bff04036b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:44.233398 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e1b1f9-4ee7-46f8-ac8a-970bff04036b None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:44.233709 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e1b1f9-4ee7-46f8-ac8a-970bff04036b None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:44.234011 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e1b1f9-4ee7-46f8-ac8a-970bff04036b None admin] PATH_INFO: `/v3/projects` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:44.235172 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e1b1f9-4ee7-46f8-ac8a-970bff04036b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:00:44.235490 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e1b1f9-4ee7-46f8-ac8a-970bff04036b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:44.237068 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e1b1f9-4ee7-46f8-ac8a-970bff04036b None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:44.250523 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 469/936] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Oct 13 11:00:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:00:44.258378 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09919945-7ba7-4089-9f47-51dc879d8f16 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:44.369398 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09919945-7ba7-4089-9f47-51dc879d8f16 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:44.405099 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffacb79-8d24-4c70-aed2-5b99d803b618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:44.406327 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffacb79-8d24-4c70-aed2-5b99d803b618 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:44.406610 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffacb79-8d24-4c70-aed2-5b99d803b618 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:44.406946 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffacb79-8d24-4c70-aed2-5b99d803b618 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:44.407699 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffacb79-8d24-4c70-aed2-5b99d803b618 None admin] RBAC: Adding query filter params (role.id=409a58470d23473abb676acf7c1095ae, scope.project.id=85bfac5f03e24fb3870a59a6b52dba6e, user.id=ed4bb75e68a640fc92ddd47fad61a25a) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:00:44.408007 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffacb79-8d24-4c70-aed2-5b99d803b618 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:44.409469 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffacb79-8d24-4c70-aed2-5b99d803b618 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:44.416024 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 468/937] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Oct 13 11:00:44 2022] GET /identity/v3/role_assignments?user.id=ed4bb75e68a640fc92ddd47fad61a25a&scope.project.id=85bfac5f03e24fb3870a59a6b52dba6e&role.id=409a58470d23473abb676acf7c1095ae => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:00:46.655766 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca88d35-fd1a-4bcd-a5cd-6192985fc5eb None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:46.656374 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca88d35-fd1a-4bcd-a5cd-6192985fc5eb None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:46.656374 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca88d35-fd1a-4bcd-a5cd-6192985fc5eb None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:46.657843 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 470/938] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 11:00:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:00:46.664040 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a38202-3189-49df-b5dc-76989d5322ce None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:46.664487 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a38202-3189-49df-b5dc-76989d5322ce None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:46.664719 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a38202-3189-49df-b5dc-76989d5322ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:46.689730 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-e4a38202-3189-49df-b5dc-76989d5322ce None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:00:46.691383 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-e4a38202-3189-49df-b5dc-76989d5322ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:00:46.695329 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:00:46.771270 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 469/939] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 11:00:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 13 11:00:47.046895 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca88d35-fd1a-4bcd-a5cd-6192985fc5eb None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:47.160551 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca88d35-fd1a-4bcd-a5cd-6192985fc5eb None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:47.197410 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:00:47.205404 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3316c5-dde1-44d2-a123-5557a29948cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:47.206195 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3316c5-dde1-44d2-a123-5557a29948cf None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:47.206504 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3316c5-dde1-44d2-a123-5557a29948cf None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:47.206805 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3316c5-dde1-44d2-a123-5557a29948cf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:47.219215 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3316c5-dde1-44d2-a123-5557a29948cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 11:00:47.224824 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-ae3316c5-dde1-44d2-a123-5557a29948cf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 11:00:47.224824 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 11:00:47.224824 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 11:00:47.224824 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 11:00:47.224824 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 11:00:47.224824 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 11:00:47.224824 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 11:00:47.224824 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 11:00:47.224824 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 11:00:47.224824 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 11:00:47.224824 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 11:00:47.224824 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 11:00:47.224824 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 11:00:47.224824 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 11:00:47.224824 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 11:00:47.224824 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 11:00:47.226002 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 11:00:47.226002 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 11:00:47.226002 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 11:00:47.226002 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 11:00:47.226002 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 11:00:47.226002 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 11:00:47.226002 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 11:00:47.226002 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 11:00:47.226002 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 11:00:47.226002 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 11:00:47.226002 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 11:00:47.226002 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 11:00:47.226002 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 11:00:47.226002 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 11:00:47.226002 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 11:00:47.226002 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 11:00:47.227030 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 11:00:47.227030 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 11:00:47.227030 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 11:00:47.227030 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 11:00:47.227030 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 11:00:47.227030 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 11:00:47.227030 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 11:00:47.227030 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 11:00:47.227030 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 11:00:47.227030 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 11:00:47.227030 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 11:00:47.227030 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 11:00:47.227030 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 471/940] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Oct 13 11:00:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 11:00:47.232667 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a38202-3189-49df-b5dc-76989d5322ce None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:47.350808 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a38202-3189-49df-b5dc-76989d5322ce None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:47.386217 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15727ed1-e150-40fe-a1e6-9738bc9b91e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:47.386862 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15727ed1-e150-40fe-a1e6-9738bc9b91e8 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:47.387156 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15727ed1-e150-40fe-a1e6-9738bc9b91e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:47.387426 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15727ed1-e150-40fe-a1e6-9738bc9b91e8 None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:47.388403 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15727ed1-e150-40fe-a1e6-9738bc9b91e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:00:47.388695 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15727ed1-e150-40fe-a1e6-9738bc9b91e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:47.390863 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15727ed1-e150-40fe-a1e6-9738bc9b91e8 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:47.406777 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 470/941] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 11:00:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:00:47.408309 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3316c5-dde1-44d2-a123-5557a29948cf None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:47.529925 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3316c5-dde1-44d2-a123-5557a29948cf None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:47.578860 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9288080-e6db-46ed-9a05-2270632c139b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:47.579524 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9288080-e6db-46ed-9a05-2270632c139b None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:47.579847 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9288080-e6db-46ed-9a05-2270632c139b None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:47.580158 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9288080-e6db-46ed-9a05-2270632c139b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:47.592358 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9288080-e6db-46ed-9a05-2270632c139b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:47.593809 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9288080-e6db-46ed-9a05-2270632c139b None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:47.611922 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-a9288080-e6db-46ed-9a05-2270632c139b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 11:00:47.611922 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 11:00:47.611922 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 11:00:47.611922 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 11:00:47.611922 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 11:00:47.611922 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 11:00:47.611922 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 11:00:47.611922 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 11:00:47.611922 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 11:00:47.611922 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 11:00:47.611922 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 11:00:47.611922 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 11:00:47.611922 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 11:00:47.611922 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 11:00:47.611922 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 11:00:47.611922 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 11:00:47.615092 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 11:00:47.615092 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 11:00:47.615092 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 11:00:47.615092 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 11:00:47.615092 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 11:00:47.615092 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 11:00:47.615092 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 11:00:47.615092 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 11:00:47.615092 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 11:00:47.615092 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 11:00:47.615092 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 11:00:47.615092 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 11:00:47.615092 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 11:00:47.615092 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 11:00:47.615092 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 11:00:47.615092 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 11:00:47.615092 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 11:00:47.616064 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 11:00:47.616064 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 11:00:47.616064 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 11:00:47.616064 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 472/942] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 11:00:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 11:00:47.620076 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15727ed1-e150-40fe-a1e6-9738bc9b91e8 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:47.625115 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:00:47.767285 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15727ed1-e150-40fe-a1e6-9738bc9b91e8 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:47.803719 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf3cd90-84c4-43cf-a35c-98979a3968e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:47.804328 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf3cd90-84c4-43cf-a35c-98979a3968e6 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:47.804606 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf3cd90-84c4-43cf-a35c-98979a3968e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:47.804900 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf3cd90-84c4-43cf-a35c-98979a3968e6 None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:47.805782 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf3cd90-84c4-43cf-a35c-98979a3968e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:00:47.806116 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf3cd90-84c4-43cf-a35c-98979a3968e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:47.807903 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf3cd90-84c4-43cf-a35c-98979a3968e6 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:47.822315 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 471/943] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 11:00:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:00:47.828769 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9288080-e6db-46ed-9a05-2270632c139b None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:47.877249 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:00:47.938677 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9288080-e6db-46ed-9a05-2270632c139b None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:47.977619 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ded1a2a-ae1b-444c-bc63-264c440b00ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:47.978420 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded1a2a-ae1b-444c-bc63-264c440b00ed None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:47.978737 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded1a2a-ae1b-444c-bc63-264c440b00ed None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:47.979075 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded1a2a-ae1b-444c-bc63-264c440b00ed None admin] PATH_INFO: `/v3/users/placement` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:47.988418 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ded1a2a-ae1b-444c-bc63-264c440b00ed None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:47.990586 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ded1a2a-ae1b-444c-bc63-264c440b00ed None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:48.005298 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-4ded1a2a-ae1b-444c-bc63-264c440b00ed None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 13 11:00:48.005298 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 11:00:48.005298 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 11:00:48.005298 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 11:00:48.005298 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 11:00:48.005298 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 11:00:48.005298 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 11:00:48.005298 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 11:00:48.005298 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 11:00:48.005298 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 11:00:48.005298 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 11:00:48.005298 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 11:00:48.005298 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 11:00:48.005298 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 11:00:48.005298 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 11:00:48.005298 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 11:00:48.006417 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 11:00:48.006417 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 11:00:48.006417 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 11:00:48.006417 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 11:00:48.006417 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 11:00:48.006417 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 11:00:48.006417 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 11:00:48.006417 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 11:00:48.006417 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 11:00:48.006417 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 11:00:48.006417 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 11:00:48.006417 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 11:00:48.006417 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 11:00:48.006417 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 11:00:48.006417 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 11:00:48.006417 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 11:00:48.006417 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 11:00:48.006417 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 11:00:48.007354 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 11:00:48.007354 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 11:00:48.007354 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 11:00:48.007354 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 11:00:48.007354 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 11:00:48.007354 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 11:00:48.007354 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 11:00:48.007354 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 11:00:48.007354 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 13 11:00:48.007354 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 11:00:48.007354 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 473/944] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 11:00:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 11:00:48.013765 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf3cd90-84c4-43cf-a35c-98979a3968e6 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:48.090080 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:00:48.140884 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf3cd90-84c4-43cf-a35c-98979a3968e6 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:48.185597 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cbde5b-a811-4a7c-9359-b40916bfb215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:48.186745 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cbde5b-a811-4a7c-9359-b40916bfb215 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:48.187339 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cbde5b-a811-4a7c-9359-b40916bfb215 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:48.187875 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cbde5b-a811-4a7c-9359-b40916bfb215 None admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:48.188787 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cbde5b-a811-4a7c-9359-b40916bfb215 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:00:48.189099 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cbde5b-a811-4a7c-9359-b40916bfb215 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:48.190573 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cbde5b-a811-4a7c-9359-b40916bfb215 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:48.214361 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 472/945] 10.222.0.25 () {56 vars in 1143 bytes} [Thu Oct 13 11:00:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:00:48.221696 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ded1a2a-ae1b-444c-bc63-264c440b00ed None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:48.352408 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ded1a2a-ae1b-444c-bc63-264c440b00ed None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:48.354172 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:00:48.395265 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943818c1-87ad-4f1f-b87b-a22f665a0ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:48.396085 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943818c1-87ad-4f1f-b87b-a22f665a0ce9 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:48.396572 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943818c1-87ad-4f1f-b87b-a22f665a0ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:48.396878 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943818c1-87ad-4f1f-b87b-a22f665a0ce9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:48.409839 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943818c1-87ad-4f1f-b87b-a22f665a0ce9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:48.411386 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943818c1-87ad-4f1f-b87b-a22f665a0ce9 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:48.433674 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-943818c1-87ad-4f1f-b87b-a22f665a0ce9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 11:00:48.433674 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 11:00:48.433674 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 11:00:48.433674 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 11:00:48.433674 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 11:00:48.433674 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 11:00:48.433674 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 11:00:48.433674 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 11:00:48.433674 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 11:00:48.433674 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 11:00:48.433674 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 11:00:48.433674 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 11:00:48.433674 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 11:00:48.433674 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 11:00:48.433674 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 11:00:48.433674 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 11:00:48.434876 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 11:00:48.434876 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 11:00:48.434876 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 11:00:48.434876 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 11:00:48.434876 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 11:00:48.434876 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 11:00:48.434876 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 11:00:48.434876 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 11:00:48.434876 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 11:00:48.434876 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 11:00:48.434876 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 11:00:48.434876 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 11:00:48.434876 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 11:00:48.434876 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 11:00:48.434876 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 11:00:48.434876 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 11:00:48.434876 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 11:00:48.435940 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 11:00:48.435940 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 11:00:48.435940 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 11:00:48.435940 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 474/946] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 11:00:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 11:00:48.440634 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cbde5b-a811-4a7c-9359-b40916bfb215 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:48.560270 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cbde5b-a811-4a7c-9359-b40916bfb215 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:48.587043 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:00:48.603032 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c8a90f-1e77-4433-ad3d-70d232ed22bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:48.603685 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c8a90f-1e77-4433-ad3d-70d232ed22bd None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:48.603929 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c8a90f-1e77-4433-ad3d-70d232ed22bd None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:48.604212 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c8a90f-1e77-4433-ad3d-70d232ed22bd None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:48.605049 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c8a90f-1e77-4433-ad3d-70d232ed22bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:00:48.605213 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c8a90f-1e77-4433-ad3d-70d232ed22bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:48.606656 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c8a90f-1e77-4433-ad3d-70d232ed22bd None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:48.619305 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 473/947] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 11:00:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:00:48.625569 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943818c1-87ad-4f1f-b87b-a22f665a0ce9 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:48.736323 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943818c1-87ad-4f1f-b87b-a22f665a0ce9 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:48.780287 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b214c5c1-ad82-4388-a3c7-d1dea3da628b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:48.780945 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b214c5c1-ad82-4388-a3c7-d1dea3da628b None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:48.781223 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b214c5c1-ad82-4388-a3c7-d1dea3da628b None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:48.781492 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b214c5c1-ad82-4388-a3c7-d1dea3da628b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:48.789311 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b214c5c1-ad82-4388-a3c7-d1dea3da628b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:48.791211 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b214c5c1-ad82-4388-a3c7-d1dea3da628b None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:48.804701 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-b214c5c1-ad82-4388-a3c7-d1dea3da628b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 11:00:48.804701 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 11:00:48.804701 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 11:00:48.804701 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 11:00:48.804701 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 11:00:48.804701 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 11:00:48.804701 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 11:00:48.804701 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 11:00:48.804701 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 11:00:48.804701 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 11:00:48.804701 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 11:00:48.804701 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 11:00:48.804701 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 11:00:48.804701 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 11:00:48.804701 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 11:00:48.805804 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 11:00:48.805804 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 11:00:48.805804 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 11:00:48.805804 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 11:00:48.805804 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 11:00:48.805804 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 11:00:48.805804 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 11:00:48.805804 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 11:00:48.805804 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 11:00:48.805804 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 11:00:48.805804 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 11:00:48.805804 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 11:00:48.805804 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 11:00:48.805804 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 11:00:48.805804 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 11:00:48.805804 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 11:00:48.805804 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 11:00:48.806874 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 11:00:48.806874 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 11:00:48.806874 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 11:00:48.806874 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 11:00:48.806874 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 11:00:48.806874 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 11:00:48.806874 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 11:00:48.806874 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 11:00:48.806874 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 475/948] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Oct 13 11:00:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 11:00:48.812858 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c8a90f-1e77-4433-ad3d-70d232ed22bd None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:48.924454 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c8a90f-1e77-4433-ad3d-70d232ed22bd None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:48.960483 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec0e928-2e5a-4c57-85c3-917b41cc32ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:48.961090 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec0e928-2e5a-4c57-85c3-917b41cc32ee None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:48.961367 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec0e928-2e5a-4c57-85c3-917b41cc32ee None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:48.961643 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec0e928-2e5a-4c57-85c3-917b41cc32ee None admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:48.962358 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec0e928-2e5a-4c57-85c3-917b41cc32ee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:00:48.962665 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec0e928-2e5a-4c57-85c3-917b41cc32ee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:48.964136 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec0e928-2e5a-4c57-85c3-917b41cc32ee None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:48.978147 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 474/949] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Oct 13 11:00:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:00:48.985220 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b214c5c1-ad82-4388-a3c7-d1dea3da628b None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:49.005292 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:00:49.101009 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b214c5c1-ad82-4388-a3c7-d1dea3da628b None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:49.139078 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223507d3-08e1-4155-a1e7-7d6e36098613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:49.140298 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223507d3-08e1-4155-a1e7-7d6e36098613 None admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:49.140580 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223507d3-08e1-4155-a1e7-7d6e36098613 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:49.140902 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223507d3-08e1-4155-a1e7-7d6e36098613 None admin] PATH_INFO: `/v3/projects/85bfac5f03e24fb3870a59a6b52dba6e/users/ed4bb75e68a640fc92ddd47fad61a25a/roles/ea564961b1db4eb4a1d4d880964611b2` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:49.142869 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223507d3-08e1-4155-a1e7-7d6e36098613 None admin] RBAC: Authorizing `identity:create_grant(project_id=85bfac5f03e24fb3870a59a6b52dba6e, user_id=ed4bb75e68a640fc92ddd47fad61a25a, role_id=ea564961b1db4eb4a1d4d880964611b2)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:49.144278 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223507d3-08e1-4155-a1e7-7d6e36098613 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:49.157744 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 476/950] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Oct 13 11:00:48 2022] PUT /identity/v3/projects/85bfac5f03e24fb3870a59a6b52dba6e/users/ed4bb75e68a640fc92ddd47fad61a25a/roles/ea564961b1db4eb4a1d4d880964611b2 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:00:51.542045 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84c0f2-29c2-42c2-99a8-d1233e24e0bd None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:51.542686 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84c0f2-29c2-42c2-99a8-d1233e24e0bd None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:51.542804 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84c0f2-29c2-42c2-99a8-d1233e24e0bd None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:51.544483 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 475/951] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 11:00:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:00:51.550182 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d488c247-f96f-4b1a-9377-ce07544e07ee None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:51.550681 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d488c247-f96f-4b1a-9377-ce07544e07ee None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:51.550681 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d488c247-f96f-4b1a-9377-ce07544e07ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:51.570651 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-d488c247-f96f-4b1a-9377-ce07544e07ee None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:00:51.571826 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-d488c247-f96f-4b1a-9377-ce07544e07ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:00:51.644925 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 477/952] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 11:00:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 11:00:51.916344 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f84c0f2-29c2-42c2-99a8-d1233e24e0bd None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:51.961227 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:00:52.022073 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f84c0f2-29c2-42c2-99a8-d1233e24e0bd None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:52.059153 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be748bc-bcbe-4c5d-ad1e-ddabe052091b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:52.059784 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be748bc-bcbe-4c5d-ad1e-ddabe052091b None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:52.060063 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be748bc-bcbe-4c5d-ad1e-ddabe052091b None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:52.060329 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be748bc-bcbe-4c5d-ad1e-ddabe052091b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:52.070835 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be748bc-bcbe-4c5d-ad1e-ddabe052091b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 11:00:52.075580 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-4be748bc-bcbe-4c5d-ad1e-ddabe052091b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 11:00:52.075580 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 11:00:52.075580 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 11:00:52.075580 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 11:00:52.075580 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 11:00:52.075580 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 11:00:52.075580 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 11:00:52.075580 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 11:00:52.075580 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 11:00:52.075580 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 11:00:52.075580 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 11:00:52.075580 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 11:00:52.075580 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 11:00:52.075580 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 11:00:52.075580 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 11:00:52.075580 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 11:00:52.076776 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 11:00:52.076776 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 11:00:52.076776 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 11:00:52.076776 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 11:00:52.076776 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 11:00:52.076776 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 11:00:52.076776 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 11:00:52.076776 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 11:00:52.076776 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 11:00:52.076776 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 11:00:52.076776 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 11:00:52.076776 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 11:00:52.076776 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 11:00:52.076776 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 11:00:52.076776 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 11:00:52.076776 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 11:00:52.078460 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 11:00:52.078460 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 11:00:52.078460 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 11:00:52.078460 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 11:00:52.078460 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 11:00:52.078460 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 11:00:52.078460 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 11:00:52.078460 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 11:00:52.078460 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 11:00:52.078460 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 11:00:52.078460 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 11:00:52.078460 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 11:00:52.078460 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 476/953] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Oct 13 11:00:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 11:00:52.083349 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d488c247-f96f-4b1a-9377-ce07544e07ee None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:52.086444 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:00:52.191168 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d488c247-f96f-4b1a-9377-ce07544e07ee None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:52.225841 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3043bb-e3fc-4006-90e7-502451fe66f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:52.226513 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3043bb-e3fc-4006-90e7-502451fe66f2 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:52.226875 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3043bb-e3fc-4006-90e7-502451fe66f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:52.227208 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3043bb-e3fc-4006-90e7-502451fe66f2 None admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:52.227937 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3043bb-e3fc-4006-90e7-502451fe66f2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:00:52.228296 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3043bb-e3fc-4006-90e7-502451fe66f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:52.229658 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3043bb-e3fc-4006-90e7-502451fe66f2 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:52.239242 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 478/954] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Oct 13 11:00:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:00:52.245079 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be748bc-bcbe-4c5d-ad1e-ddabe052091b None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:52.349639 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:00:52.352911 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be748bc-bcbe-4c5d-ad1e-ddabe052091b None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:52.389103 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b36428e-1ef7-40dd-a68d-1afc437665fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:52.389755 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36428e-1ef7-40dd-a68d-1afc437665fa None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:52.390063 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36428e-1ef7-40dd-a68d-1afc437665fa None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:52.390335 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36428e-1ef7-40dd-a68d-1afc437665fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:52.400889 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b36428e-1ef7-40dd-a68d-1afc437665fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:52.402381 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b36428e-1ef7-40dd-a68d-1afc437665fa None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:52.418009 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-3b36428e-1ef7-40dd-a68d-1afc437665fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 11:00:52.418009 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 11:00:52.418009 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 11:00:52.418009 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 11:00:52.418009 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 11:00:52.418009 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 11:00:52.418009 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 11:00:52.418009 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 11:00:52.418009 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 11:00:52.418009 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 11:00:52.418009 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 11:00:52.418009 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 11:00:52.418009 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 11:00:52.418009 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 11:00:52.418009 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 11:00:52.418009 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 11:00:52.419245 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 11:00:52.419245 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 11:00:52.419245 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 11:00:52.419245 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 11:00:52.419245 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 11:00:52.419245 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 11:00:52.419245 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 11:00:52.419245 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 11:00:52.419245 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 11:00:52.419245 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 11:00:52.419245 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 11:00:52.419245 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 11:00:52.419245 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 11:00:52.419245 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 11:00:52.419245 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 11:00:52.419245 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 11:00:52.419245 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 11:00:52.420361 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 11:00:52.420361 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 11:00:52.420361 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 11:00:52.420361 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 477/955] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 11:00:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 11:00:52.426010 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3043bb-e3fc-4006-90e7-502451fe66f2 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:52.493647 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:00:52.529274 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3043bb-e3fc-4006-90e7-502451fe66f2 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:52.570143 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c3d70e-1033-4de3-a161-6482adc33291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:52.570867 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3d70e-1033-4de3-a161-6482adc33291 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:52.571217 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3d70e-1033-4de3-a161-6482adc33291 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:52.571490 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3d70e-1033-4de3-a161-6482adc33291 None admin] PATH_INFO: `/v3/domains` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:52.572161 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c3d70e-1033-4de3-a161-6482adc33291 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:00:52.572463 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c3d70e-1033-4de3-a161-6482adc33291 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:52.573974 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c3d70e-1033-4de3-a161-6482adc33291 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:52.587251 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 479/956] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 11:00:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:00:52.593529 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b36428e-1ef7-40dd-a68d-1afc437665fa None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:52.698629 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b36428e-1ef7-40dd-a68d-1afc437665fa None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:52.733230 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a30520e-b91e-485b-af90-99a0a8b1c98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:52.733882 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30520e-b91e-485b-af90-99a0a8b1c98d None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:52.734193 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30520e-b91e-485b-af90-99a0a8b1c98d None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:52.734463 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30520e-b91e-485b-af90-99a0a8b1c98d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:52.742204 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a30520e-b91e-485b-af90-99a0a8b1c98d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:52.743628 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a30520e-b91e-485b-af90-99a0a8b1c98d None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:52.754588 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-8a30520e-b91e-485b-af90-99a0a8b1c98d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 13 11:00:52.754588 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 11:00:52.754588 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 11:00:52.754588 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 11:00:52.754588 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 11:00:52.754588 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 11:00:52.754588 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 11:00:52.754588 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 11:00:52.754588 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 11:00:52.754588 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 11:00:52.754588 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 11:00:52.754588 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 11:00:52.754588 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 11:00:52.754588 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 11:00:52.754588 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 11:00:52.754588 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 11:00:52.755679 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 11:00:52.755679 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 11:00:52.755679 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 11:00:52.755679 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 11:00:52.755679 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 11:00:52.755679 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 11:00:52.755679 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 11:00:52.755679 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 11:00:52.755679 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 11:00:52.755679 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 11:00:52.755679 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 11:00:52.755679 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 11:00:52.755679 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 11:00:52.755679 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 11:00:52.755679 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 11:00:52.755679 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 11:00:52.755679 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 11:00:52.755679 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 11:00:52.756733 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 11:00:52.756733 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 11:00:52.756733 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 11:00:52.756733 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 11:00:52.756733 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 11:00:52.756733 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 11:00:52.756733 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 11:00:52.756733 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 11:00:52.756733 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 13 11:00:52.756733 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 11:00:52.756733 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 478/957] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 11:00:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 11:00:52.762305 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c3d70e-1033-4de3-a161-6482adc33291 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:52.861445 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c3d70e-1033-4de3-a161-6482adc33291 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:52.888796 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:00:52.898949 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836149c2-df79-4755-945e-2bbadf39fca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:52.899589 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836149c2-df79-4755-945e-2bbadf39fca5 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:52.899864 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836149c2-df79-4755-945e-2bbadf39fca5 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:52.900129 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836149c2-df79-4755-945e-2bbadf39fca5 None admin] PATH_INFO: `/v3/users` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:52.900861 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836149c2-df79-4755-945e-2bbadf39fca5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:00:52.901165 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836149c2-df79-4755-945e-2bbadf39fca5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:52.902604 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836149c2-df79-4755-945e-2bbadf39fca5 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:52.920479 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 480/958] 10.222.0.25 () {56 vars in 1143 bytes} [Thu Oct 13 11:00:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:00:52.926774 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a30520e-b91e-485b-af90-99a0a8b1c98d None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:52.946363 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:00:53.028517 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a30520e-b91e-485b-af90-99a0a8b1c98d None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:53.060797 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7923f1-33da-40ec-8d3b-f31d426228dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:53.061398 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7923f1-33da-40ec-8d3b-f31d426228dd None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:53.061698 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7923f1-33da-40ec-8d3b-f31d426228dd None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:53.061999 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7923f1-33da-40ec-8d3b-f31d426228dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:53.125354 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7923f1-33da-40ec-8d3b-f31d426228dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:53.126813 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7923f1-33da-40ec-8d3b-f31d426228dd None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:53.139306 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:00:53.219823 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 479/959] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Oct 13 11:00:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 13 11:00:53.225597 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836149c2-df79-4755-945e-2bbadf39fca5 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:53.320027 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836149c2-df79-4755-945e-2bbadf39fca5 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:53.351792 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c44604-2a86-4ecf-a50e-3e047de36f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:53.352397 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c44604-2a86-4ecf-a50e-3e047de36f8a None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:53.352671 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c44604-2a86-4ecf-a50e-3e047de36f8a None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:53.352939 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c44604-2a86-4ecf-a50e-3e047de36f8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:53.363322 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c44604-2a86-4ecf-a50e-3e047de36f8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:53.364720 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c44604-2a86-4ecf-a50e-3e047de36f8a None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:53.378501 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-42c44604-2a86-4ecf-a50e-3e047de36f8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 11:00:53.378501 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 11:00:53.378501 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 11:00:53.378501 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 11:00:53.378501 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 11:00:53.378501 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 11:00:53.378501 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 11:00:53.378501 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 11:00:53.378501 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 11:00:53.378501 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 11:00:53.378501 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 11:00:53.378501 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 11:00:53.378501 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 11:00:53.378501 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 11:00:53.378501 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 11:00:53.378501 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 11:00:53.379581 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 11:00:53.379581 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 11:00:53.379581 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 11:00:53.379581 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 11:00:53.379581 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 11:00:53.379581 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 11:00:53.379581 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 11:00:53.379581 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 11:00:53.379581 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 11:00:53.379581 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 11:00:53.379581 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 11:00:53.379581 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 11:00:53.379581 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 11:00:53.379581 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 11:00:53.379581 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 11:00:53.379581 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 11:00:53.379581 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 11:00:53.380542 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 11:00:53.380542 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 11:00:53.380542 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 11:00:53.380542 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 481/960] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 11:00:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 11:00:53.384928 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7923f1-33da-40ec-8d3b-f31d426228dd None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:53.479853 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7923f1-33da-40ec-8d3b-f31d426228dd None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:53.492668 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:00:53.513211 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed17166-a579-4003-ba20-fd3d23e6a2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:53.513803 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed17166-a579-4003-ba20-fd3d23e6a2a6 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:53.514114 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed17166-a579-4003-ba20-fd3d23e6a2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:53.514386 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed17166-a579-4003-ba20-fd3d23e6a2a6 None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:53.515562 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed17166-a579-4003-ba20-fd3d23e6a2a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:00:53.515864 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed17166-a579-4003-ba20-fd3d23e6a2a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:53.517213 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed17166-a579-4003-ba20-fd3d23e6a2a6 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:53.529516 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 480/961] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Oct 13 11:00:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:00:53.537375 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c44604-2a86-4ecf-a50e-3e047de36f8a None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:53.582077 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:00:53.645105 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c44604-2a86-4ecf-a50e-3e047de36f8a None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:53.677690 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1684c67e-3d36-469b-a87c-9bf82b20ff07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:53.678326 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1684c67e-3d36-469b-a87c-9bf82b20ff07 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:53.678603 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1684c67e-3d36-469b-a87c-9bf82b20ff07 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:53.678877 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1684c67e-3d36-469b-a87c-9bf82b20ff07 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:53.685168 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1684c67e-3d36-469b-a87c-9bf82b20ff07 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:53.687199 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1684c67e-3d36-469b-a87c-9bf82b20ff07 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:53.698089 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application [None req-1684c67e-3d36-469b-a87c-9bf82b20ff07 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 11:00:53.698089 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 11:00:53.698089 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 11:00:53.698089 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 11:00:53.698089 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 11:00:53.698089 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 11:00:53.698089 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 11:00:53.698089 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 11:00:53.698089 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 11:00:53.698089 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 11:00:53.698089 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 11:00:53.698089 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 11:00:53.698089 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 11:00:53.698089 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 11:00:53.698089 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 11:00:53.699123 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 11:00:53.699123 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 11:00:53.699123 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 11:00:53.699123 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 11:00:53.699123 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 11:00:53.699123 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 11:00:53.699123 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 11:00:53.699123 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 11:00:53.699123 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application with Lock( Oct 13 11:00:53.699123 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 11:00:53.699123 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._enter() Oct 13 11:00:53.699123 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 11:00:53.699123 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 11:00:53.699123 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 11:00:53.699123 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.creator() Oct 13 11:00:53.699123 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 11:00:53.699123 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application created_value = creator( Oct 13 11:00:53.700330 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 11:00:53.700330 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 11:00:53.700330 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 11:00:53.700330 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 11:00:53.700330 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 11:00:53.700330 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 11:00:53.700330 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 11:00:53.700330 dv-cinder-861001-1-smb devstack@keystone.service[81551]: ERROR keystone.server.flask.application Oct 13 11:00:53.700330 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 482/962] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Oct 13 11:00:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 11:00:53.705025 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed17166-a579-4003-ba20-fd3d23e6a2a6 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:53.806327 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed17166-a579-4003-ba20-fd3d23e6a2a6 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:53.839050 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4a9353-b9cf-4fe1-a568-ceeff425402e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:53.839648 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a9353-b9cf-4fe1-a568-ceeff425402e None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:53.839963 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a9353-b9cf-4fe1-a568-ceeff425402e None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:53.840264 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a9353-b9cf-4fe1-a568-ceeff425402e None admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:53.840994 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4a9353-b9cf-4fe1-a568-ceeff425402e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:00:53.841336 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4a9353-b9cf-4fe1-a568-ceeff425402e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:53.843374 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4a9353-b9cf-4fe1-a568-ceeff425402e None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:53.854815 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 481/963] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Oct 13 11:00:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 11:00:53.861305 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1684c67e-3d36-469b-a87c-9bf82b20ff07 None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:53.951181 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:00:53.957120 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1684c67e-3d36-469b-a87c-9bf82b20ff07 None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:53.990001 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a598286-47b2-4d4b-998a-a6f32a592cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:53.990591 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a598286-47b2-4d4b-998a-a6f32a592cf1 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:53.990872 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a598286-47b2-4d4b-998a-a6f32a592cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:53.991150 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a598286-47b2-4d4b-998a-a6f32a592cf1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:53.991869 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a598286-47b2-4d4b-998a-a6f32a592cf1 None admin] RBAC: Adding query filter params (role.id=ea564961b1db4eb4a1d4d880964611b2, scope.project.id=85bfac5f03e24fb3870a59a6b52dba6e, user.id=ed4bb75e68a640fc92ddd47fad61a25a) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:00:53.992176 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a598286-47b2-4d4b-998a-a6f32a592cf1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:53.993575 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a598286-47b2-4d4b-998a-a6f32a592cf1 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:53.999122 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 483/964] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Oct 13 11:00:53 2022] GET /identity/v3/role_assignments?user.id=ed4bb75e68a640fc92ddd47fad61a25a&scope.project.id=85bfac5f03e24fb3870a59a6b52dba6e&role.id=ea564961b1db4eb4a1d4d880964611b2 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:00:56.143924 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca123d9f-ffa8-466b-b031-4ec3ebc7da4a None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:56.144449 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca123d9f-ffa8-466b-b031-4ec3ebc7da4a None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:56.144449 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca123d9f-ffa8-466b-b031-4ec3ebc7da4a None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:56.145726 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 482/965] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 11:00:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:00:56.151088 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ba981-ae03-4867-9748-287f7506e551 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:56.151475 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ba981-ae03-4867-9748-287f7506e551 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:56.151643 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ba981-ae03-4867-9748-287f7506e551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:56.170766 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-817ba981-ae03-4867-9748-287f7506e551 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:00:56.172521 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-817ba981-ae03-4867-9748-287f7506e551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:00:56.235269 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 484/966] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 11:00:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 11:00:56.505203 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca123d9f-ffa8-466b-b031-4ec3ebc7da4a None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:56.538252 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:00:56.615494 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca123d9f-ffa8-466b-b031-4ec3ebc7da4a None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:56.647932 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6c9f73-0ff1-4f6a-8da7-989a4d4d7af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:56.648554 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c9f73-0ff1-4f6a-8da7-989a4d4d7af3 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:56.648832 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c9f73-0ff1-4f6a-8da7-989a4d4d7af3 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:56.649104 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c9f73-0ff1-4f6a-8da7-989a4d4d7af3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:56.649682 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6c9f73-0ff1-4f6a-8da7-989a4d4d7af3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:56.651068 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6c9f73-0ff1-4f6a-8da7-989a4d4d7af3 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:56.660173 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-ab6c9f73-0ff1-4f6a-8da7-989a4d4d7af3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 13 11:00:56.660173 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 11:00:56.660173 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 11:00:56.660173 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 11:00:56.660173 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 11:00:56.660173 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 11:00:56.660173 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 11:00:56.660173 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 11:00:56.660173 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 13 11:00:56.660173 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 11:00:56.660173 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 11:00:56.660173 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 11:00:56.660173 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 11:00:56.660173 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 11:00:56.660173 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 11:00:56.660173 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 11:00:56.660173 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 11:00:56.661386 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 11:00:56.661386 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 11:00:56.661386 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 11:00:56.661386 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 11:00:56.661386 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 11:00:56.661386 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 11:00:56.661386 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 11:00:56.661386 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 11:00:56.661386 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 11:00:56.661386 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 11:00:56.661386 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 11:00:56.661386 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 11:00:56.661386 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 11:00:56.661386 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 11:00:56.661386 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 11:00:56.661386 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 11:00:56.662429 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 11:00:56.662429 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 11:00:56.662429 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 11:00:56.662429 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 11:00:56.662429 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 11:00:56.662429 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 11:00:56.662429 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 11:00:56.662429 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 11:00:56.662429 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 11:00:56.662429 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 11:00:56.662429 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 11:00:56.662429 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 11:00:56.662429 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 13 11:00:56.662429 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 11:00:56.662429 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 483/967] 10.222.0.25 () {56 vars in 1117 bytes} [Thu Oct 13 11:00:56 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 11:00:56.667254 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817ba981-ae03-4867-9748-287f7506e551 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:56.751714 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:00:56.761612 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817ba981-ae03-4867-9748-287f7506e551 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:56.794847 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515ad214-d56d-4b71-97f9-c3a54673b76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:56.795435 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515ad214-d56d-4b71-97f9-c3a54673b76a None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:56.795739 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515ad214-d56d-4b71-97f9-c3a54673b76a None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:56.795976 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515ad214-d56d-4b71-97f9-c3a54673b76a None admin] PATH_INFO: `/v3/services` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:56.796591 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515ad214-d56d-4b71-97f9-c3a54673b76a None admin] RBAC: Adding query filter params (name=placement) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:00:56.796885 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515ad214-d56d-4b71-97f9-c3a54673b76a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:56.798243 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515ad214-d56d-4b71-97f9-c3a54673b76a None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:56.802772 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 485/968] 10.222.0.25 () {56 vars in 1116 bytes} [Thu Oct 13 11:00:56 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 11:00:56.808434 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6c9f73-0ff1-4f6a-8da7-989a4d4d7af3 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:56.905367 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:00:56.911525 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6c9f73-0ff1-4f6a-8da7-989a4d4d7af3 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:56.943674 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4680d1cf-8ee7-4a63-b9d1-684bdce8a388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:56.944268 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4680d1cf-8ee7-4a63-b9d1-684bdce8a388 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:56.944550 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4680d1cf-8ee7-4a63-b9d1-684bdce8a388 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:56.944826 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4680d1cf-8ee7-4a63-b9d1-684bdce8a388 None admin] PATH_INFO: `/v3/services` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:56.945453 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4680d1cf-8ee7-4a63-b9d1-684bdce8a388 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:00:56.945765 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4680d1cf-8ee7-4a63-b9d1-684bdce8a388 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:56.947149 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4680d1cf-8ee7-4a63-b9d1-684bdce8a388 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:56.951845 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 484/969] 10.222.0.25 () {56 vars in 1116 bytes} [Thu Oct 13 11:00:56 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:00:59.040248 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a464e57-c0d1-4b09-aa2d-701316006404 None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:59.040893 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a464e57-c0d1-4b09-aa2d-701316006404 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:59.040893 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a464e57-c0d1-4b09-aa2d-701316006404 None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:59.042119 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 486/970] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 11:00:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:00:59.047341 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106bf762-9e4e-4322-9fb1-97e9f43b192c None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:59.047751 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106bf762-9e4e-4322-9fb1-97e9f43b192c None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:59.047891 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106bf762-9e4e-4322-9fb1-97e9f43b192c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:59.066135 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-106bf762-9e4e-4322-9fb1-97e9f43b192c None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:00:59.068581 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-106bf762-9e4e-4322-9fb1-97e9f43b192c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:00:59.132139 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 485/971] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 11:00:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 11:00:59.403401 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a464e57-c0d1-4b09-aa2d-701316006404 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:59.500002 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a464e57-c0d1-4b09-aa2d-701316006404 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:59.533105 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927b44a8-dc57-4991-8139-c9cd6bd86b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:59.533785 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b44a8-dc57-4991-8139-c9cd6bd86b91 None admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:59.534114 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b44a8-dc57-4991-8139-c9cd6bd86b91 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:59.534394 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b44a8-dc57-4991-8139-c9cd6bd86b91 None admin] PATH_INFO: `/v3/services` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:59.535133 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927b44a8-dc57-4991-8139-c9cd6bd86b91 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:59.536628 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927b44a8-dc57-4991-8139-c9cd6bd86b91 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:59.552000 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 487/972] 10.222.0.25 () {60 vars in 1141 bytes} [Thu Oct 13 11:00:59 2022] POST /identity/v3/services => generated 246 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:01:01.693206 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca95802-0eca-4dd7-9ff9-09686b0faf0e None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:01:01.693739 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca95802-0eca-4dd7-9ff9-09686b0faf0e None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:01:01.693739 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca95802-0eca-4dd7-9ff9-09686b0faf0e None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:01:01.695125 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 486/973] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 11:01:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:01:01.700211 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06dcd54-be07-4505-bb5f-cd1184ab62af None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:01:01.700649 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06dcd54-be07-4505-bb5f-cd1184ab62af None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:01:01.700750 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06dcd54-be07-4505-bb5f-cd1184ab62af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:01:01.719401 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-b06dcd54-be07-4505-bb5f-cd1184ab62af None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:01:01.720570 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-b06dcd54-be07-4505-bb5f-cd1184ab62af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:01:01.729428 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:01:01.791350 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 488/974] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 11:01:01 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 11:01:02.060329 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca95802-0eca-4dd7-9ff9-09686b0faf0e None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:01:02.148010 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:01:02.158455 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca95802-0eca-4dd7-9ff9-09686b0faf0e None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:01:02.190672 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e58d84-a4d5-433c-9e7e-032dc075f091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:01:02.191281 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e58d84-a4d5-433c-9e7e-032dc075f091 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:01:02.191558 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e58d84-a4d5-433c-9e7e-032dc075f091 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:01:02.191831 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e58d84-a4d5-433c-9e7e-032dc075f091 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:01:02.192405 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e58d84-a4d5-433c-9e7e-032dc075f091 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:01:02.193759 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e58d84-a4d5-433c-9e7e-032dc075f091 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:01:02.202666 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-f2e58d84-a4d5-433c-9e7e-032dc075f091 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 13 11:01:02.202666 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 11:01:02.202666 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 11:01:02.202666 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 11:01:02.202666 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 11:01:02.202666 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 11:01:02.202666 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 11:01:02.202666 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 11:01:02.202666 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 13 11:01:02.202666 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 11:01:02.202666 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 11:01:02.202666 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 11:01:02.202666 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 11:01:02.202666 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 11:01:02.202666 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 11:01:02.202666 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 11:01:02.202666 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 11:01:02.204085 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 11:01:02.204085 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 11:01:02.204085 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 11:01:02.204085 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 11:01:02.204085 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 11:01:02.204085 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 11:01:02.204085 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 11:01:02.204085 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 11:01:02.204085 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 11:01:02.204085 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 11:01:02.204085 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 11:01:02.204085 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 11:01:02.204085 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 11:01:02.204085 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 11:01:02.204085 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 11:01:02.204085 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 11:01:02.204995 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 11:01:02.204995 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 11:01:02.204995 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 11:01:02.204995 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 11:01:02.204995 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 11:01:02.204995 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 11:01:02.204995 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 11:01:02.204995 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 11:01:02.204995 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 11:01:02.204995 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 11:01:02.204995 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 11:01:02.204995 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 11:01:02.204995 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 13 11:01:02.204995 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 11:01:02.204995 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 487/975] 10.222.0.25 () {56 vars in 1117 bytes} [Thu Oct 13 11:01:02 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 11:01:02.209396 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06dcd54-be07-4505-bb5f-cd1184ab62af None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:01:02.302913 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06dcd54-be07-4505-bb5f-cd1184ab62af None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:01:02.334303 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71faa96c-ed06-40d4-a488-2a50af483cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:01:02.334833 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71faa96c-ed06-40d4-a488-2a50af483cfb None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:01:02.335109 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71faa96c-ed06-40d4-a488-2a50af483cfb None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:01:02.335378 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71faa96c-ed06-40d4-a488-2a50af483cfb None admin] PATH_INFO: `/v3/services` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:01:02.335994 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71faa96c-ed06-40d4-a488-2a50af483cfb None admin] RBAC: Adding query filter params (name=placement) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:01:02.336295 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71faa96c-ed06-40d4-a488-2a50af483cfb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:01:02.337634 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71faa96c-ed06-40d4-a488-2a50af483cfb None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:01:02.342988 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 489/976] 10.222.0.25 () {56 vars in 1116 bytes} [Thu Oct 13 11:01:02 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:01:02.348609 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e58d84-a4d5-433c-9e7e-032dc075f091 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:01:02.443696 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e58d84-a4d5-433c-9e7e-032dc075f091 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:01:02.474903 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0e51ed-a086-4a51-868a-709eaa685d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:01:02.475488 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e51ed-a086-4a51-868a-709eaa685d04 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:01:02.475765 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e51ed-a086-4a51-868a-709eaa685d04 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:01:02.476037 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e51ed-a086-4a51-868a-709eaa685d04 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:01:02.476723 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0e51ed-a086-4a51-868a-709eaa685d04 None admin] RBAC: Adding query filter params (interface=public, service_id=faf09d2c16b9415ea66c01e6deda3907, region_id=RegionOne) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:01:02.477030 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0e51ed-a086-4a51-868a-709eaa685d04 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:01:02.478405 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0e51ed-a086-4a51-868a-709eaa685d04 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:01:02.483801 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 488/977] 10.222.0.25 () {56 vars in 1251 bytes} [Thu Oct 13 11:01:02 2022] GET /identity/v3/endpoints?service_id=faf09d2c16b9415ea66c01e6deda3907&interface=public®ion_id=RegionOne => generated 194 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:01:02.489287 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71faa96c-ed06-40d4-a488-2a50af483cfb None admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:01:02.492923 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:01:02.592387 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71faa96c-ed06-40d4-a488-2a50af483cfb None admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:01:02.625540 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2c6fe1-3528-4e71-a770-91f552a30cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:01:02.626177 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c6fe1-3528-4e71-a770-91f552a30cd3 None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:01:02.626461 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c6fe1-3528-4e71-a770-91f552a30cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:01:02.626734 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c6fe1-3528-4e71-a770-91f552a30cd3 None admin] PATH_INFO: `/v3/services` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:01:02.627341 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2c6fe1-3528-4e71-a770-91f552a30cd3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:01:02.628703 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2c6fe1-3528-4e71-a770-91f552a30cd3 None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:01:02.635416 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 490/978] 10.222.0.25 () {56 vars in 1087 bytes} [Thu Oct 13 11:01:02 2022] GET /identity/v3/services => generated 2191 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:01:04.743790 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21782acc-0e09-41e3-ab7a-38f07048645f None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:01:04.744354 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21782acc-0e09-41e3-ab7a-38f07048645f None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:01:04.744354 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21782acc-0e09-41e3-ab7a-38f07048645f None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:01:04.745693 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 489/979] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 11:01:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:01:04.750803 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda5a16-ba72-471b-9fc2-ffa0d2ee3b0d None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:01:04.751240 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda5a16-ba72-471b-9fc2-ffa0d2ee3b0d None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:01:04.751341 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda5a16-ba72-471b-9fc2-ffa0d2ee3b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:01:04.769758 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-2fda5a16-ba72-471b-9fc2-ffa0d2ee3b0d None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:01:04.770963 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-2fda5a16-ba72-471b-9fc2-ffa0d2ee3b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:01:04.828915 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:01:04.834598 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 491/980] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 11:01:04 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 11:01:05.105537 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21782acc-0e09-41e3-ab7a-38f07048645f None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:01:05.125308 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:01:05.203938 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21782acc-0e09-41e3-ab7a-38f07048645f None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:01:05.235822 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae2b64-d357-4624-bfe9-4557b68d4c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:01:05.236436 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae2b64-d357-4624-bfe9-4557b68d4c21 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:01:05.236719 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae2b64-d357-4624-bfe9-4557b68d4c21 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:01:05.236992 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae2b64-d357-4624-bfe9-4557b68d4c21 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:01:05.237571 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ae2b64-d357-4624-bfe9-4557b68d4c21 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:01:05.239197 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ae2b64-d357-4624-bfe9-4557b68d4c21 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:01:05.247729 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-58ae2b64-d357-4624-bfe9-4557b68d4c21 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 13 11:01:05.247729 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 11:01:05.247729 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 11:01:05.247729 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 11:01:05.247729 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 11:01:05.247729 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 11:01:05.247729 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 11:01:05.247729 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 11:01:05.247729 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 13 11:01:05.247729 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 11:01:05.247729 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 11:01:05.247729 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 11:01:05.247729 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 11:01:05.247729 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 11:01:05.247729 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 11:01:05.247729 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 11:01:05.247729 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 11:01:05.249168 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 11:01:05.249168 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 11:01:05.249168 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 11:01:05.249168 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 11:01:05.249168 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 11:01:05.249168 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 11:01:05.249168 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 11:01:05.249168 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 11:01:05.249168 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 11:01:05.249168 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 11:01:05.249168 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 11:01:05.249168 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 11:01:05.249168 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 11:01:05.249168 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 11:01:05.249168 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 11:01:05.249168 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 11:01:05.250063 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 11:01:05.250063 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Oct 13 11:01:05.250063 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 11:01:05.250063 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Oct 13 11:01:05.250063 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 11:01:05.250063 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 11:01:05.250063 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 11:01:05.250063 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Oct 13 11:01:05.250063 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 11:01:05.250063 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Oct 13 11:01:05.250063 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 11:01:05.250063 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 11:01:05.250063 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 13 11:01:05.250063 dv-cinder-861001-1-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Oct 13 11:01:05.250063 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 490/981] 10.222.0.25 () {56 vars in 1117 bytes} [Thu Oct 13 11:01:05 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 11:01:05.255153 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fda5a16-ba72-471b-9fc2-ffa0d2ee3b0d None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:01:05.348533 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fda5a16-ba72-471b-9fc2-ffa0d2ee3b0d None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:01:05.381969 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08cac98-4a0b-4403-a890-fad58c3e9e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:01:05.382508 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08cac98-4a0b-4403-a890-fad58c3e9e3d None admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:01:05.382775 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08cac98-4a0b-4403-a890-fad58c3e9e3d None admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:01:05.383039 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08cac98-4a0b-4403-a890-fad58c3e9e3d None admin] PATH_INFO: `/v3/services` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:01:05.383657 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08cac98-4a0b-4403-a890-fad58c3e9e3d None admin] RBAC: Adding query filter params (name=placement) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:01:05.383952 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08cac98-4a0b-4403-a890-fad58c3e9e3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:01:05.385285 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08cac98-4a0b-4403-a890-fad58c3e9e3d None admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:01:05.390229 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 492/982] 10.222.0.25 () {56 vars in 1116 bytes} [Thu Oct 13 11:01:05 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:01:05.395859 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae2b64-d357-4624-bfe9-4557b68d4c21 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:01:05.475985 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:01:05.494878 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae2b64-d357-4624-bfe9-4557b68d4c21 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:01:05.529788 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f323c30-2188-4202-8a51-1d7c74c8508c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:01:05.530630 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f323c30-2188-4202-8a51-1d7c74c8508c None admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:01:05.530926 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f323c30-2188-4202-8a51-1d7c74c8508c None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:01:05.531173 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f323c30-2188-4202-8a51-1d7c74c8508c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:01:05.531922 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f323c30-2188-4202-8a51-1d7c74c8508c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:01:05.533484 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f323c30-2188-4202-8a51-1d7c74c8508c None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:01:05.555272 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 491/983] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:01:05 2022] POST /identity/v3/endpoints => generated 331 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:01:15.387239 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=69 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:01:15.550892 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:02:08.838101 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef7d547-c634-4cd3-a1d4-ad56020c0064 None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:08.838599 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef7d547-c634-4cd3-a1d4-ad56020c0064 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:08.838693 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef7d547-c634-4cd3-a1d4-ad56020c0064 None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:08.841382 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 493/984] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 11:02:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:02:08.847057 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93511b53-4588-482a-bfb6-1904b8a6ad90 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:08.847511 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93511b53-4588-482a-bfb6-1904b8a6ad90 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:08.847590 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93511b53-4588-482a-bfb6-1904b8a6ad90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:08.930380 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-93511b53-4588-482a-bfb6-1904b8a6ad90 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:02:08.931588 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-93511b53-4588-482a-bfb6-1904b8a6ad90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:09.044496 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 492/985] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 11:02:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:02:09.334921 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50070bc-38a4-4617-be77-bf502b90690e None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:09.335283 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50070bc-38a4-4617-be77-bf502b90690e None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:09.335774 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50070bc-38a4-4617-be77-bf502b90690e None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:09.337162 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 494/986] 10.222.0.25 () {54 vars in 964 bytes} [Thu Oct 13 11:02:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:02:09.343945 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad7902d-eca8-43bc-8c6c-858ed2c7b3e4 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:09.344309 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad7902d-eca8-43bc-8c6c-858ed2c7b3e4 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:09.344671 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad7902d-eca8-43bc-8c6c-858ed2c7b3e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:09.425402 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-2ad7902d-eca8-43bc-8c6c-858ed2c7b3e4 None None] MFA Rules not processed for user `085e8bffed444287bc5f805461c3fb55`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:02:09.426734 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-2ad7902d-eca8-43bc-8c6c-858ed2c7b3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:09.447665 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:02:09.506605 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 493/987] 10.222.0.25 () {58 vars in 1061 bytes} [Thu Oct 13 11:02:09 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:02:09.515745 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50070bc-38a4-4617-be77-bf502b90690e None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:02:09.517595 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-c50070bc-38a4-4617-be77-bf502b90690e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:09.641410 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50070bc-38a4-4617-be77-bf502b90690e None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:02:09.728419 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61751ae3-f2f8-4c67-b79b-5a3e391ce9b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:02:09.729045 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61751ae3-f2f8-4c67-b79b-5a3e391ce9b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:09.729324 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61751ae3-f2f8-4c67-b79b-5a3e391ce9b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:09.729593 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61751ae3-f2f8-4c67-b79b-5a3e391ce9b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:09.731302 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-61751ae3-f2f8-4c67-b79b-5a3e391ce9b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:09.792599 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:02:09.852380 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61751ae3-f2f8-4c67-b79b-5a3e391ce9b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:02:09.854003 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61751ae3-f2f8-4c67-b79b-5a3e391ce9b4 service neutron] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:02:09.874314 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 495/988] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:02:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:02:12.294901 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d8c5a-9edf-4b12-8056-2b51daa5d45a None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:12.295384 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d8c5a-9edf-4b12-8056-2b51daa5d45a None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:12.295475 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d8c5a-9edf-4b12-8056-2b51daa5d45a None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:12.297029 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 494/989] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 11:02:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:02:12.302624 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081794d-35e1-481b-9f4b-1c6160641ca0 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:12.303502 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081794d-35e1-481b-9f4b-1c6160641ca0 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:12.304006 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081794d-35e1-481b-9f4b-1c6160641ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:12.392129 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-2081794d-35e1-481b-9f4b-1c6160641ca0 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:02:12.393348 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-2081794d-35e1-481b-9f4b-1c6160641ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:12.489374 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 496/990] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 11:02:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:02:12.796021 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931d8c5a-9edf-4b12-8056-2b51daa5d45a None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:02:12.797603 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-931d8c5a-9edf-4b12-8056-2b51daa5d45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:12.900764 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931d8c5a-9edf-4b12-8056-2b51daa5d45a None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:02:12.974151 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:02:12.976822 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbac4580-22e4-4047-9ec4-785432f88294 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:02:12.977443 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac4580-22e4-4047-9ec4-785432f88294 service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:12.978001 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac4580-22e4-4047-9ec4-785432f88294 service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:12.978467 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac4580-22e4-4047-9ec4-785432f88294 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:12.980681 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-cbac4580-22e4-4047-9ec4-785432f88294 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:13.087810 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbac4580-22e4-4047-9ec4-785432f88294 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:02:13.089172 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbac4580-22e4-4047-9ec4-785432f88294 service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:02:13.110214 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 495/991] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:02:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:02:15.537854 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78e965-cce7-45c8-b17a-7c20ecc20076 None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:15.538468 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78e965-cce7-45c8-b17a-7c20ecc20076 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:15.538699 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78e965-cce7-45c8-b17a-7c20ecc20076 None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:15.540566 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 497/992] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 11:02:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:02:15.545826 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb12dd5-d1f6-4aea-ba43-4ad5b767a883 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:15.546257 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb12dd5-d1f6-4aea-ba43-4ad5b767a883 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:15.546421 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb12dd5-d1f6-4aea-ba43-4ad5b767a883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:15.609923 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-dfb12dd5-d1f6-4aea-ba43-4ad5b767a883 None None] MFA Rules not processed for user `88156daaeeb84adf93ec5b93ed8bb55e`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:02:15.611153 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-dfb12dd5-d1f6-4aea-ba43-4ad5b767a883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:15.660862 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:02:15.711653 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 496/993] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 11:02:15 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 11:02:16.010982 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece49dd3-f4fe-4318-8f78-c0e0bc4cc27e None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:16.011265 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece49dd3-f4fe-4318-8f78-c0e0bc4cc27e None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:16.011539 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece49dd3-f4fe-4318-8f78-c0e0bc4cc27e None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:16.012903 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 498/994] 10.222.0.25 () {54 vars in 964 bytes} [Thu Oct 13 11:02:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:02:16.018669 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3feaa-51db-4f65-bc9e-75b8c151b74f None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:16.018957 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3feaa-51db-4f65-bc9e-75b8c151b74f None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:16.019936 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3feaa-51db-4f65-bc9e-75b8c151b74f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:16.093117 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-96e3feaa-51db-4f65-bc9e-75b8c151b74f None None] MFA Rules not processed for user `085e8bffed444287bc5f805461c3fb55`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:02:16.094355 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-96e3feaa-51db-4f65-bc9e-75b8c151b74f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:16.168408 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 497/995] 10.222.0.25 () {58 vars in 1061 bytes} [Thu Oct 13 11:02:16 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:02:16.177893 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece49dd3-f4fe-4318-8f78-c0e0bc4cc27e None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:02:16.179434 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-ece49dd3-f4fe-4318-8f78-c0e0bc4cc27e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:16.190328 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:02:16.280144 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece49dd3-f4fe-4318-8f78-c0e0bc4cc27e None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:02:16.350430 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb53727-5818-41a8-af3e-c72f9b9b1b05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:02:16.351025 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb53727-5818-41a8-af3e-c72f9b9b1b05 service neutron] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:16.351299 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb53727-5818-41a8-af3e-c72f9b9b1b05 service neutron] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:16.351568 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb53727-5818-41a8-af3e-c72f9b9b1b05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:16.353129 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-ebb53727-5818-41a8-af3e-c72f9b9b1b05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:16.412776 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:02:16.458160 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb53727-5818-41a8-af3e-c72f9b9b1b05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:02:16.459503 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb53727-5818-41a8-af3e-c72f9b9b1b05 service neutron] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:02:16.477125 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 499/996] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:02:16 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:02:19.491734 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81af82e-fd9c-465f-8735-6efb5e54dc3b None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:19.492280 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81af82e-fd9c-465f-8735-6efb5e54dc3b None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:19.492280 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81af82e-fd9c-465f-8735-6efb5e54dc3b None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:19.493609 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 498/997] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 11:02:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:02:19.498772 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a5644f-d825-439c-a8f1-8acbcd5501e4 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:19.499151 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a5644f-d825-439c-a8f1-8acbcd5501e4 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:19.499317 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a5644f-d825-439c-a8f1-8acbcd5501e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:19.566509 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-55a5644f-d825-439c-a8f1-8acbcd5501e4 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:02:19.567718 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-55a5644f-d825-439c-a8f1-8acbcd5501e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:19.660794 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 500/998] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 11:02:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:02:19.943700 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81af82e-fd9c-465f-8735-6efb5e54dc3b None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:02:19.945237 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-b81af82e-fd9c-465f-8735-6efb5e54dc3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:19.994474 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:02:20.045479 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81af82e-fd9c-465f-8735-6efb5e54dc3b None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:02:20.115377 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a20efba-0b31-4d79-bbf0-acf6a1a18f12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:02:20.115966 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20efba-0b31-4d79-bbf0-acf6a1a18f12 service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:20.116237 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20efba-0b31-4d79-bbf0-acf6a1a18f12 service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:20.116502 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20efba-0b31-4d79-bbf0-acf6a1a18f12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:20.118095 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-9a20efba-0b31-4d79-bbf0-acf6a1a18f12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:20.208939 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:02:20.221853 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a20efba-0b31-4d79-bbf0-acf6a1a18f12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:02:20.223291 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a20efba-0b31-4d79-bbf0-acf6a1a18f12 service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:02:20.240644 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 499/999] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:02:19 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:02:23.026052 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a4b05-4c7d-4558-8c8b-2b25affb88ad None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:23.026605 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a4b05-4c7d-4558-8c8b-2b25affb88ad None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:23.026605 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a4b05-4c7d-4558-8c8b-2b25affb88ad None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:23.028109 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 501/1000] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 11:02:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:02:23.033672 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c830f35-76ad-47dc-9fde-6b67400958e0 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:23.034254 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c830f35-76ad-47dc-9fde-6b67400958e0 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:23.034254 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c830f35-76ad-47dc-9fde-6b67400958e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:23.105451 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-0c830f35-76ad-47dc-9fde-6b67400958e0 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:02:23.106747 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-0c830f35-76ad-47dc-9fde-6b67400958e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:23.208222 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 500/1001] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 11:02:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:02:23.492085 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681a4b05-4c7d-4558-8c8b-2b25affb88ad None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:02:23.493611 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-681a4b05-4c7d-4558-8c8b-2b25affb88ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:23.514314 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:02:23.598016 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681a4b05-4c7d-4558-8c8b-2b25affb88ad None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:02:23.670399 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dadb62b-1ae0-4406-a7b6-a7de23f66d3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:02:23.670995 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dadb62b-1ae0-4406-a7b6-a7de23f66d3c service neutron] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:23.671272 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dadb62b-1ae0-4406-a7b6-a7de23f66d3c service neutron] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:23.671538 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dadb62b-1ae0-4406-a7b6-a7de23f66d3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:23.673096 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-1dadb62b-1ae0-4406-a7b6-a7de23f66d3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:23.743853 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:02:23.781701 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dadb62b-1ae0-4406-a7b6-a7de23f66d3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:02:23.783163 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dadb62b-1ae0-4406-a7b6-a7de23f66d3c service neutron] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:02:23.801410 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 502/1002] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:02:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:02:25.994963 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53f044-716d-468d-a5da-fac8f9d312c1 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:25.995531 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53f044-716d-468d-a5da-fac8f9d312c1 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:25.995531 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53f044-716d-468d-a5da-fac8f9d312c1 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:25.996881 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 501/1003] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 11:02:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:02:26.002121 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbda8c6-bde3-47f9-8d6d-a73b63d283f5 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:26.002506 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbda8c6-bde3-47f9-8d6d-a73b63d283f5 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:26.002705 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbda8c6-bde3-47f9-8d6d-a73b63d283f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:26.069252 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-8bbda8c6-bde3-47f9-8d6d-a73b63d283f5 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:02:26.070469 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-8bbda8c6-bde3-47f9-8d6d-a73b63d283f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:26.175235 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 503/1004] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 11:02:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:02:26.450664 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b53f044-716d-468d-a5da-fac8f9d312c1 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:02:26.452191 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-6b53f044-716d-468d-a5da-fac8f9d312c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:26.510452 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:02:26.555481 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b53f044-716d-468d-a5da-fac8f9d312c1 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:02:26.628957 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86950400-c58d-4c6e-8e0f-17c2cc98634e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:02:26.629555 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86950400-c58d-4c6e-8e0f-17c2cc98634e service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:26.629830 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86950400-c58d-4c6e-8e0f-17c2cc98634e service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:26.630128 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86950400-c58d-4c6e-8e0f-17c2cc98634e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:26.631701 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-86950400-c58d-4c6e-8e0f-17c2cc98634e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:26.737480 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:02:26.740091 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86950400-c58d-4c6e-8e0f-17c2cc98634e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:02:26.741900 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86950400-c58d-4c6e-8e0f-17c2cc98634e service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:02:26.759831 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 502/1005] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:02:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:02:28.932423 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a9299-d67b-4523-95a0-65c9c2a1a204 None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:28.932915 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a9299-d67b-4523-95a0-65c9c2a1a204 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:28.932915 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a9299-d67b-4523-95a0-65c9c2a1a204 None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:28.934876 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 504/1006] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 11:02:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:02:28.940086 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc3943d-21a2-49b2-b75b-4bb1fa7a854b None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:28.940491 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc3943d-21a2-49b2-b75b-4bb1fa7a854b None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:28.940642 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc3943d-21a2-49b2-b75b-4bb1fa7a854b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:29.005587 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-4cc3943d-21a2-49b2-b75b-4bb1fa7a854b None None] MFA Rules not processed for user `88156daaeeb84adf93ec5b93ed8bb55e`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:02:29.006833 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-4cc3943d-21a2-49b2-b75b-4bb1fa7a854b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:29.103797 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 503/1007] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 11:02:28 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:02:29.385084 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815a9299-d67b-4523-95a0-65c9c2a1a204 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:02:29.386670 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-815a9299-d67b-4523-95a0-65c9c2a1a204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:29.419765 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:02:29.495847 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815a9299-d67b-4523-95a0-65c9c2a1a204 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:02:29.569126 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f679b9-a4af-44b8-a675-8f2411bee7b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:02:29.569756 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f679b9-a4af-44b8-a675-8f2411bee7b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:29.570062 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f679b9-a4af-44b8-a675-8f2411bee7b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:29.570328 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f679b9-a4af-44b8-a675-8f2411bee7b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:29.571896 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-54f679b9-a4af-44b8-a675-8f2411bee7b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:29.646968 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:02:29.678026 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f679b9-a4af-44b8-a675-8f2411bee7b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:02:29.679451 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f679b9-a4af-44b8-a675-8f2411bee7b7 service neutron] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:02:29.697290 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 505/1008] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:02:29 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:02:32.037226 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef66c42-fbfa-493b-9a87-704de00b0c20 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:32.037815 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef66c42-fbfa-493b-9a87-704de00b0c20 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:32.037815 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef66c42-fbfa-493b-9a87-704de00b0c20 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:32.039147 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 504/1009] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 11:02:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:02:32.044522 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7418d5-1304-49ab-ae2b-322ef76faebd None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:32.044926 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7418d5-1304-49ab-ae2b-322ef76faebd None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:32.045075 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7418d5-1304-49ab-ae2b-322ef76faebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:32.109261 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-9e7418d5-1304-49ab-ae2b-322ef76faebd None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:02:32.110485 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-9e7418d5-1304-49ab-ae2b-322ef76faebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:32.205280 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 506/1010] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 11:02:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 11:02:32.485112 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef66c42-fbfa-493b-9a87-704de00b0c20 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:02:32.486697 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-6ef66c42-fbfa-493b-9a87-704de00b0c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:32.555444 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:02:32.588863 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef66c42-fbfa-493b-9a87-704de00b0c20 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:02:32.659772 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd445a62-8e12-4b2d-9fe4-f015d9ef888e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:02:32.660374 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd445a62-8e12-4b2d-9fe4-f015d9ef888e service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:32.660654 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd445a62-8e12-4b2d-9fe4-f015d9ef888e service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:32.660931 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd445a62-8e12-4b2d-9fe4-f015d9ef888e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:32.662550 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-dd445a62-8e12-4b2d-9fe4-f015d9ef888e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:32.767760 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd445a62-8e12-4b2d-9fe4-f015d9ef888e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:02:32.769104 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd445a62-8e12-4b2d-9fe4-f015d9ef888e service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:02:32.779138 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:02:32.788056 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 505/1011] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:02:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:02:34.961503 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1bca6-045e-47b9-8601-14ce2a39fb5a None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:34.962089 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1bca6-045e-47b9-8601-14ce2a39fb5a None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:34.962089 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1bca6-045e-47b9-8601-14ce2a39fb5a None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:34.963383 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 507/1012] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 11:02:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:02:34.968524 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f3d30b-b077-443c-aec6-e82776cedb74 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:34.968965 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f3d30b-b077-443c-aec6-e82776cedb74 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:34.969073 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f3d30b-b077-443c-aec6-e82776cedb74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:35.033934 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-02f3d30b-b077-443c-aec6-e82776cedb74 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:02:35.035162 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-02f3d30b-b077-443c-aec6-e82776cedb74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:35.129294 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 506/1013] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 11:02:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:02:35.411026 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc1bca6-045e-47b9-8601-14ce2a39fb5a None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:02:35.412574 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-8cc1bca6-045e-47b9-8601-14ce2a39fb5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:35.453087 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:02:35.515029 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc1bca6-045e-47b9-8601-14ce2a39fb5a None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:02:35.591502 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971a86bb-cd13-4cb5-89c2-4041fa455c5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:02:35.592111 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a86bb-cd13-4cb5-89c2-4041fa455c5d service neutron] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:35.592391 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a86bb-cd13-4cb5-89c2-4041fa455c5d service neutron] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:35.592662 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a86bb-cd13-4cb5-89c2-4041fa455c5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:35.594317 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-971a86bb-cd13-4cb5-89c2-4041fa455c5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:35.675140 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:02:35.700508 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971a86bb-cd13-4cb5-89c2-4041fa455c5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:02:35.701989 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971a86bb-cd13-4cb5-89c2-4041fa455c5d service neutron] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:02:35.720093 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 508/1014] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:02:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:02:38.135143 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e354f576-add6-4d87-afe0-0afd7119f785 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:38.135674 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e354f576-add6-4d87-afe0-0afd7119f785 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:38.135674 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e354f576-add6-4d87-afe0-0afd7119f785 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:38.137597 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 507/1015] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 11:02:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:02:38.142777 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ccc9d8-a91f-4a4f-b6b0-5f649c139da8 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:38.143212 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ccc9d8-a91f-4a4f-b6b0-5f649c139da8 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:38.143330 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ccc9d8-a91f-4a4f-b6b0-5f649c139da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:38.216933 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-56ccc9d8-a91f-4a4f-b6b0-5f649c139da8 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:02:38.218168 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-56ccc9d8-a91f-4a4f-b6b0-5f649c139da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:38.312654 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 509/1016] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 11:02:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:02:38.590046 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e354f576-add6-4d87-afe0-0afd7119f785 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:02:38.591575 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-e354f576-add6-4d87-afe0-0afd7119f785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:38.665328 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:02:38.692955 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e354f576-add6-4d87-afe0-0afd7119f785 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:02:38.764615 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8dc4e9-1bd6-48c1-87d0-89fda9619898 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:02:38.765217 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8dc4e9-1bd6-48c1-87d0-89fda9619898 service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:38.765494 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8dc4e9-1bd6-48c1-87d0-89fda9619898 service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:38.765767 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8dc4e9-1bd6-48c1-87d0-89fda9619898 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:38.767376 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-fe8dc4e9-1bd6-48c1-87d0-89fda9619898 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:38.872423 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8dc4e9-1bd6-48c1-87d0-89fda9619898 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:02:38.873769 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8dc4e9-1bd6-48c1-87d0-89fda9619898 service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:02:38.893792 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 508/1017] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:02:38 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:02:42.876385 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a8ebf1-b2a4-40f5-a5c2-a69fba0155cd None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:42.876883 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a8ebf1-b2a4-40f5-a5c2-a69fba0155cd None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:42.876883 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a8ebf1-b2a4-40f5-a5c2-a69fba0155cd None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:42.878446 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 510/1018] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 11:02:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 11:02:42.883653 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f15d5-56b8-4096-b918-c179c3aaef9d None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:42.884040 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f15d5-56b8-4096-b918-c179c3aaef9d None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:42.884198 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f15d5-56b8-4096-b918-c179c3aaef9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:42.890158 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:02:42.950268 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-f61f15d5-56b8-4096-b918-c179c3aaef9d None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:02:42.951467 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-f61f15d5-56b8-4096-b918-c179c3aaef9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:43.048308 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 509/1019] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 11:02:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:02:43.329205 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a8ebf1-b2a4-40f5-a5c2-a69fba0155cd None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:02:43.330799 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-83a8ebf1-b2a4-40f5-a5c2-a69fba0155cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:43.379464 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:02:43.434762 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a8ebf1-b2a4-40f5-a5c2-a69fba0155cd None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:02:43.509458 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8625823a-3d9f-47bf-89ea-9591f2598753 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:02:43.510107 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8625823a-3d9f-47bf-89ea-9591f2598753 service neutron] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:43.510387 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8625823a-3d9f-47bf-89ea-9591f2598753 service neutron] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:43.510657 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8625823a-3d9f-47bf-89ea-9591f2598753 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:43.512327 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-8625823a-3d9f-47bf-89ea-9591f2598753 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:43.606796 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:02:43.623630 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8625823a-3d9f-47bf-89ea-9591f2598753 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:02:43.625053 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8625823a-3d9f-47bf-89ea-9591f2598753 service neutron] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:02:43.642795 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 511/1020] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:02:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:02:46.419498 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c5a11-b125-4989-963c-1d25ee5be6c7 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:46.420026 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c5a11-b125-4989-963c-1d25ee5be6c7 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:46.420026 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c5a11-b125-4989-963c-1d25ee5be6c7 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:46.421377 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 510/1021] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 11:02:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:02:46.426639 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec5606-036a-441c-949e-e434c40bff6a None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:46.427196 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec5606-036a-441c-949e-e434c40bff6a None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:46.427306 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec5606-036a-441c-949e-e434c40bff6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:46.495011 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-4cec5606-036a-441c-949e-e434c40bff6a None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:02:46.496249 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-4cec5606-036a-441c-949e-e434c40bff6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:46.611286 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 512/1022] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 11:02:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:02:46.893969 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4c5a11-b125-4989-963c-1d25ee5be6c7 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:02:46.895550 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-4a4c5a11-b125-4989-963c-1d25ee5be6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:46.983706 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:02:47.003450 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4c5a11-b125-4989-963c-1d25ee5be6c7 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:02:47.078762 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83382683-9e0e-4968-8fed-3bfc9917c06f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:02:47.079461 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83382683-9e0e-4968-8fed-3bfc9917c06f service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:47.079743 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83382683-9e0e-4968-8fed-3bfc9917c06f service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:47.080013 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83382683-9e0e-4968-8fed-3bfc9917c06f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:47.081602 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-83382683-9e0e-4968-8fed-3bfc9917c06f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:47.187009 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83382683-9e0e-4968-8fed-3bfc9917c06f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:02:47.188437 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83382683-9e0e-4968-8fed-3bfc9917c06f service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:02:47.208578 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 511/1023] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:02:46 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:02:51.285333 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40dc615-3e21-408e-852e-0e7db78b8d89 None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:51.285842 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40dc615-3e21-408e-852e-0e7db78b8d89 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:51.285932 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40dc615-3e21-408e-852e-0e7db78b8d89 None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:51.287223 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 513/1024] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 11:02:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:02:51.292659 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a208a-b85b-43e4-b5df-daef609c3e7b None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:51.293046 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a208a-b85b-43e4-b5df-daef609c3e7b None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:51.293239 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a208a-b85b-43e4-b5df-daef609c3e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:51.308953 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:02:51.363881 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-6d1a208a-b85b-43e4-b5df-daef609c3e7b None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:02:51.365446 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-6d1a208a-b85b-43e4-b5df-daef609c3e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:51.461672 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 512/1025] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 11:02:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:02:51.755288 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40dc615-3e21-408e-852e-0e7db78b8d89 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:02:51.756811 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-f40dc615-3e21-408e-852e-0e7db78b8d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:51.815123 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:02:51.859972 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40dc615-3e21-408e-852e-0e7db78b8d89 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:02:51.932892 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff987af-0096-42e6-aeb0-abf1365a9e9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:02:51.933521 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff987af-0096-42e6-aeb0-abf1365a9e9d service neutron] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:51.933812 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff987af-0096-42e6-aeb0-abf1365a9e9d service neutron] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:51.934117 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff987af-0096-42e6-aeb0-abf1365a9e9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:51.935691 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-3ff987af-0096-42e6-aeb0-abf1365a9e9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:52.038280 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:02:52.041994 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff987af-0096-42e6-aeb0-abf1365a9e9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:02:52.043659 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff987af-0096-42e6-aeb0-abf1365a9e9d service neutron] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:02:52.060858 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 514/1026] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:02:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:02:56.968115 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec97ff8c-e027-492c-a72c-cf36043cb554 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:56.969316 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec97ff8c-e027-492c-a72c-cf36043cb554 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:56.969826 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec97ff8c-e027-492c-a72c-cf36043cb554 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:56.971719 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 513/1027] 10.222.0.25 () {54 vars in 921 bytes} [Thu Oct 13 11:02:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:02:56.978953 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce55725c-525c-42b1-a428-af337cf3b493 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:56.979385 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce55725c-525c-42b1-a428-af337cf3b493 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:56.979523 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce55725c-525c-42b1-a428-af337cf3b493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:57.111322 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-ce55725c-525c-42b1-a428-af337cf3b493 None None] MFA Rules not processed for user `ed4bb75e68a640fc92ddd47fad61a25a`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:02:57.112470 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-ce55725c-525c-42b1-a428-af337cf3b493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:57.253538 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 515/1028] 10.222.0.25 () {58 vars in 1018 bytes} [Thu Oct 13 11:02:56 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:03:01.409080 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a6cf39-68fe-4b9c-8baa-b5d053e28af7 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:01.409649 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a6cf39-68fe-4b9c-8baa-b5d053e28af7 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:01.409649 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a6cf39-68fe-4b9c-8baa-b5d053e28af7 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:01.410991 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 514/1029] 10.222.0.25 () {54 vars in 921 bytes} [Thu Oct 13 11:03:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:03:01.416430 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3833709-d507-446c-a65f-7c419afe7cca None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:01.416898 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3833709-d507-446c-a65f-7c419afe7cca None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:01.417206 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3833709-d507-446c-a65f-7c419afe7cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:01.460090 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=59 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:03:01.475502 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:03:01.499935 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-a3833709-d507-446c-a65f-7c419afe7cca None None] MFA Rules not processed for user `ed4bb75e68a640fc92ddd47fad61a25a`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:03:01.501298 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-a3833709-d507-446c-a65f-7c419afe7cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:01.609980 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 516/1030] 10.222.0.25 () {58 vars in 1018 bytes} [Thu Oct 13 11:03:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:03:02.948952 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cebaba-caa6-4d34-936f-ac785ff26d76 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:02.949553 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cebaba-caa6-4d34-936f-ac785ff26d76 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:02.949648 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cebaba-caa6-4d34-936f-ac785ff26d76 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:02.951060 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 515/1031] 10.222.0.25 () {54 vars in 921 bytes} [Thu Oct 13 11:03:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:03:02.956015 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19972212-c548-4479-b669-e3682cf59235 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:02.956471 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19972212-c548-4479-b669-e3682cf59235 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:02.956574 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19972212-c548-4479-b669-e3682cf59235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:03.032945 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-19972212-c548-4479-b669-e3682cf59235 None None] MFA Rules not processed for user `ed4bb75e68a640fc92ddd47fad61a25a`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:03:03.034274 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-19972212-c548-4479-b669-e3682cf59235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:03.074724 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:03:03.141527 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 517/1032] 10.222.0.25 () {58 vars in 1018 bytes} [Thu Oct 13 11:03:02 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 11:03:06.690052 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233bb83c-934c-4406-8549-f89e17fd8dbe None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:06.690656 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233bb83c-934c-4406-8549-f89e17fd8dbe None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:06.690845 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233bb83c-934c-4406-8549-f89e17fd8dbe None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:06.692427 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 516/1033] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 11:03:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:03:06.697832 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74f006-c9ca-4dc8-9817-a15b0fff2f8b None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:06.698990 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74f006-c9ca-4dc8-9817-a15b0fff2f8b None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:06.699198 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74f006-c9ca-4dc8-9817-a15b0fff2f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:06.773882 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-ed74f006-c9ca-4dc8-9817-a15b0fff2f8b None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:03:06.775284 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-ed74f006-c9ca-4dc8-9817-a15b0fff2f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:06.884085 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 518/1034] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 11:03:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:03:07.192368 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f40492-e114-4dc3-8c04-68c1ad1b851b None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:07.192876 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f40492-e114-4dc3-8c04-68c1ad1b851b None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:07.193277 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f40492-e114-4dc3-8c04-68c1ad1b851b None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:07.197416 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 517/1035] 10.222.0.25 () {54 vars in 961 bytes} [Thu Oct 13 11:03:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:03:07.206367 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363392a9-21b3-4207-9311-a93323b6ceb9 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:07.206675 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363392a9-21b3-4207-9311-a93323b6ceb9 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:07.207057 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363392a9-21b3-4207-9311-a93323b6ceb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:07.226602 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:03:07.296466 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-363392a9-21b3-4207-9311-a93323b6ceb9 None None] MFA Rules not processed for user `78384fbffdd346578855e7214b335d8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:03:07.297762 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-363392a9-21b3-4207-9311-a93323b6ceb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:07.421289 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 519/1036] 10.222.0.25 () {58 vars in 1058 bytes} [Thu Oct 13 11:03:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:03:07.428949 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f40492-e114-4dc3-8c04-68c1ad1b851b None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:03:07.430765 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-e3f40492-e114-4dc3-8c04-68c1ad1b851b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:07.586903 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f40492-e114-4dc3-8c04-68c1ad1b851b None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:03:07.661462 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:03:07.706813 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abbf36f-dff8-4b1d-a2da-3a146d5fc3e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78384fbffdd346578855e7214b335d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:03:07.707480 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abbf36f-dff8-4b1d-a2da-3a146d5fc3e4 service nova] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:07.707743 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abbf36f-dff8-4b1d-a2da-3a146d5fc3e4 service nova] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:07.707915 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abbf36f-dff8-4b1d-a2da-3a146d5fc3e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:07.709480 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-9abbf36f-dff8-4b1d-a2da-3a146d5fc3e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:07.811728 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abbf36f-dff8-4b1d-a2da-3a146d5fc3e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:03:07.813680 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abbf36f-dff8-4b1d-a2da-3a146d5fc3e4 service nova] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:03:07.834878 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 518/1037] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:03:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:03:10.207037 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf5e3b-9650-4bdd-89ac-e9b177611166 None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:10.207686 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf5e3b-9650-4bdd-89ac-e9b177611166 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:10.207686 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf5e3b-9650-4bdd-89ac-e9b177611166 None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:10.214088 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e77da-c250-4ba3-9cbc-a5831e395a08 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:10.214681 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e77da-c250-4ba3-9cbc-a5831e395a08 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:10.214681 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e77da-c250-4ba3-9cbc-a5831e395a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:10.219180 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 520/1038] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 11:03:10 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:03:10.282119 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-268e77da-c250-4ba3-9cbc-a5831e395a08 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:03:10.283308 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-268e77da-c250-4ba3-9cbc-a5831e395a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:10.322189 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:03:10.393861 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 519/1039] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 11:03:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 11:03:10.679547 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acf5e3b-9650-4bdd-89ac-e9b177611166 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:03:10.681061 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-3acf5e3b-9650-4bdd-89ac-e9b177611166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:10.758733 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:03:10.858886 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acf5e3b-9650-4bdd-89ac-e9b177611166 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:03:11.005993 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60b4a6a-a70b-48e6-986d-e12b7435ca8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78384fbffdd346578855e7214b335d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:03:11.006646 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b4a6a-a70b-48e6-986d-e12b7435ca8c service nova] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:11.006856 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b4a6a-a70b-48e6-986d-e12b7435ca8c service nova] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:11.007120 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b4a6a-a70b-48e6-986d-e12b7435ca8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:11.009002 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-d60b4a6a-a70b-48e6-986d-e12b7435ca8c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:11.032337 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:03:11.101653 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60b4a6a-a70b-48e6-986d-e12b7435ca8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:03:11.103203 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60b4a6a-a70b-48e6-986d-e12b7435ca8c service nova] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:03:11.122067 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 521/1040] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:03:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:03:13.577672 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec2377a-f12c-4a1d-889d-ac216f415ae5 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:13.578292 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec2377a-f12c-4a1d-889d-ac216f415ae5 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:13.578292 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec2377a-f12c-4a1d-889d-ac216f415ae5 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:13.582000 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 520/1041] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 11:03:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:03:13.585469 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a7dba-dfd2-4165-a041-98001a51e1a7 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:13.585929 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a7dba-dfd2-4165-a041-98001a51e1a7 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:13.586048 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a7dba-dfd2-4165-a041-98001a51e1a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:13.656414 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-ff2a7dba-dfd2-4165-a041-98001a51e1a7 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:03:13.657531 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-ff2a7dba-dfd2-4165-a041-98001a51e1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:13.757695 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:03:13.762027 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 522/1042] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 11:03:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:03:14.061807 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4af8c9-44e9-4cbd-95a5-0594de44034e None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:14.062136 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4af8c9-44e9-4cbd-95a5-0594de44034e None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:14.062420 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4af8c9-44e9-4cbd-95a5-0594de44034e None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:14.063925 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 521/1043] 10.222.0.25 () {54 vars in 961 bytes} [Thu Oct 13 11:03:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:03:14.069581 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b7bf40-054a-4e29-a17b-98c8f7127bac None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:14.069953 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b7bf40-054a-4e29-a17b-98c8f7127bac None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:14.070298 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b7bf40-054a-4e29-a17b-98c8f7127bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:14.149737 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-73b7bf40-054a-4e29-a17b-98c8f7127bac None None] MFA Rules not processed for user `78384fbffdd346578855e7214b335d8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:03:14.150961 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-73b7bf40-054a-4e29-a17b-98c8f7127bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:14.273470 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 523/1044] 10.222.0.25 () {58 vars in 1058 bytes} [Thu Oct 13 11:03:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:03:14.281020 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4af8c9-44e9-4cbd-95a5-0594de44034e None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:03:14.282568 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-9f4af8c9-44e9-4cbd-95a5-0594de44034e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:14.432351 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4af8c9-44e9-4cbd-95a5-0594de44034e None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:03:14.453567 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:03:14.553705 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066afe87-70c4-4db1-b816-fc0e88c444d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78384fbffdd346578855e7214b335d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:03:14.554363 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066afe87-70c4-4db1-b816-fc0e88c444d0 service nova] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:14.554638 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066afe87-70c4-4db1-b816-fc0e88c444d0 service nova] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:14.554905 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066afe87-70c4-4db1-b816-fc0e88c444d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:14.556486 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-066afe87-70c4-4db1-b816-fc0e88c444d0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:14.651561 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066afe87-70c4-4db1-b816-fc0e88c444d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:03:14.653142 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066afe87-70c4-4db1-b816-fc0e88c444d0 service nova] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:03:14.673423 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 522/1045] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:03:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:03:14.839613 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75238e0b-a923-480a-a6b7-fa50900cedf8 None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:14.840203 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75238e0b-a923-480a-a6b7-fa50900cedf8 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:14.840203 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75238e0b-a923-480a-a6b7-fa50900cedf8 None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:14.841764 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 524/1046] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 11:03:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:03:14.847457 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6befaebf-2b83-461d-84c6-10ce0b620c32 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:14.847838 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6befaebf-2b83-461d-84c6-10ce0b620c32 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:14.848030 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6befaebf-2b83-461d-84c6-10ce0b620c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:14.886196 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:03:14.933517 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-6befaebf-2b83-461d-84c6-10ce0b620c32 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:03:14.934964 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-6befaebf-2b83-461d-84c6-10ce0b620c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:15.045336 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 523/1047] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 11:03:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:03:15.382344 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3bc0a5-31f4-4570-a311-f15ff4ac3442 None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:15.382634 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3bc0a5-31f4-4570-a311-f15ff4ac3442 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:15.383188 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3bc0a5-31f4-4570-a311-f15ff4ac3442 None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:15.384364 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 525/1048] 10.222.0.25 () {54 vars in 963 bytes} [Thu Oct 13 11:03:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:03:15.389670 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8841c3f9-c182-412d-b06f-e0c69a25eae6 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:15.390026 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8841c3f9-c182-412d-b06f-e0c69a25eae6 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:15.390259 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8841c3f9-c182-412d-b06f-e0c69a25eae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:15.471646 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-8841c3f9-c182-412d-b06f-e0c69a25eae6 None None] MFA Rules not processed for user `35f4c2fc51f54f0e977648b13efaed1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:03:15.472868 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-8841c3f9-c182-412d-b06f-e0c69a25eae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:15.523660 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:03:15.556241 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 524/1049] 10.222.0.25 () {58 vars in 1060 bytes} [Thu Oct 13 11:03:15 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:03:15.563824 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3bc0a5-31f4-4570-a311-f15ff4ac3442 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:03:15.565336 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-7d3bc0a5-31f4-4570-a311-f15ff4ac3442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:15.618109 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:03:15.677447 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3bc0a5-31f4-4570-a311-f15ff4ac3442 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:03:15.762371 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b72292d-837d-4c3c-b9fb-2210fbd42646 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f4c2fc51f54f0e977648b13efaed1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:03:15.762987 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b72292d-837d-4c3c-b9fb-2210fbd42646 service cinder] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:15.763262 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b72292d-837d-4c3c-b9fb-2210fbd42646 service cinder] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:15.763553 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b72292d-837d-4c3c-b9fb-2210fbd42646 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:15.765176 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-1b72292d-837d-4c3c-b9fb-2210fbd42646 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:15.879220 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:03:15.909203 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b72292d-837d-4c3c-b9fb-2210fbd42646 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:03:15.910627 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b72292d-837d-4c3c-b9fb-2210fbd42646 service cinder] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:03:15.931697 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 526/1050] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:03:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:03:16.923450 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2451a5-e10b-4e3e-a211-0dae8a7ebf92 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:16.923996 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2451a5-e10b-4e3e-a211-0dae8a7ebf92 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:16.924110 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2451a5-e10b-4e3e-a211-0dae8a7ebf92 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:16.925407 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 525/1051] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 11:03:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:03:16.930662 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609430b4-5004-45b5-bb8c-8f14d98f6f30 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:16.931102 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609430b4-5004-45b5-bb8c-8f14d98f6f30 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:16.931199 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609430b4-5004-45b5-bb8c-8f14d98f6f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:16.996095 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-609430b4-5004-45b5-bb8c-8f14d98f6f30 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:03:16.997302 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-609430b4-5004-45b5-bb8c-8f14d98f6f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:17.093191 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 527/1052] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 11:03:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:03:17.386954 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2451a5-e10b-4e3e-a211-0dae8a7ebf92 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:03:17.388593 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-cf2451a5-e10b-4e3e-a211-0dae8a7ebf92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:17.548609 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2451a5-e10b-4e3e-a211-0dae8a7ebf92 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:03:17.601675 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:03:17.665666 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68475242-004b-4f59-bf74-c1a7754d9533 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78384fbffdd346578855e7214b335d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:03:17.666325 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68475242-004b-4f59-bf74-c1a7754d9533 service nova] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:17.666600 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68475242-004b-4f59-bf74-c1a7754d9533 service nova] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:17.667414 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68475242-004b-4f59-bf74-c1a7754d9533 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:17.669042 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-68475242-004b-4f59-bf74-c1a7754d9533 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:17.759620 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68475242-004b-4f59-bf74-c1a7754d9533 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:03:17.761793 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68475242-004b-4f59-bf74-c1a7754d9533 service nova] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:03:17.781623 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 526/1053] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:03:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 13 11:03:20.013454 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc89ee7-3c49-4282-a963-fe39afd7cca1 None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:20.014087 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc89ee7-3c49-4282-a963-fe39afd7cca1 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:20.014087 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc89ee7-3c49-4282-a963-fe39afd7cca1 None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:20.015986 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 528/1054] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 11:03:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:03:20.021296 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c18eacf-69c1-4624-8ce1-188c16766d64 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:20.021716 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c18eacf-69c1-4624-8ce1-188c16766d64 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:20.021891 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c18eacf-69c1-4624-8ce1-188c16766d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:20.091697 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-0c18eacf-69c1-4624-8ce1-188c16766d64 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:03:20.093079 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-0c18eacf-69c1-4624-8ce1-188c16766d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:20.100585 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:03:20.210027 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 527/1055] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 11:03:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:03:20.496896 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc89ee7-3c49-4282-a963-fe39afd7cca1 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:03:20.498422 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-5dc89ee7-3c49-4282-a963-fe39afd7cca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:20.575274 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:03:20.664167 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc89ee7-3c49-4282-a963-fe39afd7cca1 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:03:20.784905 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6d16c5-db18-4900-95d3-06792d83df8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78384fbffdd346578855e7214b335d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:03:20.785409 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d16c5-db18-4900-95d3-06792d83df8a service nova] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:20.785685 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d16c5-db18-4900-95d3-06792d83df8a service nova] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:20.785972 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d16c5-db18-4900-95d3-06792d83df8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:20.787534 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-9a6d16c5-db18-4900-95d3-06792d83df8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:20.806597 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:03:20.883612 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6d16c5-db18-4900-95d3-06792d83df8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:03:20.884939 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6d16c5-db18-4900-95d3-06792d83df8a service nova] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:03:20.905836 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 529/1056] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:03:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:03:23.108717 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546110b6-db4c-49bb-8419-d71124f6d3eb None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:23.109255 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546110b6-db4c-49bb-8419-d71124f6d3eb None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:23.109255 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546110b6-db4c-49bb-8419-d71124f6d3eb None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:23.110891 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 528/1057] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 11:03:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:03:23.116478 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7466d69e-99eb-483a-b90e-d47d9c10b7d2 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:23.116877 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7466d69e-99eb-483a-b90e-d47d9c10b7d2 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:23.117034 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7466d69e-99eb-483a-b90e-d47d9c10b7d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:23.196800 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-7466d69e-99eb-483a-b90e-d47d9c10b7d2 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:03:23.199232 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-7466d69e-99eb-483a-b90e-d47d9c10b7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:23.308157 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:03:23.339025 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 530/1058] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 11:03:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:03:23.616044 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546110b6-db4c-49bb-8419-d71124f6d3eb None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:03:23.617562 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-546110b6-db4c-49bb-8419-d71124f6d3eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:23.753318 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:03:23.764196 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546110b6-db4c-49bb-8419-d71124f6d3eb None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:03:23.889899 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582cde00-ccb7-4b9b-924d-809a09437ded service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78384fbffdd346578855e7214b335d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:03:23.890316 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582cde00-ccb7-4b9b-924d-809a09437ded service nova] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:23.890608 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582cde00-ccb7-4b9b-924d-809a09437ded service nova] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:23.890865 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582cde00-ccb7-4b9b-924d-809a09437ded service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:23.892455 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-582cde00-ccb7-4b9b-924d-809a09437ded service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:23.991948 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582cde00-ccb7-4b9b-924d-809a09437ded service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:03:23.993526 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582cde00-ccb7-4b9b-924d-809a09437ded service nova] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:03:24.004644 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:03:24.014144 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 529/1059] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:03:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 13 11:03:26.227889 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f60302-01f5-419c-9422-60170e8fba7a None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:26.228864 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f60302-01f5-419c-9422-60170e8fba7a None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:26.228864 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f60302-01f5-419c-9422-60170e8fba7a None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:26.229859 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 531/1060] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 11:03:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 11:03:26.235106 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429e159-f71d-453d-907f-f680a94bac48 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:26.235530 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429e159-f71d-453d-907f-f680a94bac48 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:26.235727 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429e159-f71d-453d-907f-f680a94bac48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:26.303083 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-a429e159-f71d-453d-907f-f680a94bac48 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:03:26.304287 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-a429e159-f71d-453d-907f-f680a94bac48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:26.406269 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 530/1061] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 11:03:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:03:26.693617 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f60302-01f5-419c-9422-60170e8fba7a None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:03:26.695284 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-e9f60302-01f5-419c-9422-60170e8fba7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:26.909492 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f60302-01f5-419c-9422-60170e8fba7a None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:03:26.982547 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:03:27.033242 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f88a6e-edc1-4e9e-bf5d-6cbef0aa79d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78384fbffdd346578855e7214b335d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:03:27.034328 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f88a6e-edc1-4e9e-bf5d-6cbef0aa79d2 service nova] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:27.034907 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f88a6e-edc1-4e9e-bf5d-6cbef0aa79d2 service nova] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:27.035326 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f88a6e-edc1-4e9e-bf5d-6cbef0aa79d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:27.038296 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-51f88a6e-edc1-4e9e-bf5d-6cbef0aa79d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:27.170917 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f88a6e-edc1-4e9e-bf5d-6cbef0aa79d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:03:27.172519 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f88a6e-edc1-4e9e-bf5d-6cbef0aa79d2 service nova] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:03:27.193650 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 532/1062] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:03:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:03:29.424732 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872fac4e-864c-40a5-8603-085aa547dada None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:29.425296 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872fac4e-864c-40a5-8603-085aa547dada None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:29.425409 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872fac4e-864c-40a5-8603-085aa547dada None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:29.427262 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 531/1063] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 11:03:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:03:29.433127 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c3f32-10d5-4517-b9cb-81f6a3e3688d None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:29.433586 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c3f32-10d5-4517-b9cb-81f6a3e3688d None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:29.433683 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c3f32-10d5-4517-b9cb-81f6a3e3688d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:29.502953 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-bb7c3f32-10d5-4517-b9cb-81f6a3e3688d None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:03:29.504359 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-bb7c3f32-10d5-4517-b9cb-81f6a3e3688d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:29.536772 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:03:29.604926 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 533/1064] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 11:03:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:03:29.897161 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872fac4e-864c-40a5-8603-085aa547dada None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:03:29.898844 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-872fac4e-864c-40a5-8603-085aa547dada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:29.978503 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:03:30.047658 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872fac4e-864c-40a5-8603-085aa547dada None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:03:30.159050 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8226f2b-03b3-4c3d-9a85-133b69f57dcd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78384fbffdd346578855e7214b335d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:03:30.159573 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8226f2b-03b3-4c3d-9a85-133b69f57dcd service nova] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:30.159845 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8226f2b-03b3-4c3d-9a85-133b69f57dcd service nova] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:30.160110 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8226f2b-03b3-4c3d-9a85-133b69f57dcd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:30.161686 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-b8226f2b-03b3-4c3d-9a85-133b69f57dcd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:30.201112 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:03:30.251684 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8226f2b-03b3-4c3d-9a85-133b69f57dcd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:03:30.253303 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8226f2b-03b3-4c3d-9a85-133b69f57dcd service nova] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:03:30.271284 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 532/1065] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:03:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:03:31.870676 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b3176-a52e-4d81-9c27-f3496dcc5c69 None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:31.871224 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b3176-a52e-4d81-9c27-f3496dcc5c69 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:31.871599 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b3176-a52e-4d81-9c27-f3496dcc5c69 None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:31.875175 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 534/1066] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 11:03:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:03:31.881550 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fddf2db-9ae6-40ed-971f-9d236c73e2a0 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:31.882028 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fddf2db-9ae6-40ed-971f-9d236c73e2a0 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:31.882573 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fddf2db-9ae6-40ed-971f-9d236c73e2a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:31.949201 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-4fddf2db-9ae6-40ed-971f-9d236c73e2a0 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:03:31.950435 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-4fddf2db-9ae6-40ed-971f-9d236c73e2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:32.046636 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 533/1067] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 11:03:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:03:32.348648 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbcfe35-f1e2-4afe-a05c-79063f0535e0 None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:32.348934 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbcfe35-f1e2-4afe-a05c-79063f0535e0 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:32.349210 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbcfe35-f1e2-4afe-a05c-79063f0535e0 None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:32.350553 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 535/1068] 10.222.0.25 () {54 vars in 962 bytes} [Thu Oct 13 11:03:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:03:32.355971 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bfc6ab-12ad-457a-b3e8-129f0c2d7ef0 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:32.356341 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bfc6ab-12ad-457a-b3e8-129f0c2d7ef0 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:32.356684 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bfc6ab-12ad-457a-b3e8-129f0c2d7ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:32.373421 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:03:32.428031 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d73b1-e372-4f71-9347-96c6437d8469 None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:32.428312 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d73b1-e372-4f71-9347-96c6437d8469 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:32.428586 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d73b1-e372-4f71-9347-96c6437d8469 None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:32.429960 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 536/1069] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 11:03:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 11:03:32.434964 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-25bfc6ab-12ad-457a-b3e8-129f0c2d7ef0 None None] MFA Rules not processed for user `399f7d3700a24cb486e56b409a6e5429`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:03:32.435469 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b9179-6a1d-4286-870f-6b4abd5de75a None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:32.435747 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b9179-6a1d-4286-870f-6b4abd5de75a None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:32.436018 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b9179-6a1d-4286-870f-6b4abd5de75a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:32.436184 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-25bfc6ab-12ad-457a-b3e8-129f0c2d7ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:32.503134 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-568b9179-6a1d-4286-870f-6b4abd5de75a None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:03:32.504373 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-568b9179-6a1d-4286-870f-6b4abd5de75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:32.518798 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 534/1070] 10.222.0.25 () {58 vars in 1059 bytes} [Thu Oct 13 11:03:32 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:03:32.530597 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bfc6ab-12ad-457a-b3e8-129f0c2d7ef0 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:03:32.541161 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bfc6ab-12ad-457a-b3e8-129f0c2d7ef0 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:03:32.616926 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02362353-8a1c-420e-a654-96b232f728b9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '399f7d3700a24cb486e56b409a6e5429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:03:32.617437 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02362353-8a1c-420e-a654-96b232f728b9 service glance] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:32.617716 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02362353-8a1c-420e-a654-96b232f728b9 service glance] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:32.618239 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02362353-8a1c-420e-a654-96b232f728b9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:32.620523 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-02362353-8a1c-420e-a654-96b232f728b9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:32.639707 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 537/1071] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 11:03:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 11:03:32.650110 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:03:32.726983 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02362353-8a1c-420e-a654-96b232f728b9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:03:32.728545 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02362353-8a1c-420e-a654-96b232f728b9 service glance] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:03:32.747065 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 535/1072] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:03:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:03:32.928290 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568b9179-6a1d-4286-870f-6b4abd5de75a None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:03:32.929545 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-568b9179-6a1d-4286-870f-6b4abd5de75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:32.945140 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:03:33.050408 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568b9179-6a1d-4286-870f-6b4abd5de75a None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:03:33.169867 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3622db-779f-451f-bfee-2e8f86fcfa77 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78384fbffdd346578855e7214b335d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:03:33.170504 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3622db-779f-451f-bfee-2e8f86fcfa77 service nova] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:33.170779 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3622db-779f-451f-bfee-2e8f86fcfa77 service nova] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:33.171050 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3622db-779f-451f-bfee-2e8f86fcfa77 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:33.172643 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-9b3622db-779f-451f-bfee-2e8f86fcfa77 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:33.181564 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:03:33.263810 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3622db-779f-451f-bfee-2e8f86fcfa77 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:03:33.265417 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3622db-779f-451f-bfee-2e8f86fcfa77 service nova] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:03:33.283991 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 538/1073] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:03:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:03:33.518610 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf45743-6140-4dac-b057-26771fe2e2ca None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:33.519137 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf45743-6140-4dac-b057-26771fe2e2ca None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:33.519137 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf45743-6140-4dac-b057-26771fe2e2ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:33.592939 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-abf45743-6140-4dac-b057-26771fe2e2ca None None] MFA Rules not processed for user `6e803a9cc6114c4f93869e50bca313e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:03:33.594390 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-abf45743-6140-4dac-b057-26771fe2e2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:33.678285 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:03:33.684631 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 536/1074] 10.222.0.25 () {58 vars in 1009 bytes} [Thu Oct 13 11:03:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:03:33.730453 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147debe2-4902-4c0f-89ef-f35f5868aebb None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:33.730812 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147debe2-4902-4c0f-89ef-f35f5868aebb None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:33.731175 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147debe2-4902-4c0f-89ef-f35f5868aebb None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:33.732578 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 539/1075] 10.222.0.25 () {54 vars in 943 bytes} [Thu Oct 13 11:03:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:03:33.738748 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88092c48-72d4-43b9-821b-bf695b519377 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:33.739149 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88092c48-72d4-43b9-821b-bf695b519377 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:33.739693 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88092c48-72d4-43b9-821b-bf695b519377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:33.817075 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-88092c48-72d4-43b9-821b-bf695b519377 None None] MFA Rules not processed for user `e24c779d0a604ef28dfc1235ee76a711`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:03:33.818383 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-88092c48-72d4-43b9-821b-bf695b519377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:33.934186 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 537/1076] 10.222.0.25 () {58 vars in 1040 bytes} [Thu Oct 13 11:03:33 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:03:33.943467 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147debe2-4902-4c0f-89ef-f35f5868aebb None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:03:33.945226 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-147debe2-4902-4c0f-89ef-f35f5868aebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:34.080838 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:03:34.082437 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147debe2-4902-4c0f-89ef-f35f5868aebb None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:03:34.189199 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9570494e-d0f4-4800-91a2-9ca910cf420c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e24c779d0a604ef28dfc1235ee76a711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:03:34.189734 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9570494e-d0f4-4800-91a2-9ca910cf420c service swift] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:34.190041 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9570494e-d0f4-4800-91a2-9ca910cf420c service swift] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:34.190315 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9570494e-d0f4-4800-91a2-9ca910cf420c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:34.192061 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-9570494e-d0f4-4800-91a2-9ca910cf420c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:34.276881 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9570494e-d0f4-4800-91a2-9ca910cf420c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:03:34.278510 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9570494e-d0f4-4800-91a2-9ca910cf420c service swift] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:03:34.286584 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 540/1077] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Oct 13 11:03:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 13 11:03:35.470353 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecfa744-9ac2-44c5-b8c9-bd33a6571f4b None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:35.471016 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecfa744-9ac2-44c5-b8c9-bd33a6571f4b None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:35.471016 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecfa744-9ac2-44c5-b8c9-bd33a6571f4b None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:35.472231 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 538/1078] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 11:03:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:03:35.477553 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a614ce-ead4-4ec3-bd98-39380496098e None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:35.478044 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a614ce-ead4-4ec3-bd98-39380496098e None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:35.478177 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a614ce-ead4-4ec3-bd98-39380496098e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:35.520643 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:03:35.550727 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-c0a614ce-ead4-4ec3-bd98-39380496098e None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:03:35.551937 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-c0a614ce-ead4-4ec3-bd98-39380496098e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:35.665760 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 541/1079] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 11:03:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:03:35.966087 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecfa744-9ac2-44c5-b8c9-bd33a6571f4b None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:03:35.971549 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-eecfa744-9ac2-44c5-b8c9-bd33a6571f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:36.037909 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:03:36.134551 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecfa744-9ac2-44c5-b8c9-bd33a6571f4b None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:03:36.267161 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4cb141-b410-44c4-bb4b-3c9ef3db563b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78384fbffdd346578855e7214b335d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:03:36.267881 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4cb141-b410-44c4-bb4b-3c9ef3db563b service nova] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:36.268161 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4cb141-b410-44c4-bb4b-3c9ef3db563b service nova] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:36.268452 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4cb141-b410-44c4-bb4b-3c9ef3db563b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:36.270076 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-ed4cb141-b410-44c4-bb4b-3c9ef3db563b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:36.289688 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:03:36.375519 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4cb141-b410-44c4-bb4b-3c9ef3db563b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:03:36.377116 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4cb141-b410-44c4-bb4b-3c9ef3db563b service nova] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:03:36.398082 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 539/1080] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:03:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:03:38.648389 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd7344a-a503-4977-8b39-3d6187f8cd59 None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:38.648966 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd7344a-a503-4977-8b39-3d6187f8cd59 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:38.648966 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd7344a-a503-4977-8b39-3d6187f8cd59 None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:38.650219 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 542/1081] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 11:03:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:03:38.655678 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41168dcf-c4d3-4ff7-aafa-61010621af8c None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:38.656098 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41168dcf-c4d3-4ff7-aafa-61010621af8c None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:38.656296 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41168dcf-c4d3-4ff7-aafa-61010621af8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:38.729961 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-41168dcf-c4d3-4ff7-aafa-61010621af8c None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:03:38.731191 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-41168dcf-c4d3-4ff7-aafa-61010621af8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:38.835546 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:03:38.843907 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 540/1082] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 11:03:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 11:03:39.133925 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd7344a-a503-4977-8b39-3d6187f8cd59 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:03:39.135548 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-4bd7344a-a503-4977-8b39-3d6187f8cd59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:39.249214 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:03:39.297885 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd7344a-a503-4977-8b39-3d6187f8cd59 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:03:39.422080 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8881a4f5-9a1a-4c35-a6fd-8c6fa088578c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78384fbffdd346578855e7214b335d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:03:39.422693 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8881a4f5-9a1a-4c35-a6fd-8c6fa088578c service nova] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:39.422976 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8881a4f5-9a1a-4c35-a6fd-8c6fa088578c service nova] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:39.423253 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8881a4f5-9a1a-4c35-a6fd-8c6fa088578c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:39.424875 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-8881a4f5-9a1a-4c35-a6fd-8c6fa088578c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:39.546772 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:03:39.564509 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8881a4f5-9a1a-4c35-a6fd-8c6fa088578c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:03:39.566115 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8881a4f5-9a1a-4c35-a6fd-8c6fa088578c service nova] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:03:39.585331 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 543/1083] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:03:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:03:41.809574 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd15db-dccd-4ff9-9c4c-1184044a6aaa None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:41.810144 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd15db-dccd-4ff9-9c4c-1184044a6aaa None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:41.810144 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd15db-dccd-4ff9-9c4c-1184044a6aaa None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:41.811718 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 541/1084] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 11:03:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:03:41.817223 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a4cc7-856d-44a0-9879-cec0ef50e0f7 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:41.817653 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a4cc7-856d-44a0-9879-cec0ef50e0f7 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:41.817837 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a4cc7-856d-44a0-9879-cec0ef50e0f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:41.898610 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-a62a4cc7-856d-44a0-9879-cec0ef50e0f7 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:03:41.899893 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-a62a4cc7-856d-44a0-9879-cec0ef50e0f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:42.005755 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 544/1085] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 11:03:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:03:42.298703 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd15db-dccd-4ff9-9c4c-1184044a6aaa None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:03:42.299824 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-30dd15db-dccd-4ff9-9c4c-1184044a6aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:42.467583 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd15db-dccd-4ff9-9c4c-1184044a6aaa None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:03:42.540722 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:03:42.589893 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a0ece8-6b27-41de-9549-b5bef21e9f3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78384fbffdd346578855e7214b335d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:03:42.590657 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a0ece8-6b27-41de-9549-b5bef21e9f3b service nova] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:42.590994 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a0ece8-6b27-41de-9549-b5bef21e9f3b service nova] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:42.591331 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a0ece8-6b27-41de-9549-b5bef21e9f3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:42.593017 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-28a0ece8-6b27-41de-9549-b5bef21e9f3b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:42.688305 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a0ece8-6b27-41de-9549-b5bef21e9f3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:03:42.691730 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a0ece8-6b27-41de-9549-b5bef21e9f3b service nova] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:03:42.710779 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 542/1086] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:03:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:03:52.004018 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=78 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:03:52.707983 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=65 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:03:57.089781 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5791e113-763d-4fdd-b9dd-2948fd3929ed None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:57.090359 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5791e113-763d-4fdd-b9dd-2948fd3929ed None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:57.090359 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5791e113-763d-4fdd-b9dd-2948fd3929ed None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:57.091716 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 545/1087] 10.222.0.25 () {54 vars in 918 bytes} [Thu Oct 13 11:03:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:03:57.096714 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f09b7-f21f-472c-aa86-d30b3dda14b0 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:57.097146 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f09b7-f21f-472c-aa86-d30b3dda14b0 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:57.097349 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f09b7-f21f-472c-aa86-d30b3dda14b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:57.173001 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-773f09b7-f21f-472c-aa86-d30b3dda14b0 None None] MFA Rules not processed for user `ed4bb75e68a640fc92ddd47fad61a25a`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:03:57.174235 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-773f09b7-f21f-472c-aa86-d30b3dda14b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:57.276895 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 543/1088] 10.222.0.25 () {58 vars in 1015 bytes} [Thu Oct 13 11:03:57 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 11:03:57.291054 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b2ed65-7a96-4959-ae59-cdb391e89b99 None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:57.291338 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b2ed65-7a96-4959-ae59-cdb391e89b99 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:57.291612 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b2ed65-7a96-4959-ae59-cdb391e89b99 None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:57.292935 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 546/1089] 10.222.0.25 () {54 vars in 918 bytes} [Thu Oct 13 11:03:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:03:57.297364 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019bf8e-4f17-4a01-a871-26820fbd85c9 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:57.297644 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019bf8e-4f17-4a01-a871-26820fbd85c9 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:57.297913 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019bf8e-4f17-4a01-a871-26820fbd85c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:57.368572 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:03:57.371668 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-f019bf8e-4f17-4a01-a871-26820fbd85c9 None None] MFA Rules not processed for user `78384fbffdd346578855e7214b335d8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:03:57.373388 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-f019bf8e-4f17-4a01-a871-26820fbd85c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:57.487048 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 544/1090] 10.222.0.25 () {58 vars in 1015 bytes} [Thu Oct 13 11:03:57 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 11:04:00.040090 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf92c78-538f-42e9-a310-ba1ddaae53ef None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:00.040658 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf92c78-538f-42e9-a310-ba1ddaae53ef None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:00.040658 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf92c78-538f-42e9-a310-ba1ddaae53ef None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:00.041965 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 547/1091] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 13 11:04:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:04:00.047090 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f81c34-6f3a-4fcf-91ec-b3a966ea3219 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:00.047537 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f81c34-6f3a-4fcf-91ec-b3a966ea3219 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:00.047678 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f81c34-6f3a-4fcf-91ec-b3a966ea3219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:00.117834 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-42f81c34-6f3a-4fcf-91ec-b3a966ea3219 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:04:00.119602 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-42f81c34-6f3a-4fcf-91ec-b3a966ea3219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:00.172788 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:00.213699 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 545/1092] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 13 11:04:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:04:00.501769 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf92c78-538f-42e9-a310-ba1ddaae53ef None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:04:00.503317 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-baf92c78-538f-42e9-a310-ba1ddaae53ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:00.648293 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf92c78-538f-42e9-a310-ba1ddaae53ef None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:04:00.719022 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:00.759125 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdc9c12-fe25-4494-9476-888234d65f1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78384fbffdd346578855e7214b335d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:04:00.759687 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc9c12-fe25-4494-9476-888234d65f1f service nova] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:00.759969 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc9c12-fe25-4494-9476-888234d65f1f service nova] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:00.760248 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc9c12-fe25-4494-9476-888234d65f1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:00.761857 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-ecdc9c12-fe25-4494-9476-888234d65f1f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:00.848955 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdc9c12-fe25-4494-9476-888234d65f1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:04:00.850573 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdc9c12-fe25-4494-9476-888234d65f1f service nova] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:04:00.868293 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 548/1093] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:04:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:04:01.992474 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda5caf-a62b-41c8-9e50-ac221aa64e7c None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:01.993034 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda5caf-a62b-41c8-9e50-ac221aa64e7c None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:01.993034 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda5caf-a62b-41c8-9e50-ac221aa64e7c None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:01.995020 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 546/1094] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 13 11:04:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:04:02.001113 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37a649-7590-4df2-bfbf-c8e9a7ff7344 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:02.001530 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37a649-7590-4df2-bfbf-c8e9a7ff7344 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:02.001641 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37a649-7590-4df2-bfbf-c8e9a7ff7344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:02.076503 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-1f37a649-7590-4df2-bfbf-c8e9a7ff7344 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:04:02.077734 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-1f37a649-7590-4df2-bfbf-c8e9a7ff7344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:02.105485 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:02.174807 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 549/1095] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 13 11:04:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:04:02.320811 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceda5caf-a62b-41c8-9e50-ac221aa64e7c None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:04:02.322415 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-ceda5caf-a62b-41c8-9e50-ac221aa64e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:02.463990 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceda5caf-a62b-41c8-9e50-ac221aa64e7c None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:04:02.502322 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:02.573346 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5c807f-a41f-4fd3-9158-43068ee1f18c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78384fbffdd346578855e7214b335d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:04:02.573967 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c807f-a41f-4fd3-9158-43068ee1f18c service nova] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:02.574247 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c807f-a41f-4fd3-9158-43068ee1f18c service nova] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:02.574511 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c807f-a41f-4fd3-9158-43068ee1f18c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:02.576084 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-4a5c807f-a41f-4fd3-9158-43068ee1f18c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:02.662891 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5c807f-a41f-4fd3-9158-43068ee1f18c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:04:02.664446 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5c807f-a41f-4fd3-9158-43068ee1f18c service nova] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:04:02.681412 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 547/1096] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:04:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:04:03.803235 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99535b23-3cfb-4526-ae34-887d3e2f552f None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:03.803904 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99535b23-3cfb-4526-ae34-887d3e2f552f None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:03.803904 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99535b23-3cfb-4526-ae34-887d3e2f552f None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:03.805114 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 550/1097] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 13 11:04:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:04:03.811339 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896946e2-ace3-471e-9c2e-acff165b34e5 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:03.811771 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896946e2-ace3-471e-9c2e-acff165b34e5 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:03.811870 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896946e2-ace3-471e-9c2e-acff165b34e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:03.865378 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:03.888422 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-896946e2-ace3-471e-9c2e-acff165b34e5 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:04:03.889638 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-896946e2-ace3-471e-9c2e-acff165b34e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:03.983330 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 548/1098] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 13 11:04:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:04:04.132462 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99535b23-3cfb-4526-ae34-887d3e2f552f None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:04:04.133897 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-99535b23-3cfb-4526-ae34-887d3e2f552f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:04.276178 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99535b23-3cfb-4526-ae34-887d3e2f552f None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:04:04.287868 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:04.385817 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f7574d-6574-4be9-8846-5a81b940d0d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78384fbffdd346578855e7214b335d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:04:04.386378 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f7574d-6574-4be9-8846-5a81b940d0d6 service nova] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:04.386653 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f7574d-6574-4be9-8846-5a81b940d0d6 service nova] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:04.386921 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f7574d-6574-4be9-8846-5a81b940d0d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:04.388498 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-94f7574d-6574-4be9-8846-5a81b940d0d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:04.477494 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f7574d-6574-4be9-8846-5a81b940d0d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:04:04.479680 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f7574d-6574-4be9-8846-5a81b940d0d6 service nova] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:04:04.497329 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 551/1099] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:04:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:04:05.597485 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13fc5e3-91eb-4caa-9148-ff9227b50185 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:05.598084 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13fc5e3-91eb-4caa-9148-ff9227b50185 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:05.598084 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13fc5e3-91eb-4caa-9148-ff9227b50185 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:05.599471 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 549/1100] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 13 11:04:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:04:05.606325 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac89c37-44ad-43af-9053-86b1da86f1c7 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:05.606859 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac89c37-44ad-43af-9053-86b1da86f1c7 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:05.606971 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac89c37-44ad-43af-9053-86b1da86f1c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:05.627384 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:05.683844 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-6ac89c37-44ad-43af-9053-86b1da86f1c7 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:04:05.685045 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-6ac89c37-44ad-43af-9053-86b1da86f1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:05.779546 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 552/1101] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 13 11:04:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:04:05.926667 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13fc5e3-91eb-4caa-9148-ff9227b50185 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:04:05.928185 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-d13fc5e3-91eb-4caa-9148-ff9227b50185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:06.034878 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:06.069757 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13fc5e3-91eb-4caa-9148-ff9227b50185 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:04:06.180556 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660b8c5-d8f1-4012-806b-81e849d644a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78384fbffdd346578855e7214b335d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:04:06.181182 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660b8c5-d8f1-4012-806b-81e849d644a6 service nova] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:06.181456 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660b8c5-d8f1-4012-806b-81e849d644a6 service nova] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:06.181724 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660b8c5-d8f1-4012-806b-81e849d644a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:06.183337 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-c660b8c5-d8f1-4012-806b-81e849d644a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:06.258140 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:06.272091 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c660b8c5-d8f1-4012-806b-81e849d644a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:04:06.273667 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c660b8c5-d8f1-4012-806b-81e849d644a6 service nova] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:04:06.291538 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 550/1102] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:04:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:04:07.392057 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bce7e8-cd7d-4525-b21e-dc15a7b9ff5a None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:07.392478 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bce7e8-cd7d-4525-b21e-dc15a7b9ff5a None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:07.392587 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bce7e8-cd7d-4525-b21e-dc15a7b9ff5a None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:07.393983 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 553/1103] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 13 11:04:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:04:07.400744 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b6ab7-f3f7-4caf-ba74-cc0551bda1b7 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:07.401202 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b6ab7-f3f7-4caf-ba74-cc0551bda1b7 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:07.401299 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b6ab7-f3f7-4caf-ba74-cc0551bda1b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:07.475290 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-d10b6ab7-f3f7-4caf-ba74-cc0551bda1b7 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:04:07.476513 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-d10b6ab7-f3f7-4caf-ba74-cc0551bda1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:07.572718 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 551/1104] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 13 11:04:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:04:07.725754 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bce7e8-cd7d-4525-b21e-dc15a7b9ff5a None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:04:07.727287 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-11bce7e8-cd7d-4525-b21e-dc15a7b9ff5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:07.811321 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:07.872742 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bce7e8-cd7d-4525-b21e-dc15a7b9ff5a None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:04:07.984346 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475264d4-8650-41df-a223-88a79ac740ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78384fbffdd346578855e7214b335d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:04:07.984887 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475264d4-8650-41df-a223-88a79ac740ca service nova] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:07.985162 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475264d4-8650-41df-a223-88a79ac740ca service nova] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:07.985432 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475264d4-8650-41df-a223-88a79ac740ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:07.987045 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-475264d4-8650-41df-a223-88a79ac740ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:08.036305 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:08.076810 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475264d4-8650-41df-a223-88a79ac740ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:04:08.078413 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475264d4-8650-41df-a223-88a79ac740ca service nova] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:04:08.095908 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 554/1105] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:04:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:04:09.143977 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f59ae2-8e3b-4070-a858-a0c2de968e5a None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:09.144537 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f59ae2-8e3b-4070-a858-a0c2de968e5a None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:09.144537 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f59ae2-8e3b-4070-a858-a0c2de968e5a None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:09.145800 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 552/1106] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 13 11:04:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:04:09.152074 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c53ff-e575-4ce9-99a9-3520a4b2ce0f None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:09.152531 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c53ff-e575-4ce9-99a9-3520a4b2ce0f None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:09.152628 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c53ff-e575-4ce9-99a9-3520a4b2ce0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:09.227602 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-d11c53ff-e575-4ce9-99a9-3520a4b2ce0f None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:04:09.229374 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-d11c53ff-e575-4ce9-99a9-3520a4b2ce0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:09.322599 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 555/1107] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 13 11:04:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:04:09.469147 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f59ae2-8e3b-4070-a858-a0c2de968e5a None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:04:09.470693 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-a0f59ae2-8e3b-4070-a858-a0c2de968e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:09.519749 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:09.618156 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f59ae2-8e3b-4070-a858-a0c2de968e5a None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:04:09.730493 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fe496e-1138-44f9-8b16-2e8122234ed8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78384fbffdd346578855e7214b335d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:04:09.731020 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe496e-1138-44f9-8b16-2e8122234ed8 service nova] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:09.731293 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe496e-1138-44f9-8b16-2e8122234ed8 service nova] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:09.731563 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe496e-1138-44f9-8b16-2e8122234ed8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:09.733150 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-41fe496e-1138-44f9-8b16-2e8122234ed8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:09.740027 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:09.820035 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fe496e-1138-44f9-8b16-2e8122234ed8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:04:09.821655 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fe496e-1138-44f9-8b16-2e8122234ed8 service nova] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:04:09.839513 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 553/1108] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:04:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:04:10.892539 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0152cf9f-8e15-477a-b6a0-e6e46a03232a None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:10.893022 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0152cf9f-8e15-477a-b6a0-e6e46a03232a None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:10.893124 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0152cf9f-8e15-477a-b6a0-e6e46a03232a None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:10.894464 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 556/1109] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 13 11:04:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:04:10.900779 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c2e2b5-8800-4757-bedd-5b369442b381 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:10.901182 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c2e2b5-8800-4757-bedd-5b369442b381 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:10.901317 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c2e2b5-8800-4757-bedd-5b369442b381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:10.974613 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-a9c2e2b5-8800-4757-bedd-5b369442b381 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:04:10.975728 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-a9c2e2b5-8800-4757-bedd-5b369442b381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:11.042861 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:11.071114 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 554/1110] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 13 11:04:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:04:11.221606 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0152cf9f-8e15-477a-b6a0-e6e46a03232a None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:04:11.223219 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-0152cf9f-8e15-477a-b6a0-e6e46a03232a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:11.241319 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:11.366803 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0152cf9f-8e15-477a-b6a0-e6e46a03232a None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:04:11.452540 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:11.478178 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b065980b-9891-495b-9da9-57a215beb9ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78384fbffdd346578855e7214b335d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:04:11.478733 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065980b-9891-495b-9da9-57a215beb9ac service nova] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:11.479010 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065980b-9891-495b-9da9-57a215beb9ac service nova] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:11.479281 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065980b-9891-495b-9da9-57a215beb9ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:11.480893 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-b065980b-9891-495b-9da9-57a215beb9ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:11.571039 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b065980b-9891-495b-9da9-57a215beb9ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:04:11.573063 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b065980b-9891-495b-9da9-57a215beb9ac service nova] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:04:11.591294 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 557/1111] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:04:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:04:12.633451 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff274ce-9fc2-4c01-9644-75d79ea8cae6 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:12.634528 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff274ce-9fc2-4c01-9644-75d79ea8cae6 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:12.634528 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff274ce-9fc2-4c01-9644-75d79ea8cae6 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:12.635906 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 555/1112] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 13 11:04:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:04:12.642146 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44533b0c-fc8d-4b50-ab75-ee22bd01fee4 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:12.642557 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44533b0c-fc8d-4b50-ab75-ee22bd01fee4 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:12.642711 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44533b0c-fc8d-4b50-ab75-ee22bd01fee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:12.720276 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-44533b0c-fc8d-4b50-ab75-ee22bd01fee4 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:04:12.721491 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-44533b0c-fc8d-4b50-ab75-ee22bd01fee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:12.764120 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:12.818678 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 558/1113] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 13 11:04:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:04:12.969760 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff274ce-9fc2-4c01-9644-75d79ea8cae6 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:04:12.971357 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-bff274ce-9fc2-4c01-9644-75d79ea8cae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:13.113797 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff274ce-9fc2-4c01-9644-75d79ea8cae6 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:04:13.170914 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:13.230384 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cbb128-6b07-42ae-954d-ff4f54610674 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78384fbffdd346578855e7214b335d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:04:13.230882 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cbb128-6b07-42ae-954d-ff4f54610674 service nova] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:13.231157 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cbb128-6b07-42ae-954d-ff4f54610674 service nova] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:13.231428 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cbb128-6b07-42ae-954d-ff4f54610674 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:13.233049 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-33cbb128-6b07-42ae-954d-ff4f54610674 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:13.321219 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cbb128-6b07-42ae-954d-ff4f54610674 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:04:13.322813 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cbb128-6b07-42ae-954d-ff4f54610674 service nova] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:04:13.340643 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 556/1114] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:04:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:04:14.388698 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a97cad7-9574-494f-8ffc-7ad19a4055ee None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:14.389190 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a97cad7-9574-494f-8ffc-7ad19a4055ee None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:14.389293 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a97cad7-9574-494f-8ffc-7ad19a4055ee None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:14.390650 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 559/1115] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 13 11:04:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:04:14.396761 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e4b670-71f3-4046-9f04-6866afd16289 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:14.397221 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e4b670-71f3-4046-9f04-6866afd16289 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:14.397333 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e4b670-71f3-4046-9f04-6866afd16289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:14.470415 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-f4e4b670-71f3-4046-9f04-6866afd16289 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:04:14.471603 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-f4e4b670-71f3-4046-9f04-6866afd16289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:14.473551 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:14.565632 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 557/1116] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 13 11:04:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:04:14.713658 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a97cad7-9574-494f-8ffc-7ad19a4055ee None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:04:14.715244 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-4a97cad7-9574-494f-8ffc-7ad19a4055ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:14.859056 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a97cad7-9574-494f-8ffc-7ad19a4055ee None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:04:14.887356 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:14.973328 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68605dd-8550-4cfa-a2fb-080ea5854884 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78384fbffdd346578855e7214b335d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:04:14.973844 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68605dd-8550-4cfa-a2fb-080ea5854884 service nova] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:14.974144 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68605dd-8550-4cfa-a2fb-080ea5854884 service nova] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:14.974412 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68605dd-8550-4cfa-a2fb-080ea5854884 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:14.975991 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-a68605dd-8550-4cfa-a2fb-080ea5854884 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:15.063983 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68605dd-8550-4cfa-a2fb-080ea5854884 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:04:15.065603 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68605dd-8550-4cfa-a2fb-080ea5854884 service nova] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:04:15.083358 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 560/1117] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:04:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:04:17.134950 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de27a6ea-1075-43d7-a0bf-beac65db3dad None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:17.135450 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de27a6ea-1075-43d7-a0bf-beac65db3dad None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:17.135450 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de27a6ea-1075-43d7-a0bf-beac65db3dad None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:17.136837 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 558/1118] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 13 11:04:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:04:17.142512 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e0ee1-d72b-4c41-bb84-d1635d9d3cdf None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:17.142947 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e0ee1-d72b-4c41-bb84-d1635d9d3cdf None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:17.143051 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e0ee1-d72b-4c41-bb84-d1635d9d3cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:17.185375 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:17.211574 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-223e0ee1-d72b-4c41-bb84-d1635d9d3cdf None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:04:17.213536 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-223e0ee1-d72b-4c41-bb84-d1635d9d3cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:17.307843 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 561/1119] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 13 11:04:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:04:17.594086 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de27a6ea-1075-43d7-a0bf-beac65db3dad None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:04:17.595661 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-de27a6ea-1075-43d7-a0bf-beac65db3dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:17.697492 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de27a6ea-1075-43d7-a0bf-beac65db3dad None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:04:17.728677 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:17.769893 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e0591b-53ce-4d63-975f-f8d68a8b79b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:04:17.770515 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0591b-53ce-4d63-975f-f8d68a8b79b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:17.770792 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0591b-53ce-4d63-975f-f8d68a8b79b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:17.771060 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0591b-53ce-4d63-975f-f8d68a8b79b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:17.772649 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-d5e0591b-53ce-4d63-975f-f8d68a8b79b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:17.882506 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e0591b-53ce-4d63-975f-f8d68a8b79b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:04:17.883714 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e0591b-53ce-4d63-975f-f8d68a8b79b9 service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:04:17.901899 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 559/1120] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:04:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:04:20.232201 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7517383-bee5-4f57-a7d1-600c53a8a0cd None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:20.232781 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7517383-bee5-4f57-a7d1-600c53a8a0cd None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:20.232781 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7517383-bee5-4f57-a7d1-600c53a8a0cd None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:20.234102 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 562/1121] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 13 11:04:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:04:20.239347 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a95a6-2f48-4105-bda0-e5e2dfcb9237 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:20.239776 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a95a6-2f48-4105-bda0-e5e2dfcb9237 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:20.240133 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a95a6-2f48-4105-bda0-e5e2dfcb9237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:20.304256 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-a77a95a6-2f48-4105-bda0-e5e2dfcb9237 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:04:20.305464 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-a77a95a6-2f48-4105-bda0-e5e2dfcb9237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:20.318084 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:20.400472 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 560/1122] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 13 11:04:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:04:20.681651 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7517383-bee5-4f57-a7d1-600c53a8a0cd None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:04:20.683241 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-f7517383-bee5-4f57-a7d1-600c53a8a0cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:20.787595 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7517383-bee5-4f57-a7d1-600c53a8a0cd None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:04:20.800396 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:20.861040 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69119d70-61e9-4b7c-9fa5-77ea53b4558f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:04:20.861634 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69119d70-61e9-4b7c-9fa5-77ea53b4558f service neutron] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:20.861913 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69119d70-61e9-4b7c-9fa5-77ea53b4558f service neutron] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:20.862214 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69119d70-61e9-4b7c-9fa5-77ea53b4558f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:20.863795 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-69119d70-61e9-4b7c-9fa5-77ea53b4558f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:20.970417 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69119d70-61e9-4b7c-9fa5-77ea53b4558f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:04:20.971767 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69119d70-61e9-4b7c-9fa5-77ea53b4558f service neutron] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:04:20.989381 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 563/1123] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:04:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:04:23.502391 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c9000-5bab-4f30-960c-b7487ac528e7 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:23.502959 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c9000-5bab-4f30-960c-b7487ac528e7 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:23.502959 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c9000-5bab-4f30-960c-b7487ac528e7 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:23.504426 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 561/1124] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 13 11:04:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:04:23.509843 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace950d-3b81-4131-9549-7a7f37edcda5 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:23.510282 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace950d-3b81-4131-9549-7a7f37edcda5 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:23.510432 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace950d-3b81-4131-9549-7a7f37edcda5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:23.558225 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:23.575399 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-bace950d-3b81-4131-9549-7a7f37edcda5 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:04:23.576589 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-bace950d-3b81-4131-9549-7a7f37edcda5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:23.669999 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 564/1125] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 13 11:04:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:04:23.954173 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721c9000-5bab-4f30-960c-b7487ac528e7 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:04:23.955700 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-721c9000-5bab-4f30-960c-b7487ac528e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:24.054711 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721c9000-5bab-4f30-960c-b7487ac528e7 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:04:24.093559 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:24.126988 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3150f550-f80a-4d3b-957c-daf17af2cb78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:04:24.127582 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3150f550-f80a-4d3b-957c-daf17af2cb78 service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:24.127854 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3150f550-f80a-4d3b-957c-daf17af2cb78 service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:24.128121 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3150f550-f80a-4d3b-957c-daf17af2cb78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:24.129697 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-3150f550-f80a-4d3b-957c-daf17af2cb78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:24.239682 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3150f550-f80a-4d3b-957c-daf17af2cb78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:04:24.241382 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3150f550-f80a-4d3b-957c-daf17af2cb78 service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:04:24.259327 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 562/1126] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:04:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:04:26.504857 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d7cb32-6f06-4e08-8ef6-e2d9e99c741a None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:26.505441 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d7cb32-6f06-4e08-8ef6-e2d9e99c741a None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:26.505441 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d7cb32-6f06-4e08-8ef6-e2d9e99c741a None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:26.506822 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 565/1127] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 13 11:04:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:04:26.512251 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d03005-d2aa-4ea2-8ba8-29703acd17bf None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:26.512674 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d03005-d2aa-4ea2-8ba8-29703acd17bf None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:26.512807 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d03005-d2aa-4ea2-8ba8-29703acd17bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:26.578355 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-08d03005-d2aa-4ea2-8ba8-29703acd17bf None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:04:26.579561 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-08d03005-d2aa-4ea2-8ba8-29703acd17bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:26.599373 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:26.674419 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 563/1128] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 13 11:04:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:04:26.962259 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d7cb32-6f06-4e08-8ef6-e2d9e99c741a None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:04:26.963822 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-99d7cb32-6f06-4e08-8ef6-e2d9e99c741a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:27.065005 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d7cb32-6f06-4e08-8ef6-e2d9e99c741a None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:04:27.085001 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:27.139044 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382fa2bf-385e-402c-ac68-512b3be57470 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:04:27.139640 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382fa2bf-385e-402c-ac68-512b3be57470 service neutron] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:27.139915 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382fa2bf-385e-402c-ac68-512b3be57470 service neutron] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:27.140183 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382fa2bf-385e-402c-ac68-512b3be57470 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:27.141759 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-382fa2bf-385e-402c-ac68-512b3be57470 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:27.249204 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382fa2bf-385e-402c-ac68-512b3be57470 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:04:27.250567 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382fa2bf-385e-402c-ac68-512b3be57470 service neutron] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:04:27.268594 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 566/1129] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:04:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:04:29.452553 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e860503-1b01-44db-bfcb-36565e66aff7 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:29.453126 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e860503-1b01-44db-bfcb-36565e66aff7 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:29.453126 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e860503-1b01-44db-bfcb-36565e66aff7 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:29.454511 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 564/1130] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 13 11:04:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:04:29.459724 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f38e4a-ba9c-40b7-8552-c4bc124c0334 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:29.460149 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f38e4a-ba9c-40b7-8552-c4bc124c0334 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:29.460283 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f38e4a-ba9c-40b7-8552-c4bc124c0334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:29.523330 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:29.526162 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-14f38e4a-ba9c-40b7-8552-c4bc124c0334 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:04:29.527922 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-14f38e4a-ba9c-40b7-8552-c4bc124c0334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:29.624221 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 567/1131] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 13 11:04:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:04:29.906814 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e860503-1b01-44db-bfcb-36565e66aff7 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:04:29.908346 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-2e860503-1b01-44db-bfcb-36565e66aff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:30.008259 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e860503-1b01-44db-bfcb-36565e66aff7 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:04:30.056399 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:30.080421 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d28ffa5-a794-4b8f-9ca1-df92e707b6a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:04:30.081020 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28ffa5-a794-4b8f-9ca1-df92e707b6a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:30.081298 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28ffa5-a794-4b8f-9ca1-df92e707b6a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:30.081568 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28ffa5-a794-4b8f-9ca1-df92e707b6a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:30.083197 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-2d28ffa5-a794-4b8f-9ca1-df92e707b6a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:30.188855 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d28ffa5-a794-4b8f-9ca1-df92e707b6a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:04:30.190301 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d28ffa5-a794-4b8f-9ca1-df92e707b6a2 service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:04:30.208475 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 565/1132] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:04:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:04:32.452479 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8835502-5b24-450f-aaff-f548bf51537e None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:32.452994 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8835502-5b24-450f-aaff-f548bf51537e None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:32.453089 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8835502-5b24-450f-aaff-f548bf51537e None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:32.454431 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 568/1133] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 13 11:04:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:04:32.459582 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f38842f-bcc6-4860-a19e-b28449a935e1 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:32.460001 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f38842f-bcc6-4860-a19e-b28449a935e1 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:32.460136 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f38842f-bcc6-4860-a19e-b28449a935e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:32.523963 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-3f38842f-bcc6-4860-a19e-b28449a935e1 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:04:32.525738 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-3f38842f-bcc6-4860-a19e-b28449a935e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:32.553454 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:32.619935 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 566/1134] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 13 11:04:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:04:32.907516 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8835502-5b24-450f-aaff-f548bf51537e None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:04:32.909045 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-e8835502-5b24-450f-aaff-f548bf51537e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:33.010515 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8835502-5b24-450f-aaff-f548bf51537e None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:04:33.037926 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:33.082430 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be8f127-9025-4dec-b26f-cb96ad338542 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:04:33.083035 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be8f127-9025-4dec-b26f-cb96ad338542 service neutron] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:33.083313 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be8f127-9025-4dec-b26f-cb96ad338542 service neutron] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:33.083584 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be8f127-9025-4dec-b26f-cb96ad338542 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:33.085176 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-5be8f127-9025-4dec-b26f-cb96ad338542 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:33.192338 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be8f127-9025-4dec-b26f-cb96ad338542 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:04:33.193789 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be8f127-9025-4dec-b26f-cb96ad338542 service neutron] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:04:33.211353 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 569/1135] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:04:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:04:35.398375 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0032a-6da8-41c0-8c12-e96622702696 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:35.398993 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0032a-6da8-41c0-8c12-e96622702696 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:35.398993 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0032a-6da8-41c0-8c12-e96622702696 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:35.400783 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 567/1136] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 13 11:04:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:04:35.405996 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd65ca9-965b-412d-b7bf-034510b79965 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:35.406445 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd65ca9-965b-412d-b7bf-034510b79965 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:35.406587 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd65ca9-965b-412d-b7bf-034510b79965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:35.471994 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-2dd65ca9-965b-412d-b7bf-034510b79965 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:04:35.473217 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-2dd65ca9-965b-412d-b7bf-034510b79965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:35.481375 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:35.573061 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 570/1137] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 13 11:04:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:04:35.855931 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a0032a-6da8-41c0-8c12-e96622702696 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:04:35.857508 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-93a0032a-6da8-41c0-8c12-e96622702696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:35.959302 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a0032a-6da8-41c0-8c12-e96622702696 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:04:36.013018 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:36.030718 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b184e-cbff-45cc-84ed-e6f0417b06f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:04:36.031321 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b184e-cbff-45cc-84ed-e6f0417b06f4 service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:36.031595 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b184e-cbff-45cc-84ed-e6f0417b06f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:36.031867 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b184e-cbff-45cc-84ed-e6f0417b06f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:36.033453 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-fa3b184e-cbff-45cc-84ed-e6f0417b06f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:36.139659 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3b184e-cbff-45cc-84ed-e6f0417b06f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:04:36.140987 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3b184e-cbff-45cc-84ed-e6f0417b06f4 service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:04:36.158441 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 568/1138] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:04:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:04:38.331080 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ad13d-85e6-4753-8f97-c30e163e8e95 None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:38.331659 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ad13d-85e6-4753-8f97-c30e163e8e95 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:38.331659 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ad13d-85e6-4753-8f97-c30e163e8e95 None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:38.332959 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 571/1139] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 13 11:04:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:04:38.338840 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9640aa28-76cf-45c7-9fe2-8f9c1150c8ea None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:38.339534 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9640aa28-76cf-45c7-9fe2-8f9c1150c8ea None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:38.339781 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9640aa28-76cf-45c7-9fe2-8f9c1150c8ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:38.404597 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-9640aa28-76cf-45c7-9fe2-8f9c1150c8ea None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:04:38.405824 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-9640aa28-76cf-45c7-9fe2-8f9c1150c8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:38.442901 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:38.501219 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 569/1140] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 13 11:04:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:04:38.786501 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ad13d-85e6-4753-8f97-c30e163e8e95 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:04:38.788077 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-4a3ad13d-85e6-4753-8f97-c30e163e8e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:38.889644 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ad13d-85e6-4753-8f97-c30e163e8e95 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:04:38.925760 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:38.961787 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3fb862-1ad2-4b32-b980-2c43521147a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:04:38.962433 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3fb862-1ad2-4b32-b980-2c43521147a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:38.962717 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3fb862-1ad2-4b32-b980-2c43521147a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:38.962985 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3fb862-1ad2-4b32-b980-2c43521147a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:38.964598 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-9f3fb862-1ad2-4b32-b980-2c43521147a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:39.072993 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3fb862-1ad2-4b32-b980-2c43521147a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:04:39.074370 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3fb862-1ad2-4b32-b980-2c43521147a1 service neutron] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:04:39.091681 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 572/1141] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:04:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:04:41.268896 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862ab22-5f7f-4d1c-88ac-aafcf9a6b120 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:41.269484 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862ab22-5f7f-4d1c-88ac-aafcf9a6b120 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:41.269484 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862ab22-5f7f-4d1c-88ac-aafcf9a6b120 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:41.270933 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 570/1142] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 13 11:04:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:04:41.276595 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff41941-341c-46eb-98f6-53675d3f5ace None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:41.276992 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff41941-341c-46eb-98f6-53675d3f5ace None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:41.277121 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff41941-341c-46eb-98f6-53675d3f5ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:41.343127 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-6ff41941-341c-46eb-98f6-53675d3f5ace None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:04:41.344332 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-6ff41941-341c-46eb-98f6-53675d3f5ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:41.362056 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:41.439325 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 573/1143] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 13 11:04:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:04:41.720617 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0862ab22-5f7f-4d1c-88ac-aafcf9a6b120 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:04:41.722199 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-0862ab22-5f7f-4d1c-88ac-aafcf9a6b120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:41.823031 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0862ab22-5f7f-4d1c-88ac-aafcf9a6b120 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:04:41.888000 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:41.895206 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb109ad-249e-4143-a09b-aa8215a94e78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:04:41.895810 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb109ad-249e-4143-a09b-aa8215a94e78 service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:41.896086 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb109ad-249e-4143-a09b-aa8215a94e78 service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:41.896354 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb109ad-249e-4143-a09b-aa8215a94e78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:41.897971 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-7fb109ad-249e-4143-a09b-aa8215a94e78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:42.004913 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb109ad-249e-4143-a09b-aa8215a94e78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:04:42.006307 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb109ad-249e-4143-a09b-aa8215a94e78 service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:04:42.025817 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 571/1144] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:04:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:04:44.172819 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a25d39-d840-402d-bf8e-d20b4955d806 None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:44.173359 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a25d39-d840-402d-bf8e-d20b4955d806 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:44.173359 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a25d39-d840-402d-bf8e-d20b4955d806 None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:44.174722 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 574/1145] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 13 11:04:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:04:44.179916 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8eb3d-e99d-422a-a717-1f07fcc74711 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:44.180321 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8eb3d-e99d-422a-a717-1f07fcc74711 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:44.180460 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8eb3d-e99d-422a-a717-1f07fcc74711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:44.245153 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-33b8eb3d-e99d-422a-a717-1f07fcc74711 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:04:44.246415 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-33b8eb3d-e99d-422a-a717-1f07fcc74711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:44.292928 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:44.340766 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 572/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 13 11:04:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:04:44.628581 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a25d39-d840-402d-bf8e-d20b4955d806 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:04:44.630184 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-63a25d39-d840-402d-bf8e-d20b4955d806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:44.730579 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a25d39-d840-402d-bf8e-d20b4955d806 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:04:44.777495 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:44.803012 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42f52b6-c2d3-44a3-88d9-f03550414a5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:04:44.803619 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f52b6-c2d3-44a3-88d9-f03550414a5c service neutron] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:44.803897 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f52b6-c2d3-44a3-88d9-f03550414a5c service neutron] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:44.804168 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f52b6-c2d3-44a3-88d9-f03550414a5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:44.805786 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-a42f52b6-c2d3-44a3-88d9-f03550414a5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:44.912948 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42f52b6-c2d3-44a3-88d9-f03550414a5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:04:44.914444 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42f52b6-c2d3-44a3-88d9-f03550414a5c service neutron] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:04:44.932785 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 575/1147] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:04:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:04:54.339316 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=22 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:54.930583 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=66 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:05:04.714362 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480f7db-578c-4050-ac4e-f87a859d0d19 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:05:04.714952 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480f7db-578c-4050-ac4e-f87a859d0d19 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:05:04.714952 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480f7db-578c-4050-ac4e-f87a859d0d19 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:05:04.716245 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 573/1148] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 11:05:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:05:04.721302 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0c2905-b145-45fc-b464-5d1f3fe4528b None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:05:04.721720 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0c2905-b145-45fc-b464-5d1f3fe4528b None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:05:04.721851 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0c2905-b145-45fc-b464-5d1f3fe4528b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:05:04.785850 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-6d0c2905-b145-45fc-b464-5d1f3fe4528b None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:05:04.787065 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-6d0c2905-b145-45fc-b464-5d1f3fe4528b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:05:04.880017 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 576/1149] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 11:05:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:05:05.180049 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05818111-9a07-4885-89f9-12fd53ea630c None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:05:05.180355 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05818111-9a07-4885-89f9-12fd53ea630c None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:05:05.180630 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05818111-9a07-4885-89f9-12fd53ea630c None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:05:05.181973 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 574/1150] 10.222.0.25 () {54 vars in 962 bytes} [Thu Oct 13 11:05:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:05:05.186791 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34bb55-0c79-44db-b76a-950a92d93f82 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:05:05.187079 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34bb55-0c79-44db-b76a-950a92d93f82 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:05:05.187383 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34bb55-0c79-44db-b76a-950a92d93f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:05:05.262561 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-fb34bb55-0c79-44db-b76a-950a92d93f82 None None] MFA Rules not processed for user `399f7d3700a24cb486e56b409a6e5429`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:05:05.263749 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-fb34bb55-0c79-44db-b76a-950a92d93f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:05:05.283709 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:05:05.337119 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 577/1151] 10.222.0.25 () {58 vars in 1059 bytes} [Thu Oct 13 11:05:05 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:05:05.345034 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05818111-9a07-4885-89f9-12fd53ea630c None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:05:05.346616 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-05818111-9a07-4885-89f9-12fd53ea630c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:05:05.446678 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05818111-9a07-4885-89f9-12fd53ea630c None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:05:05.518209 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae39af1-eaf1-45f5-9ebb-8bc67d501839 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '399f7d3700a24cb486e56b409a6e5429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:05:05.518816 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae39af1-eaf1-45f5-9ebb-8bc67d501839 service glance] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:05:05.519088 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae39af1-eaf1-45f5-9ebb-8bc67d501839 service glance] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:05:05.519355 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae39af1-eaf1-45f5-9ebb-8bc67d501839 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:05:05.520920 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-2ae39af1-eaf1-45f5-9ebb-8bc67d501839 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:05:05.574200 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:05:05.629301 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae39af1-eaf1-45f5-9ebb-8bc67d501839 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:05:05.630770 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae39af1-eaf1-45f5-9ebb-8bc67d501839 service glance] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:05:05.650975 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 575/1152] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:05:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:05:07.867315 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e543b84-cc50-42cf-8450-c444e661eb80 None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:05:07.868419 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e543b84-cc50-42cf-8450-c444e661eb80 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:05:07.868419 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e543b84-cc50-42cf-8450-c444e661eb80 None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:05:07.869781 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 578/1153] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 11:05:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:05:07.875291 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b1b554-eee5-42ee-9fb1-646e93749b48 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:05:07.875763 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b1b554-eee5-42ee-9fb1-646e93749b48 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:05:07.875873 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b1b554-eee5-42ee-9fb1-646e93749b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:05:07.940684 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-35b1b554-eee5-42ee-9fb1-646e93749b48 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:05:07.941896 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-35b1b554-eee5-42ee-9fb1-646e93749b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:05:08.039420 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 576/1154] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 11:05:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 11:05:08.316728 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e543b84-cc50-42cf-8450-c444e661eb80 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:05:08.318287 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-5e543b84-cc50-42cf-8450-c444e661eb80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:05:08.444634 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e543b84-cc50-42cf-8450-c444e661eb80 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:05:08.494056 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:05:08.540696 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791458bd-a8fc-4e11-b77d-3cd8b7d5e7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:05:08.541298 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791458bd-a8fc-4e11-b77d-3cd8b7d5e7de admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:05:08.541573 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791458bd-a8fc-4e11-b77d-3cd8b7d5e7de admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:05:08.541840 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791458bd-a8fc-4e11-b77d-3cd8b7d5e7de admin admin] PATH_INFO: `/v3/projects` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:05:08.542510 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791458bd-a8fc-4e11-b77d-3cd8b7d5e7de admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:05:08.543511 dv-cinder-861001-1-smb devstack@keystone.service[81551]: WARNING py.warnings [None req-791458bd-a8fc-4e11-b77d-3cd8b7d5e7de admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 13 11:05:08.543511 dv-cinder-861001-1-smb devstack@keystone.service[81551]: warnings.warn(msg) Oct 13 11:05:08.543511 dv-cinder-861001-1-smb devstack@keystone.service[81551]: Oct 13 11:05:08.544642 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791458bd-a8fc-4e11-b77d-3cd8b7d5e7de admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:05:08.564436 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 579/1155] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Oct 13 11:05:08 2022] GET /identity/v3/projects => generated 2553 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:05:10.722777 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02407ef-ebac-4083-8f35-cf6bc2246cb1 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:05:10.723353 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02407ef-ebac-4083-8f35-cf6bc2246cb1 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:05:10.723473 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02407ef-ebac-4083-8f35-cf6bc2246cb1 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:05:10.724927 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 577/1156] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 11:05:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:05:10.730689 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd51e07-ceee-4b9e-973a-215f400fd100 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:05:10.731188 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd51e07-ceee-4b9e-973a-215f400fd100 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:05:10.731301 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd51e07-ceee-4b9e-973a-215f400fd100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:05:10.795864 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-3bd51e07-ceee-4b9e-973a-215f400fd100 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:05:10.797068 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-3bd51e07-ceee-4b9e-973a-215f400fd100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:05:10.891454 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 580/1157] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 11:05:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:05:11.182253 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02407ef-ebac-4083-8f35-cf6bc2246cb1 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:05:11.183782 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-a02407ef-ebac-4083-8f35-cf6bc2246cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:05:11.193407 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:05:11.327316 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02407ef-ebac-4083-8f35-cf6bc2246cb1 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:05:11.404618 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:05:11.437354 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da731f9a-3642-4d7c-98ba-3a5e06fa19ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78384fbffdd346578855e7214b335d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:05:11.437888 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da731f9a-3642-4d7c-98ba-3a5e06fa19ca service nova] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:05:11.438191 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da731f9a-3642-4d7c-98ba-3a5e06fa19ca service nova] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:05:11.438458 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da731f9a-3642-4d7c-98ba-3a5e06fa19ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:05:11.440028 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-da731f9a-3642-4d7c-98ba-3a5e06fa19ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:05:11.528936 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da731f9a-3642-4d7c-98ba-3a5e06fa19ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:05:11.530529 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da731f9a-3642-4d7c-98ba-3a5e06fa19ca service nova] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:05:11.548208 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 578/1158] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:05:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:05:13.869429 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9444ce-2f7c-413b-9258-90c1deca0423 None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:05:13.870026 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9444ce-2f7c-413b-9258-90c1deca0423 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:05:13.870026 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9444ce-2f7c-413b-9258-90c1deca0423 None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:05:13.871330 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 581/1159] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 11:05:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:05:13.876479 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf5b45-7f2e-49b4-802c-dfcb73eb0ec9 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:05:13.876934 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf5b45-7f2e-49b4-802c-dfcb73eb0ec9 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:05:13.877038 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf5b45-7f2e-49b4-802c-dfcb73eb0ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:05:13.941466 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-04cf5b45-7f2e-49b4-802c-dfcb73eb0ec9 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:05:13.942725 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-04cf5b45-7f2e-49b4-802c-dfcb73eb0ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:05:13.987403 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:05:14.036818 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 579/1160] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 11:05:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:05:14.328190 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9444ce-2f7c-413b-9258-90c1deca0423 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:05:14.329774 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-2f9444ce-2f7c-413b-9258-90c1deca0423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:05:14.352927 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:05:14.432004 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9444ce-2f7c-413b-9258-90c1deca0423 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:05:14.504720 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5285cc5e-fb7f-4b21-922f-aa5b1f305f09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:05:14.505348 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5285cc5e-fb7f-4b21-922f-aa5b1f305f09 service neutron] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:05:14.505631 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5285cc5e-fb7f-4b21-922f-aa5b1f305f09 service neutron] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:05:14.505901 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5285cc5e-fb7f-4b21-922f-aa5b1f305f09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:05:14.507528 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-5285cc5e-fb7f-4b21-922f-aa5b1f305f09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:05:14.580161 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:05:14.614617 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5285cc5e-fb7f-4b21-922f-aa5b1f305f09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:05:14.616029 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5285cc5e-fb7f-4b21-922f-aa5b1f305f09 service neutron] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:05:14.634845 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 582/1161] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:05:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:05:16.808029 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0195aea-2ae9-4cd5-940b-5fc0b04ef947 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:05:16.808599 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0195aea-2ae9-4cd5-940b-5fc0b04ef947 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:05:16.808599 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0195aea-2ae9-4cd5-940b-5fc0b04ef947 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:05:16.809982 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 580/1162] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 11:05:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:05:16.815099 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb01a63-f092-4519-8f3e-a61c96d99ac7 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:05:16.815548 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb01a63-f092-4519-8f3e-a61c96d99ac7 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:05:16.815656 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb01a63-f092-4519-8f3e-a61c96d99ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:05:16.880632 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-ebb01a63-f092-4519-8f3e-a61c96d99ac7 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:05:16.882366 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-ebb01a63-f092-4519-8f3e-a61c96d99ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:05:16.977305 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 583/1163] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 11:05:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:05:17.264500 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0195aea-2ae9-4cd5-940b-5fc0b04ef947 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:05:17.266085 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-d0195aea-2ae9-4cd5-940b-5fc0b04ef947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:05:17.364896 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0195aea-2ae9-4cd5-940b-5fc0b04ef947 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:05:17.436279 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:05:17.437721 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba054491-5cad-4dd6-a883-e1bb5090cd10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:05:17.438358 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba054491-5cad-4dd6-a883-e1bb5090cd10 service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:05:17.438827 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba054491-5cad-4dd6-a883-e1bb5090cd10 service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:05:17.439323 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba054491-5cad-4dd6-a883-e1bb5090cd10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:05:17.441071 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-ba054491-5cad-4dd6-a883-e1bb5090cd10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:05:17.546173 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba054491-5cad-4dd6-a883-e1bb5090cd10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:05:17.547521 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba054491-5cad-4dd6-a883-e1bb5090cd10 service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:05:17.566142 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 581/1164] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:05:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:05:19.869257 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376235e0-0b61-4a25-89db-48cefc96e75d None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:05:19.869832 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376235e0-0b61-4a25-89db-48cefc96e75d None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:05:19.869832 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376235e0-0b61-4a25-89db-48cefc96e75d None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:05:19.871148 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 584/1165] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 11:05:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:05:19.876519 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7abc50d-ac04-49ab-b4fe-9fdc575192dc None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:05:19.876932 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7abc50d-ac04-49ab-b4fe-9fdc575192dc None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:05:19.877077 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7abc50d-ac04-49ab-b4fe-9fdc575192dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:05:19.942548 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-c7abc50d-ac04-49ab-b4fe-9fdc575192dc None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:05:19.943755 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-c7abc50d-ac04-49ab-b4fe-9fdc575192dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:05:19.995620 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:05:20.038793 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 582/1166] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 11:05:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:05:20.325619 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376235e0-0b61-4a25-89db-48cefc96e75d None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:05:20.327238 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-376235e0-0b61-4a25-89db-48cefc96e75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:05:20.363423 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:05:20.430379 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376235e0-0b61-4a25-89db-48cefc96e75d None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:05:20.502211 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f5f5f0-4166-4635-8c10-f77f2afcda9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:05:20.502811 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f5f5f0-4166-4635-8c10-f77f2afcda9f service neutron] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:05:20.503086 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f5f5f0-4166-4635-8c10-f77f2afcda9f service neutron] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:05:20.503350 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f5f5f0-4166-4635-8c10-f77f2afcda9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:05:20.504926 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-45f5f5f0-4166-4635-8c10-f77f2afcda9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:05:20.583982 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:05:20.613192 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f5f5f0-4166-4635-8c10-f77f2afcda9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:05:20.614681 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f5f5f0-4166-4635-8c10-f77f2afcda9f service neutron] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:05:20.632601 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 585/1167] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:05:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:05:22.933760 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94232fd9-4426-4c76-81ff-14a3f1b5a3dd None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:05:22.934358 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94232fd9-4426-4c76-81ff-14a3f1b5a3dd None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:05:22.934358 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94232fd9-4426-4c76-81ff-14a3f1b5a3dd None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:05:22.935742 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 583/1168] 10.222.0.25 () {54 vars in 927 bytes} [Thu Oct 13 11:05:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:05:22.941016 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb553d-49f1-4268-85c1-b5be85c0178a None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:05:22.941438 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb553d-49f1-4268-85c1-b5be85c0178a None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:05:22.941539 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb553d-49f1-4268-85c1-b5be85c0178a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:05:23.006993 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-aecb553d-49f1-4268-85c1-b5be85c0178a None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:05:23.008761 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-aecb553d-49f1-4268-85c1-b5be85c0178a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:05:23.102917 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 586/1169] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Oct 13 11:05:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:05:23.389298 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94232fd9-4426-4c76-81ff-14a3f1b5a3dd None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:05:23.390951 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-94232fd9-4426-4c76-81ff-14a3f1b5a3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:05:23.491735 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94232fd9-4426-4c76-81ff-14a3f1b5a3dd None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:05:23.565248 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a87b21-bc6f-41c2-a22d-caa5924154a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:05:23.565816 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a87b21-bc6f-41c2-a22d-caa5924154a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:05:23.566165 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a87b21-bc6f-41c2-a22d-caa5924154a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:05:23.566467 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a87b21-bc6f-41c2-a22d-caa5924154a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:05:23.568277 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-88a87b21-bc6f-41c2-a22d-caa5924154a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:05:23.576842 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:05:23.674620 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a87b21-bc6f-41c2-a22d-caa5924154a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:05:23.676042 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a87b21-bc6f-41c2-a22d-caa5924154a5 service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:05:23.693864 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 584/1170] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:05:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 13 11:05:33.101452 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=82 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:05:33.691655 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=50 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:06:41.810676 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08fff6b-2d38-42ac-b472-469dbe33f3d5 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:06:41.811311 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08fff6b-2d38-42ac-b472-469dbe33f3d5 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:06:41.811311 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08fff6b-2d38-42ac-b472-469dbe33f3d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:06:41.885877 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-c08fff6b-2d38-42ac-b472-469dbe33f3d5 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:06:41.887123 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-c08fff6b-2d38-42ac-b472-469dbe33f3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:06:41.982917 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 587/1171] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:06:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:06:41.990744 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ff01d-6b02-4988-8563-9f6a1f0110b0 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:06:41.991774 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ff01d-6b02-4988-8563-9f6a1f0110b0 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:06:41.991880 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ff01d-6b02-4988-8563-9f6a1f0110b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:06:42.067306 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-8f3ff01d-6b02-4988-8563-9f6a1f0110b0 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:06:42.068441 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-8f3ff01d-6b02-4988-8563-9f6a1f0110b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:06:42.161721 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 585/1172] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:06:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:06:42.166915 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08fff6b-2d38-42ac-b472-469dbe33f3d5 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:06:42.168169 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-c08fff6b-2d38-42ac-b472-469dbe33f3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:06:42.179964 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08fff6b-2d38-42ac-b472-469dbe33f3d5 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:06:42.239246 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:06:42.272650 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f1b520-173d-4988-bfa4-cb977583f259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:06:42.273250 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f1b520-173d-4988-bfa4-cb977583f259 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:06:42.273534 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f1b520-173d-4988-bfa4-cb977583f259 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:06:42.273804 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f1b520-173d-4988-bfa4-cb977583f259 admin admin] PATH_INFO: `/v3/domains` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:06:42.274471 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f1b520-173d-4988-bfa4-cb977583f259 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:06:42.274770 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f1b520-173d-4988-bfa4-cb977583f259 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:06:42.275767 dv-cinder-861001-1-smb devstack@keystone.service[81551]: WARNING py.warnings [None req-d4f1b520-173d-4988-bfa4-cb977583f259 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 11:06:42.275767 dv-cinder-861001-1-smb devstack@keystone.service[81551]: warnings.warn(msg) Oct 13 11:06:42.275767 dv-cinder-861001-1-smb devstack@keystone.service[81551]: Oct 13 11:06:42.276662 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f1b520-173d-4988-bfa4-cb977583f259 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:06:42.287447 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 588/1173] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 11:06:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 11:06:42.297225 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ff01d-6b02-4988-8563-9f6a1f0110b0 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:06:42.306848 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ff01d-6b02-4988-8563-9f6a1f0110b0 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:06:42.365928 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:06:42.398852 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999a42c9-fab2-43db-bc28-67a8f18e3a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:06:42.399448 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a42c9-fab2-43db-bc28-67a8f18e3a4b admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:06:42.399723 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a42c9-fab2-43db-bc28-67a8f18e3a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:06:42.399996 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a42c9-fab2-43db-bc28-67a8f18e3a4b admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:06:42.400624 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999a42c9-fab2-43db-bc28-67a8f18e3a4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:06:42.401726 dv-cinder-861001-1-smb devstack@keystone.service[81550]: WARNING py.warnings [None req-999a42c9-fab2-43db-bc28-67a8f18e3a4b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 13 11:06:42.401726 dv-cinder-861001-1-smb devstack@keystone.service[81550]: warnings.warn(msg) Oct 13 11:06:42.401726 dv-cinder-861001-1-smb devstack@keystone.service[81550]: Oct 13 11:06:42.402937 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999a42c9-fab2-43db-bc28-67a8f18e3a4b admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:06:42.457264 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 586/1174] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:06:42 2022] POST /identity/v3/projects => generated 379 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:06:42.461532 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f1b520-173d-4988-bfa4-cb977583f259 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:06:42.463113 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-d4f1b520-173d-4988-bfa4-cb977583f259 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:06:42.496493 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f1b520-173d-4988-bfa4-cb977583f259 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:06:42.588829 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee9c4b-4c3b-44a1-a58c-6e8028a77c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:06:42.589438 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee9c4b-4c3b-44a1-a58c-6e8028a77c8c admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:06:42.589717 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee9c4b-4c3b-44a1-a58c-6e8028a77c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:06:42.590008 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee9c4b-4c3b-44a1-a58c-6e8028a77c8c admin admin] PATH_INFO: `/v3/users` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:06:42.590641 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ee9c4b-4c3b-44a1-a58c-6e8028a77c8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:06:42.591639 dv-cinder-861001-1-smb devstack@keystone.service[81551]: WARNING py.warnings [None req-d2ee9c4b-4c3b-44a1-a58c-6e8028a77c8c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 13 11:06:42.591639 dv-cinder-861001-1-smb devstack@keystone.service[81551]: warnings.warn(msg) Oct 13 11:06:42.591639 dv-cinder-861001-1-smb devstack@keystone.service[81551]: Oct 13 11:06:42.592837 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ee9c4b-4c3b-44a1-a58c-6e8028a77c8c admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:06:42.634075 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 589/1175] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:06:42 2022] POST /identity/v3/users => generated 290 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:06:42.638035 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999a42c9-fab2-43db-bc28-67a8f18e3a4b admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:06:42.639532 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-999a42c9-fab2-43db-bc28-67a8f18e3a4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:06:42.700181 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999a42c9-fab2-43db-bc28-67a8f18e3a4b admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:06:42.785088 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:06:42.793640 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4078ac-fef0-484d-812d-df285895ada2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:06:42.794418 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4078ac-fef0-484d-812d-df285895ada2 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:06:42.794935 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4078ac-fef0-484d-812d-df285895ada2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:06:42.795360 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4078ac-fef0-484d-812d-df285895ada2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:06:42.796222 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4078ac-fef0-484d-812d-df285895ada2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:06:42.797806 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4078ac-fef0-484d-812d-df285895ada2 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:06:42.810127 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 587/1176] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:06:42 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:06:42.814121 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee9c4b-4c3b-44a1-a58c-6e8028a77c8c admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:06:42.815622 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-d2ee9c4b-4c3b-44a1-a58c-6e8028a77c8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:06:42.826804 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee9c4b-4c3b-44a1-a58c-6e8028a77c8c admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:06:42.853068 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:06:42.924588 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31667a6-98a0-4a51-9cd8-378285c2cb90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:06:42.925193 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31667a6-98a0-4a51-9cd8-378285c2cb90 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:06:42.925475 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31667a6-98a0-4a51-9cd8-378285c2cb90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:06:42.925745 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31667a6-98a0-4a51-9cd8-378285c2cb90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:06:42.926416 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31667a6-98a0-4a51-9cd8-378285c2cb90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:06:42.928005 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31667a6-98a0-4a51-9cd8-378285c2cb90 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:06:42.940627 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 590/1177] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:06:42 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:06:42.944815 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4078ac-fef0-484d-812d-df285895ada2 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:06:42.946374 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-5e4078ac-fef0-484d-812d-df285895ada2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:06:42.979493 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4078ac-fef0-484d-812d-df285895ada2 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:06:43.072275 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73098f9d-48ac-4e6c-8d78-d9440133066d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:06:43.072915 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73098f9d-48ac-4e6c-8d78-d9440133066d admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:06:43.073189 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73098f9d-48ac-4e6c-8d78-d9440133066d admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:06:43.073459 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73098f9d-48ac-4e6c-8d78-d9440133066d admin admin] PATH_INFO: `/v3/projects/b6ecc2518e0c4c978d9faa35553f9d3a/users/ca47019d4ef6412fa8289f30b1354b6b/roles/7c3871c0ab68438b9014489d50b53a22` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:06:43.094948 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73098f9d-48ac-4e6c-8d78-d9440133066d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6ecc2518e0c4c978d9faa35553f9d3a, user_id=ca47019d4ef6412fa8289f30b1354b6b, role_id=7c3871c0ab68438b9014489d50b53a22)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:06:43.097575 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73098f9d-48ac-4e6c-8d78-d9440133066d admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:06:43.123970 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 588/1178] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:06:42 2022] PUT /identity/v3/projects/b6ecc2518e0c4c978d9faa35553f9d3a/users/ca47019d4ef6412fa8289f30b1354b6b/roles/7c3871c0ab68438b9014489d50b53a22 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:06:43.134914 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853f96c-2ba8-4b43-b1e8-f9f3869e7880 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:06:43.135202 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853f96c-2ba8-4b43-b1e8-f9f3869e7880 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:06:43.135479 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853f96c-2ba8-4b43-b1e8-f9f3869e7880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:06:43.192290 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-4853f96c-2ba8-4b43-b1e8-f9f3869e7880 None None] MFA Rules not processed for user `ca47019d4ef6412fa8289f30b1354b6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:06:43.193438 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-4853f96c-2ba8-4b43-b1e8-f9f3869e7880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:06:43.268113 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 591/1179] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:06:43 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:06:43.281655 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2199780-891b-4b0c-93b5-7efd84b5b4da None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:06:43.281985 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2199780-891b-4b0c-93b5-7efd84b5b4da None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:06:43.282287 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2199780-891b-4b0c-93b5-7efd84b5b4da None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:06:43.283619 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 589/1180] 10.222.0.25 () {54 vars in 963 bytes} [Thu Oct 13 11:06:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:06:43.288886 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a5d8d-374b-41c1-86e7-ce3853d8ce1c None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:06:43.289174 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a5d8d-374b-41c1-86e7-ce3853d8ce1c None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:06:43.289450 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a5d8d-374b-41c1-86e7-ce3853d8ce1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:06:43.319785 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:06:43.364164 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-f02a5d8d-374b-41c1-86e7-ce3853d8ce1c None None] MFA Rules not processed for user `35f4c2fc51f54f0e977648b13efaed1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:06:43.365367 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-f02a5d8d-374b-41c1-86e7-ce3853d8ce1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:06:43.438475 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 592/1181] 10.222.0.25 () {58 vars in 1060 bytes} [Thu Oct 13 11:06:43 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:06:43.446045 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2199780-891b-4b0c-93b5-7efd84b5b4da None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:06:43.447510 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-d2199780-891b-4b0c-93b5-7efd84b5b4da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:06:43.497175 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:06:43.550828 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2199780-891b-4b0c-93b5-7efd84b5b4da None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:06:43.622473 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c79e0d-3806-423c-8a65-83a45dbecc04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f4c2fc51f54f0e977648b13efaed1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:06:43.623070 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c79e0d-3806-423c-8a65-83a45dbecc04 service cinder] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:06:43.623342 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c79e0d-3806-423c-8a65-83a45dbecc04 service cinder] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:06:43.623608 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c79e0d-3806-423c-8a65-83a45dbecc04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:06:43.625168 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-77c79e0d-3806-423c-8a65-83a45dbecc04 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:06:43.720140 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c79e0d-3806-423c-8a65-83a45dbecc04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:06:43.721481 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c79e0d-3806-423c-8a65-83a45dbecc04 service cinder] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:06:43.724858 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:06:43.739535 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 590/1182] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:06:43 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:06:43.785103 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a7afb9-153f-4635-afce-2ef95ce77ae6 None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:06:43.785390 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a7afb9-153f-4635-afce-2ef95ce77ae6 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:06:43.785663 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a7afb9-153f-4635-afce-2ef95ce77ae6 None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:06:43.786922 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 593/1183] 10.222.0.25 () {52 vars in 830 bytes} [Thu Oct 13 11:06:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:06:43.790530 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c79e0d-3806-423c-8a65-83a45dbecc04 service cinder] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:06:43.791744 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-77c79e0d-3806-423c-8a65-83a45dbecc04 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:06:43.889352 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c79e0d-3806-423c-8a65-83a45dbecc04 service cinder] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:06:43.980374 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db74cdeb-8eb4-455b-ab3f-b5607f67f02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:06:43.980933 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db74cdeb-8eb4-455b-ab3f-b5607f67f02b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:06:43.981209 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db74cdeb-8eb4-455b-ab3f-b5607f67f02b admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:06:43.981482 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db74cdeb-8eb4-455b-ab3f-b5607f67f02b admin admin] PATH_INFO: `/v3/users/ca47019d4ef6412fa8289f30b1354b6b` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:06:43.994856 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db74cdeb-8eb4-455b-ab3f-b5607f67f02b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca47019d4ef6412fa8289f30b1354b6b)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:06:43.995882 dv-cinder-861001-1-smb devstack@keystone.service[81550]: WARNING py.warnings [None req-db74cdeb-8eb4-455b-ab3f-b5607f67f02b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 13 11:06:43.995882 dv-cinder-861001-1-smb devstack@keystone.service[81550]: warnings.warn(msg) Oct 13 11:06:43.995882 dv-cinder-861001-1-smb devstack@keystone.service[81550]: Oct 13 11:06:43.997079 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db74cdeb-8eb4-455b-ab3f-b5607f67f02b admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:06:44.006451 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:06:44.062865 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-db74cdeb-8eb4-455b-ab3f-b5607f67f02b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca47019d4ef6412fa8289f30b1354b6b'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:06:44.063312 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-db74cdeb-8eb4-455b-ab3f-b5607f67f02b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca47019d4ef6412fa8289f30b1354b6b'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:06:44.063830 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-db74cdeb-8eb4-455b-ab3f-b5607f67f02b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca47019d4ef6412fa8289f30b1354b6b'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:06:44.086492 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-db74cdeb-8eb4-455b-ab3f-b5607f67f02b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca47019d4ef6412fa8289f30b1354b6b'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:06:44.095811 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-db74cdeb-8eb4-455b-ab3f-b5607f67f02b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca47019d4ef6412fa8289f30b1354b6b'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:06:44.114864 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 591/1184] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:06:43 2022] DELETE /identity/v3/users/ca47019d4ef6412fa8289f30b1354b6b => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:06:44.119998 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f887b-a1b5-4a45-91eb-f42bc37fe7b0 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:06:44.120459 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f887b-a1b5-4a45-91eb-f42bc37fe7b0 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:06:44.120554 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f887b-a1b5-4a45-91eb-f42bc37fe7b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:06:44.176726 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-f37f887b-a1b5-4a45-91eb-f42bc37fe7b0 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:06:44.177913 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-f37f887b-a1b5-4a45-91eb-f42bc37fe7b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:06:44.251982 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:06:44.266226 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 594/1185] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:06:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:06:44.275895 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db74cdeb-8eb4-455b-ab3f-b5607f67f02b admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:06:44.277114 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-db74cdeb-8eb4-455b-ab3f-b5607f67f02b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:06:44.374532 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db74cdeb-8eb4-455b-ab3f-b5607f67f02b admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:06:44.427251 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:06:44.448528 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff8bc49-1e5d-443e-b0c7-d603ca6eb18a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:06:44.449134 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8bc49-1e5d-443e-b0c7-d603ca6eb18a service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:06:44.449411 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8bc49-1e5d-443e-b0c7-d603ca6eb18a service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:06:44.449737 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8bc49-1e5d-443e-b0c7-d603ca6eb18a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:06:44.451413 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-3ff8bc49-1e5d-443e-b0c7-d603ca6eb18a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:06:44.560015 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff8bc49-1e5d-443e-b0c7-d603ca6eb18a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:06:44.561662 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff8bc49-1e5d-443e-b0c7-d603ca6eb18a service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:06:44.579660 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 592/1186] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:06:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:06:44.924468 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37f887b-a1b5-4a45-91eb-f42bc37fe7b0 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:06:44.925754 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-f37f887b-a1b5-4a45-91eb-f42bc37fe7b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:06:44.937544 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37f887b-a1b5-4a45-91eb-f42bc37fe7b0 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:06:45.041851 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f37171-a8d0-4269-925f-26d71adb645a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:06:45.042508 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f37171-a8d0-4269-925f-26d71adb645a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:06:45.042785 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f37171-a8d0-4269-925f-26d71adb645a admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:06:45.043052 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f37171-a8d0-4269-925f-26d71adb645a admin admin] PATH_INFO: `/v3/projects/b6ecc2518e0c4c978d9faa35553f9d3a` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:06:45.052627 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f37171-a8d0-4269-925f-26d71adb645a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6ecc2518e0c4c978d9faa35553f9d3a)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:06:45.053667 dv-cinder-861001-1-smb devstack@keystone.service[81551]: WARNING py.warnings [None req-11f37171-a8d0-4269-925f-26d71adb645a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 13 11:06:45.053667 dv-cinder-861001-1-smb devstack@keystone.service[81551]: warnings.warn(msg) Oct 13 11:06:45.053667 dv-cinder-861001-1-smb devstack@keystone.service[81551]: Oct 13 11:06:45.054902 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f37171-a8d0-4269-925f-26d71adb645a admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:06:45.111625 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-11f37171-a8d0-4269-925f-26d71adb645a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6ecc2518e0c4c978d9faa35553f9d3a', 'request_id': 'req-11f37171-a8d0-4269-925f-26d71adb645a'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:06:45.125040 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-11f37171-a8d0-4269-925f-26d71adb645a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6ecc2518e0c4c978d9faa35553f9d3a', 'request_id': 'req-11f37171-a8d0-4269-925f-26d71adb645a'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:06:45.131028 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-11f37171-a8d0-4269-925f-26d71adb645a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6ecc2518e0c4c978d9faa35553f9d3a', 'request_id': 'req-11f37171-a8d0-4269-925f-26d71adb645a'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:06:45.158112 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-11f37171-a8d0-4269-925f-26d71adb645a admin admin] The token cache is being invalidate because project b6ecc2518e0c4c978d9faa35553f9d3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:06:45.158401 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-11f37171-a8d0-4269-925f-26d71adb645a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:06:45.158832 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-11f37171-a8d0-4269-925f-26d71adb645a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:06:45.160213 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 595/1187] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:06:44 2022] DELETE /identity/v3/projects/b6ecc2518e0c4c978d9faa35553f9d3a => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:06:54.577444 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=62 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:06:55.156169 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:08:17.012450 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c8603-5cab-44ec-a016-857922c4cac4 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:08:17.013044 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c8603-5cab-44ec-a016-857922c4cac4 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:08:17.013044 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c8603-5cab-44ec-a016-857922c4cac4 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:08:17.014410 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 593/1188] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 13 11:08:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:08:17.019216 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580ec72-6162-4f07-8f05-56e5f29838b5 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:08:17.019659 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580ec72-6162-4f07-8f05-56e5f29838b5 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:08:17.019756 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580ec72-6162-4f07-8f05-56e5f29838b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:08:17.101621 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-3580ec72-6162-4f07-8f05-56e5f29838b5 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:08:17.102844 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-3580ec72-6162-4f07-8f05-56e5f29838b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:08:17.204212 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 596/1189] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 13 11:08:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:08:17.364356 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0c8603-5cab-44ec-a016-857922c4cac4 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:08:17.367010 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-3e0c8603-5cab-44ec-a016-857922c4cac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:08:17.481642 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0c8603-5cab-44ec-a016-857922c4cac4 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:08:17.486920 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db3e60-f113-472f-ab82-e68aaeea81d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78384fbffdd346578855e7214b335d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:08:17.487521 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db3e60-f113-472f-ab82-e68aaeea81d6 service nova] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:08:17.487795 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db3e60-f113-472f-ab82-e68aaeea81d6 service nova] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:08:17.488066 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db3e60-f113-472f-ab82-e68aaeea81d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:08:17.496817 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79db3e60-f113-472f-ab82-e68aaeea81d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:08:17.498419 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79db3e60-f113-472f-ab82-e68aaeea81d6 service nova] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:08:17.507747 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 594/1190] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:08:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:08:18.575763 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24117c78-d5c3-4680-8491-1c321320f0d7 None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:08:18.576297 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24117c78-d5c3-4680-8491-1c321320f0d7 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:08:18.576398 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24117c78-d5c3-4680-8491-1c321320f0d7 None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:08:18.577977 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 597/1191] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 13 11:08:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:08:18.584138 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7227b52-5df6-455b-9ceb-0ad7d263fd43 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:08:18.584580 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7227b52-5df6-455b-9ceb-0ad7d263fd43 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:08:18.585335 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7227b52-5df6-455b-9ceb-0ad7d263fd43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:08:18.605218 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-c7227b52-5df6-455b-9ceb-0ad7d263fd43 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:08:18.606436 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-c7227b52-5df6-455b-9ceb-0ad7d263fd43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:08:18.614101 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 595/1192] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 13 11:08:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:08:18.675723 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b4f8a-8249-41ad-bc0f-0bca8760999d None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:08:18.676006 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b4f8a-8249-41ad-bc0f-0bca8760999d None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:08:18.676277 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b4f8a-8249-41ad-bc0f-0bca8760999d None None] PATH_INFO: `/v3` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:08:18.677616 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 598/1193] 10.222.0.30 () {54 vars in 925 bytes} [Thu Oct 13 11:08:18 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:08:18.684731 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76fb251-07b0-4826-8a5d-90fa3cb77915 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:08:18.685025 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76fb251-07b0-4826-8a5d-90fa3cb77915 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:08:18.685303 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76fb251-07b0-4826-8a5d-90fa3cb77915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:08:18.744418 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-a76fb251-07b0-4826-8a5d-90fa3cb77915 None None] MFA Rules not processed for user `ed4bb75e68a640fc92ddd47fad61a25a`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:08:18.745874 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-a76fb251-07b0-4826-8a5d-90fa3cb77915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:08:18.767771 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b4f8a-8249-41ad-bc0f-0bca8760999d None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:08:18.782316 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b4f8a-8249-41ad-bc0f-0bca8760999d None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:08:18.787625 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a15301-f09b-41bb-a240-a539ec49c08e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78384fbffdd346578855e7214b335d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:08:18.788833 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a15301-f09b-41bb-a240-a539ec49c08e service nova] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:08:18.789116 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a15301-f09b-41bb-a240-a539ec49c08e service nova] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:08:18.789385 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a15301-f09b-41bb-a240-a539ec49c08e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:08:18.797704 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a15301-f09b-41bb-a240-a539ec49c08e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:08:18.799313 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a15301-f09b-41bb-a240-a539ec49c08e service nova] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:08:18.800028 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:08:18.808821 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 599/1194] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:08:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 13 11:08:18.820028 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 596/1195] 10.222.0.30 () {58 vars in 1015 bytes} [Thu Oct 13 11:08:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 11:08:27.610681 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba241a7-b3a1-43f1-93e5-f0c92a4ac8fa None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:08:27.611105 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba241a7-b3a1-43f1-93e5-f0c92a4ac8fa None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:08:27.611213 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba241a7-b3a1-43f1-93e5-f0c92a4ac8fa None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:08:27.612565 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 600/1196] 10.222.0.25 () {54 vars in 961 bytes} [Thu Oct 13 11:08:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:08:27.617612 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2df8d0-a735-44a4-b240-6ff45fc76755 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:08:27.618026 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2df8d0-a735-44a4-b240-6ff45fc76755 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:08:27.618196 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2df8d0-a735-44a4-b240-6ff45fc76755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:08:27.637474 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-4f2df8d0-a735-44a4-b240-6ff45fc76755 None None] MFA Rules not processed for user `ed4bb75e68a640fc92ddd47fad61a25a`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:08:27.638708 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-4f2df8d0-a735-44a4-b240-6ff45fc76755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:08:27.647360 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 597/1197] 10.222.0.25 () {58 vars in 1058 bytes} [Thu Oct 13 11:08:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:08:27.655308 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba241a7-b3a1-43f1-93e5-f0c92a4ac8fa None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:08:27.668917 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba241a7-b3a1-43f1-93e5-f0c92a4ac8fa None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:08:27.673723 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9270193-e900-4c25-a545-815dbf82cc9e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed4bb75e68a640fc92ddd47fad61a25a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:08:27.674350 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9270193-e900-4c25-a545-815dbf82cc9e service placement] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:08:27.674630 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9270193-e900-4c25-a545-815dbf82cc9e service placement] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:08:27.674900 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9270193-e900-4c25-a545-815dbf82cc9e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:08:27.682913 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9270193-e900-4c25-a545-815dbf82cc9e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:08:27.684497 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9270193-e900-4c25-a545-815dbf82cc9e service placement] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:08:27.693860 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 601/1198] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:08:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:08:30.253043 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e051af-92b6-4f1c-aa94-459df14ede57 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:08:30.253617 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e051af-92b6-4f1c-aa94-459df14ede57 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:08:30.253617 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e051af-92b6-4f1c-aa94-459df14ede57 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:08:30.254961 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 598/1199] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 13 11:08:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:08:30.261611 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d77f5f0-29ea-4bb7-90a3-29166eb0ac56 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:08:30.262058 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d77f5f0-29ea-4bb7-90a3-29166eb0ac56 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:08:30.262197 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d77f5f0-29ea-4bb7-90a3-29166eb0ac56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:08:30.282093 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-3d77f5f0-29ea-4bb7-90a3-29166eb0ac56 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:08:30.283309 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-3d77f5f0-29ea-4bb7-90a3-29166eb0ac56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:08:30.291215 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 602/1200] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 13 11:08:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:08:30.446414 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e051af-92b6-4f1c-aa94-459df14ede57 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:08:30.460928 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e051af-92b6-4f1c-aa94-459df14ede57 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:08:30.466236 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f986e084-87e0-468d-99f9-3b63419ebce9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78384fbffdd346578855e7214b335d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:08:30.466820 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f986e084-87e0-468d-99f9-3b63419ebce9 service nova] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:08:30.467095 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f986e084-87e0-468d-99f9-3b63419ebce9 service nova] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:08:30.467393 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f986e084-87e0-468d-99f9-3b63419ebce9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:08:30.475207 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f986e084-87e0-468d-99f9-3b63419ebce9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:08:30.476764 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f986e084-87e0-468d-99f9-3b63419ebce9 service nova] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:08:30.485786 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 599/1201] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:08:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:08:31.549220 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d7ceb-8b19-46db-a1b4-2fbbd69afc4b None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:08:31.549796 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d7ceb-8b19-46db-a1b4-2fbbd69afc4b None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:08:31.549796 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d7ceb-8b19-46db-a1b4-2fbbd69afc4b None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:08:31.551117 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 603/1202] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 13 11:08:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:08:31.557649 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681902ba-932a-4c62-bfd6-28066ed009db None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:08:31.558134 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681902ba-932a-4c62-bfd6-28066ed009db None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:08:31.558232 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681902ba-932a-4c62-bfd6-28066ed009db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:08:31.577775 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-681902ba-932a-4c62-bfd6-28066ed009db None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:08:31.578991 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-681902ba-932a-4c62-bfd6-28066ed009db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:08:31.586813 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 600/1203] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 13 11:08:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:08:31.734912 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1d7ceb-8b19-46db-a1b4-2fbbd69afc4b None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:08:31.749472 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1d7ceb-8b19-46db-a1b4-2fbbd69afc4b None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:08:31.754754 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6175024f-e630-4f8a-a263-3bcd1a9ab18d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78384fbffdd346578855e7214b335d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:08:31.755339 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6175024f-e630-4f8a-a263-3bcd1a9ab18d service nova] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:08:31.755621 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6175024f-e630-4f8a-a263-3bcd1a9ab18d service nova] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:08:31.755890 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6175024f-e630-4f8a-a263-3bcd1a9ab18d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:08:31.763643 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6175024f-e630-4f8a-a263-3bcd1a9ab18d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:08:31.765192 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6175024f-e630-4f8a-a263-3bcd1a9ab18d service nova] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:08:31.774269 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 604/1204] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:08:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:08:35.735252 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad14a35-acf7-4594-bf0e-6966d6c303cf None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:08:35.735820 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad14a35-acf7-4594-bf0e-6966d6c303cf None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:08:35.735820 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad14a35-acf7-4594-bf0e-6966d6c303cf None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:08:35.737139 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 601/1205] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 13 11:08:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:08:35.742471 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ba5fa-f8fd-465e-84e2-ec04022735bb None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:08:35.742911 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ba5fa-f8fd-465e-84e2-ec04022735bb None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:08:35.743058 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ba5fa-f8fd-465e-84e2-ec04022735bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:08:35.762577 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-4c2ba5fa-f8fd-465e-84e2-ec04022735bb None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:08:35.763773 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-4c2ba5fa-f8fd-465e-84e2-ec04022735bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:08:35.771581 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 605/1206] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 13 11:08:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:08:36.055705 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad14a35-acf7-4594-bf0e-6966d6c303cf None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:08:36.057407 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-6ad14a35-acf7-4594-bf0e-6966d6c303cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:08:36.133793 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad14a35-acf7-4594-bf0e-6966d6c303cf None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:08:36.137206 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc92476-9967-4b25-b43e-3668ffba4a02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:08:36.137804 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc92476-9967-4b25-b43e-3668ffba4a02 service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:08:36.138135 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc92476-9967-4b25-b43e-3668ffba4a02 service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:08:36.138411 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc92476-9967-4b25-b43e-3668ffba4a02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:08:36.147090 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc92476-9967-4b25-b43e-3668ffba4a02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:08:36.149096 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc92476-9967-4b25-b43e-3668ffba4a02 service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:08:36.158505 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 602/1207] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:08:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:08:38.292541 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90deb9d7-20ca-472a-95b1-188f49b35f46 None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:08:38.293083 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90deb9d7-20ca-472a-95b1-188f49b35f46 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:08:38.293083 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90deb9d7-20ca-472a-95b1-188f49b35f46 None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:08:38.294449 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 606/1208] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 13 11:08:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:08:38.299688 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b4c88-e1b0-41e7-9147-0b227761f259 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:08:38.300100 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b4c88-e1b0-41e7-9147-0b227761f259 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:08:38.300235 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b4c88-e1b0-41e7-9147-0b227761f259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:08:38.319969 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-aa6b4c88-e1b0-41e7-9147-0b227761f259 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:08:38.321721 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-aa6b4c88-e1b0-41e7-9147-0b227761f259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:08:38.331110 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 603/1209] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 13 11:08:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:08:38.618006 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90deb9d7-20ca-472a-95b1-188f49b35f46 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:08:38.629124 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90deb9d7-20ca-472a-95b1-188f49b35f46 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:08:38.633413 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f77a4b6-bf8b-4170-b944-0fde4b5f2e71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:08:38.634128 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f77a4b6-bf8b-4170-b944-0fde4b5f2e71 service neutron] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:08:38.634488 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f77a4b6-bf8b-4170-b944-0fde4b5f2e71 service neutron] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:08:38.634791 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f77a4b6-bf8b-4170-b944-0fde4b5f2e71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:08:38.643946 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f77a4b6-bf8b-4170-b944-0fde4b5f2e71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:08:38.645377 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f77a4b6-bf8b-4170-b944-0fde4b5f2e71 service neutron] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:08:38.655120 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 607/1210] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:08:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:08:42.162502 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f2fa9-adb9-4da6-ab6c-3d1bbbef218d None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:08:42.163085 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f2fa9-adb9-4da6-ab6c-3d1bbbef218d None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:08:42.163085 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f2fa9-adb9-4da6-ab6c-3d1bbbef218d None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:08:42.164802 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 604/1211] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 13 11:08:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:08:42.170179 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e82ef1b-64d0-40e5-add2-d8b594670252 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:08:42.170608 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e82ef1b-64d0-40e5-add2-d8b594670252 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:08:42.170740 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e82ef1b-64d0-40e5-add2-d8b594670252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:08:42.178298 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:08:42.191190 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-8e82ef1b-64d0-40e5-add2-d8b594670252 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:08:42.192382 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-8e82ef1b-64d0-40e5-add2-d8b594670252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:08:42.200039 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 608/1212] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 13 11:08:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:08:42.502476 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765f2fa9-adb9-4da6-ab6c-3d1bbbef218d None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:08:42.504178 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-765f2fa9-adb9-4da6-ab6c-3d1bbbef218d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:08:42.578507 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765f2fa9-adb9-4da6-ab6c-3d1bbbef218d None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:08:42.581967 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca7d271-19e2-454b-a346-93ce2f1a93ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f4c2fc51f54f0e977648b13efaed1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:08:42.582563 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7d271-19e2-454b-a346-93ce2f1a93ae service cinder] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:08:42.582838 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7d271-19e2-454b-a346-93ce2f1a93ae service cinder] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:08:42.583106 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7d271-19e2-454b-a346-93ce2f1a93ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:08:42.592161 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca7d271-19e2-454b-a346-93ce2f1a93ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:08:42.593575 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca7d271-19e2-454b-a346-93ce2f1a93ae service cinder] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:08:42.603292 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 605/1213] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:08:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:08:44.700276 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b224c43-ad21-4e3b-acb3-f7628ad16f0f None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:08:44.700864 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b224c43-ad21-4e3b-acb3-f7628ad16f0f None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:08:44.700864 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b224c43-ad21-4e3b-acb3-f7628ad16f0f None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:08:44.702197 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 609/1214] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 13 11:08:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:08:44.707504 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d69369-87d8-447d-b54f-c1ca5bf43dff None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:08:44.707927 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d69369-87d8-447d-b54f-c1ca5bf43dff None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:08:44.708076 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d69369-87d8-447d-b54f-c1ca5bf43dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:08:44.728724 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-d7d69369-87d8-447d-b54f-c1ca5bf43dff None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:08:44.730026 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-d7d69369-87d8-447d-b54f-c1ca5bf43dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:08:44.737793 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 606/1215] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 13 11:08:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:08:45.041013 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b224c43-ad21-4e3b-acb3-f7628ad16f0f None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:08:45.042723 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-4b224c43-ad21-4e3b-acb3-f7628ad16f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:08:45.055793 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b224c43-ad21-4e3b-acb3-f7628ad16f0f None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:08:45.059299 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6de21d-59c3-4ee5-bcb7-046f914600d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f4c2fc51f54f0e977648b13efaed1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:08:45.059884 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6de21d-59c3-4ee5-bcb7-046f914600d5 service cinder] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:08:45.060162 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6de21d-59c3-4ee5-bcb7-046f914600d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:08:45.060431 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6de21d-59c3-4ee5-bcb7-046f914600d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:08:45.069143 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6de21d-59c3-4ee5-bcb7-046f914600d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:08:45.071124 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6de21d-59c3-4ee5-bcb7-046f914600d5 service cinder] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:08:45.080531 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 610/1216] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:08:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:08:54.723002 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=92 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:08:55.076267 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=8 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:11.158291 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58fda72-d16c-400b-9991-b713858da60b None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:11.158933 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58fda72-d16c-400b-9991-b713858da60b None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:11.158933 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58fda72-d16c-400b-9991-b713858da60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:11.187221 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-b58fda72-d16c-400b-9991-b713858da60b None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:11.188477 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-b58fda72-d16c-400b-9991-b713858da60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:11.200388 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 607/1217] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:11.211120 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826d45f-9fcc-4963-865a-18527720f6f6 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:11.211724 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826d45f-9fcc-4963-865a-18527720f6f6 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:11.211724 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826d45f-9fcc-4963-865a-18527720f6f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:11.243521 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-b826d45f-9fcc-4963-865a-18527720f6f6 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:11.244775 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-b826d45f-9fcc-4963-865a-18527720f6f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:11.253796 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 611/1218] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:11.259286 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58fda72-d16c-400b-9991-b713858da60b None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:11.276474 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58fda72-d16c-400b-9991-b713858da60b None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:11.284993 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3ecc98-737c-49c4-b823-c0c21b2d1af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:11.285636 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ecc98-737c-49c4-b823-c0c21b2d1af5 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:11.285915 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ecc98-737c-49c4-b823-c0c21b2d1af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:11.286224 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ecc98-737c-49c4-b823-c0c21b2d1af5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:11.286903 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3ecc98-737c-49c4-b823-c0c21b2d1af5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:10:11.287933 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3ecc98-737c-49c4-b823-c0c21b2d1af5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:11.289009 dv-cinder-861001-1-smb devstack@keystone.service[81550]: WARNING py.warnings [None req-5c3ecc98-737c-49c4-b823-c0c21b2d1af5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 11:10:11.289009 dv-cinder-861001-1-smb devstack@keystone.service[81550]: warnings.warn(msg) Oct 13 11:10:11.289009 dv-cinder-861001-1-smb devstack@keystone.service[81550]: Oct 13 11:10:11.289917 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3ecc98-737c-49c4-b823-c0c21b2d1af5 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:11.310144 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 608/1219] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 11:10:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 11:10:11.319505 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b826d45f-9fcc-4963-865a-18527720f6f6 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:11.331570 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b826d45f-9fcc-4963-865a-18527720f6f6 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:11.339396 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e6d6f-3b50-4115-86b4-04645d51af84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:11.340043 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e6d6f-3b50-4115-86b4-04645d51af84 admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:11.340323 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e6d6f-3b50-4115-86b4-04645d51af84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:11.340595 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e6d6f-3b50-4115-86b4-04645d51af84 admin admin] PATH_INFO: `/v3/projects` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:11.341275 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3e6d6f-3b50-4115-86b4-04645d51af84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:11.342374 dv-cinder-861001-1-smb devstack@keystone.service[81551]: WARNING py.warnings [None req-ed3e6d6f-3b50-4115-86b4-04645d51af84 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 13 11:10:11.342374 dv-cinder-861001-1-smb devstack@keystone.service[81551]: warnings.warn(msg) Oct 13 11:10:11.342374 dv-cinder-861001-1-smb devstack@keystone.service[81551]: Oct 13 11:10:11.343583 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3e6d6f-3b50-4115-86b4-04645d51af84 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:11.406199 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 612/1220] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:10:11 2022] POST /identity/v3/projects => generated 381 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:10:11.410967 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3ecc98-737c-49c4-b823-c0c21b2d1af5 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:11.427758 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3ecc98-737c-49c4-b823-c0c21b2d1af5 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:11.508619 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4cacb6-220f-48ce-800f-025633677dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:11.509247 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4cacb6-220f-48ce-800f-025633677dd9 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:11.509527 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4cacb6-220f-48ce-800f-025633677dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:11.509802 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4cacb6-220f-48ce-800f-025633677dd9 admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:11.516535 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4cacb6-220f-48ce-800f-025633677dd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:11.516535 dv-cinder-861001-1-smb devstack@keystone.service[81550]: WARNING py.warnings [None req-3d4cacb6-220f-48ce-800f-025633677dd9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 13 11:10:11.516535 dv-cinder-861001-1-smb devstack@keystone.service[81550]: warnings.warn(msg) Oct 13 11:10:11.516535 dv-cinder-861001-1-smb devstack@keystone.service[81550]: Oct 13 11:10:11.516535 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4cacb6-220f-48ce-800f-025633677dd9 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:11.544458 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 609/1221] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:10:11 2022] POST /identity/v3/users => generated 291 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:10:11.548541 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e6d6f-3b50-4115-86b4-04645d51af84 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:11.570491 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e6d6f-3b50-4115-86b4-04645d51af84 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:11.576874 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a82f663-a175-42a2-92e5-7bcd8ca26373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:11.577559 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a82f663-a175-42a2-92e5-7bcd8ca26373 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:11.577835 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a82f663-a175-42a2-92e5-7bcd8ca26373 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:11.578336 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a82f663-a175-42a2-92e5-7bcd8ca26373 admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:11.579011 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a82f663-a175-42a2-92e5-7bcd8ca26373 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:11.585387 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a82f663-a175-42a2-92e5-7bcd8ca26373 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:11.596839 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 613/1222] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:10:11.600917 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4cacb6-220f-48ce-800f-025633677dd9 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:11.612845 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4cacb6-220f-48ce-800f-025633677dd9 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:11.624101 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941efbdb-8c03-47a2-b75f-44980bb149dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:11.624733 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941efbdb-8c03-47a2-b75f-44980bb149dc admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:11.625017 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941efbdb-8c03-47a2-b75f-44980bb149dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:11.625293 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941efbdb-8c03-47a2-b75f-44980bb149dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:11.625980 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941efbdb-8c03-47a2-b75f-44980bb149dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:11.627571 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941efbdb-8c03-47a2-b75f-44980bb149dc admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:11.643334 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 610/1223] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:10:11.648136 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a82f663-a175-42a2-92e5-7bcd8ca26373 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:11.655140 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21deb997-1fa2-46e9-b338-edc5a3f5f231 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:11.655432 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21deb997-1fa2-46e9-b338-edc5a3f5f231 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:11.655707 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21deb997-1fa2-46e9-b338-edc5a3f5f231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:11.661637 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a82f663-a175-42a2-92e5-7bcd8ca26373 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:11.673615 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f223a0d6-ce07-4f70-ba33-1bb975077b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:11.674314 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f223a0d6-ce07-4f70-ba33-1bb975077b67 admin admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:11.674594 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f223a0d6-ce07-4f70-ba33-1bb975077b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:11.674865 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f223a0d6-ce07-4f70-ba33-1bb975077b67 admin admin] PATH_INFO: `/v3/projects/e522f7d57d4f48059325b3607bb05756/users/4dfff6f5944c4c76a3bf26368580af64/roles/7c3871c0ab68438b9014489d50b53a22` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:11.686031 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-21deb997-1fa2-46e9-b338-edc5a3f5f231 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:11.687269 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-21deb997-1fa2-46e9-b338-edc5a3f5f231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:11.696377 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f223a0d6-ce07-4f70-ba33-1bb975077b67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e522f7d57d4f48059325b3607bb05756, user_id=4dfff6f5944c4c76a3bf26368580af64, role_id=7c3871c0ab68438b9014489d50b53a22)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:11.702703 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 611/1224] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 11:10:11.703218 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f223a0d6-ce07-4f70-ba33-1bb975077b67 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:11.703789 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e44e6-9194-45ef-9a10-a1e6e719900f None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:11.704064 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e44e6-9194-45ef-9a10-a1e6e719900f None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:11.704335 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e44e6-9194-45ef-9a10-a1e6e719900f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:11.723520 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 614/1225] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:10:11 2022] PUT /identity/v3/projects/e522f7d57d4f48059325b3607bb05756/users/4dfff6f5944c4c76a3bf26368580af64/roles/7c3871c0ab68438b9014489d50b53a22 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:10:11.724896 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f19d3-52d4-4be7-b762-e8c2e282ef2c None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:11.725180 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f19d3-52d4-4be7-b762-e8c2e282ef2c None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:11.725460 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f19d3-52d4-4be7-b762-e8c2e282ef2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:11.740012 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-d29e44e6-9194-45ef-9a10-a1e6e719900f None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:11.741749 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-d29e44e6-9194-45ef-9a10-a1e6e719900f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:11.761157 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-154f19d3-52d4-4be7-b762-e8c2e282ef2c None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:11.762384 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-154f19d3-52d4-4be7-b762-e8c2e282ef2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:11.832206 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 612/1226] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:11.833523 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba4d35-25c9-4d94-96fb-c50bbc3a07b6 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:11.833810 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba4d35-25c9-4d94-96fb-c50bbc3a07b6 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:11.834136 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba4d35-25c9-4d94-96fb-c50bbc3a07b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:11.835220 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 615/1227] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:11.836323 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187f813-0466-4021-a95b-f54287a196e8 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:11.836608 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187f813-0466-4021-a95b-f54287a196e8 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:11.836880 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187f813-0466-4021-a95b-f54287a196e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:11.856091 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-d187f813-0466-4021-a95b-f54287a196e8 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:11.857036 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-b7ba4d35-25c9-4d94-96fb-c50bbc3a07b6 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:11.857293 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-d187f813-0466-4021-a95b-f54287a196e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:11.858231 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-b7ba4d35-25c9-4d94-96fb-c50bbc3a07b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:11.865164 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 616/1228] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:11.866854 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed23a51-a14a-4eda-a360-4db822735f0e None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:11.867207 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 613/1229] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:11.867333 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed23a51-a14a-4eda-a360-4db822735f0e None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:11.867440 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed23a51-a14a-4eda-a360-4db822735f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:11.868344 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d514649-3a08-4ca1-a894-8678dd433159 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:11.868635 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d514649-3a08-4ca1-a894-8678dd433159 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:11.868913 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d514649-3a08-4ca1-a894-8678dd433159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:11.895864 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-9d514649-3a08-4ca1-a894-8678dd433159 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:11.896919 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-9ed23a51-a14a-4eda-a360-4db822735f0e None None] MFA Rules not processed for user `4dfff6f5944c4c76a3bf26368580af64`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:11.897123 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-9d514649-3a08-4ca1-a894-8678dd433159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:11.898132 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-9ed23a51-a14a-4eda-a360-4db822735f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:11.905028 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 614/1230] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:11.906244 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467ebe4-f825-436e-9b7a-f66b95c7e0a3 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:11.906528 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467ebe4-f825-436e-9b7a-f66b95c7e0a3 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:11.906797 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467ebe4-f825-436e-9b7a-f66b95c7e0a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:11.925522 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-e467ebe4-f825-436e-9b7a-f66b95c7e0a3 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:11.926733 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-e467ebe4-f825-436e-9b7a-f66b95c7e0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:11.935128 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 615/1231] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:11.936613 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ddbe5-2bfb-40ce-bb6b-75f8b50fe39d None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:11.936996 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ddbe5-2bfb-40ce-bb6b-75f8b50fe39d None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:11.937369 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ddbe5-2bfb-40ce-bb6b-75f8b50fe39d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:11.960108 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-8d1ddbe5-2bfb-40ce-bb6b-75f8b50fe39d None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:11.961307 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-8d1ddbe5-2bfb-40ce-bb6b-75f8b50fe39d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:11.962197 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 617/1232] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:11.965613 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdbf6f9-e9ba-464d-8c9d-95de94205e9c None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:11.965613 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdbf6f9-e9ba-464d-8c9d-95de94205e9c None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:11.965613 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdbf6f9-e9ba-464d-8c9d-95de94205e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:11.972808 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 616/1233] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:11.973205 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64d20e-f8e6-43c3-8080-c2e897a7469c None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:11.973490 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64d20e-f8e6-43c3-8080-c2e897a7469c None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:11.973764 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64d20e-f8e6-43c3-8080-c2e897a7469c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:11.984923 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-acdbf6f9-e9ba-464d-8c9d-95de94205e9c None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:11.986171 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-acdbf6f9-e9ba-464d-8c9d-95de94205e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:11.993682 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-6a64d20e-f8e6-43c3-8080-c2e897a7469c None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:11.994562 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 618/1234] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:11.995034 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-6a64d20e-f8e6-43c3-8080-c2e897a7469c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:11.995993 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdbf6f9-e9ba-464d-8c9d-95de94205e9c None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:12.002135 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:12.003452 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 617/1235] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:12.004855 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c577f-25b4-4297-b1c9-791284cf8e55 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:12.005208 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c577f-25b4-4297-b1c9-791284cf8e55 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:12.005532 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c577f-25b4-4297-b1c9-791284cf8e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:12.006504 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdbf6f9-e9ba-464d-8c9d-95de94205e9c None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:12.012646 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b66f4b8-2a7a-4405-a5f9-e2ce1dda55b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:12.013271 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b66f4b8-2a7a-4405-a5f9-e2ce1dda55b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:12.013742 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b66f4b8-2a7a-4405-a5f9-e2ce1dda55b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:12.014045 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b66f4b8-2a7a-4405-a5f9-e2ce1dda55b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:12.014707 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b66f4b8-2a7a-4405-a5f9-e2ce1dda55b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:10:12.015014 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b66f4b8-2a7a-4405-a5f9-e2ce1dda55b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:12.016612 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b66f4b8-2a7a-4405-a5f9-e2ce1dda55b9 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:12.025588 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-9d2c577f-25b4-4297-b1c9-791284cf8e55 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:12.026821 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-9d2c577f-25b4-4297-b1c9-791284cf8e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:12.028522 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 619/1236] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 11:10:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:10:12.039525 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb553b-012e-4570-9bd1-1aab98582e7a None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:12.039525 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb553b-012e-4570-9bd1-1aab98582e7a None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:12.039525 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb553b-012e-4570-9bd1-1aab98582e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:12.039811 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 618/1237] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:12.039811 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b64deeb-bd0f-4a3f-9f29-30d0493569e4 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:12.039811 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b64deeb-bd0f-4a3f-9f29-30d0493569e4 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:12.039811 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b64deeb-bd0f-4a3f-9f29-30d0493569e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:12.050453 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-b3eb553b-012e-4570-9bd1-1aab98582e7a None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:12.051660 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-b3eb553b-012e-4570-9bd1-1aab98582e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:12.056066 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-8b64deeb-bd0f-4a3f-9f29-30d0493569e4 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:12.057262 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-8b64deeb-bd0f-4a3f-9f29-30d0493569e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:12.059794 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 620/1238] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:12.060626 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb553b-012e-4570-9bd1-1aab98582e7a None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:12.065880 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 619/1239] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:12.067205 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fe8a86-975e-4c8f-bbab-b41276b94056 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:12.067486 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fe8a86-975e-4c8f-bbab-b41276b94056 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:12.067763 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fe8a86-975e-4c8f-bbab-b41276b94056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:12.071064 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb553b-012e-4570-9bd1-1aab98582e7a None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:12.075773 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb39489-6a8b-40be-87c3-a12959b163fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:12.076355 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb39489-6a8b-40be-87c3-a12959b163fa admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:12.076665 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb39489-6a8b-40be-87c3-a12959b163fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:12.076938 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb39489-6a8b-40be-87c3-a12959b163fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:12.077578 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb39489-6a8b-40be-87c3-a12959b163fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:12.079483 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb39489-6a8b-40be-87c3-a12959b163fa admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:12.082193 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:12.088997 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-a3fe8a86-975e-4c8f-bbab-b41276b94056 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:12.090750 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-a3fe8a86-975e-4c8f-bbab-b41276b94056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:12.099238 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 620/1240] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:12.100334 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fe8a86-975e-4c8f-bbab-b41276b94056 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:12.110339 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fe8a86-975e-4c8f-bbab-b41276b94056 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:12.114144 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 621/1241] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:10:12 2022] POST /identity/v3/projects => generated 379 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:10:12.114144 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb39489-6a8b-40be-87c3-a12959b163fa admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:12.168629 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a74ecc-1739-489f-aaad-0590019ee791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:12.169334 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a74ecc-1739-489f-aaad-0590019ee791 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:12.169683 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a74ecc-1739-489f-aaad-0590019ee791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:12.170049 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a74ecc-1739-489f-aaad-0590019ee791 admin admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:12.170763 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a74ecc-1739-489f-aaad-0590019ee791 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:10:12.171140 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a74ecc-1739-489f-aaad-0590019ee791 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:12.172729 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a74ecc-1739-489f-aaad-0590019ee791 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:12.176219 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb39489-6a8b-40be-87c3-a12959b163fa admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:12.180838 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d7e9cd-b4bd-4b05-99f3-3095e8e5370d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:12.181447 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d7e9cd-b4bd-4b05-99f3-3095e8e5370d admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:12.181728 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d7e9cd-b4bd-4b05-99f3-3095e8e5370d admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:12.182048 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d7e9cd-b4bd-4b05-99f3-3095e8e5370d admin admin] PATH_INFO: `/v3/domains` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:12.182699 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d7e9cd-b4bd-4b05-99f3-3095e8e5370d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:10:12.183004 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d7e9cd-b4bd-4b05-99f3-3095e8e5370d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:12.184011 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 621/1242] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 11:10:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:10:12.184588 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d7e9cd-b4bd-4b05-99f3-3095e8e5370d admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:12.184780 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a74ecc-1739-489f-aaad-0590019ee791 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:12.196955 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 622/1243] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 11:10:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:10:12.197826 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d7e9cd-b4bd-4b05-99f3-3095e8e5370d admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:12.206888 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a74ecc-1739-489f-aaad-0590019ee791 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:12.207303 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d7e9cd-b4bd-4b05-99f3-3095e8e5370d admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:12.212107 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f5b7e7-cd62-4c22-85df-84d27440d503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:12.212469 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad2d75f-78f4-4cbe-9817-e37be57cec2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:12.212971 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5b7e7-cd62-4c22-85df-84d27440d503 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:12.212971 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5b7e7-cd62-4c22-85df-84d27440d503 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:12.213161 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad2d75f-78f4-4cbe-9817-e37be57cec2b admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:12.213264 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5b7e7-cd62-4c22-85df-84d27440d503 admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:12.213362 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad2d75f-78f4-4cbe-9817-e37be57cec2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:12.213571 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad2d75f-78f4-4cbe-9817-e37be57cec2b admin admin] PATH_INFO: `/v3/domains` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:12.213839 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f5b7e7-cd62-4c22-85df-84d27440d503 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:12.214238 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad2d75f-78f4-4cbe-9817-e37be57cec2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:10:12.214544 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad2d75f-78f4-4cbe-9817-e37be57cec2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:12.215911 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f5b7e7-cd62-4c22-85df-84d27440d503 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:12.216102 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad2d75f-78f4-4cbe-9817-e37be57cec2b admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:12.234995 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 623/1244] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 11:10:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:10:12.234995 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad2d75f-78f4-4cbe-9817-e37be57cec2b admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:12.238514 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad2d75f-78f4-4cbe-9817-e37be57cec2b admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:12.243492 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab98830-ea5d-4ede-9051-a22a96babd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:12.244120 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab98830-ea5d-4ede-9051-a22a96babd24 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:12.244413 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab98830-ea5d-4ede-9051-a22a96babd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:12.244690 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab98830-ea5d-4ede-9051-a22a96babd24 admin admin] PATH_INFO: `/v3/domains` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:12.245331 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab98830-ea5d-4ede-9051-a22a96babd24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:10:12.245638 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab98830-ea5d-4ede-9051-a22a96babd24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:12.250128 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 622/1245] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:10:12 2022] POST /identity/v3/projects => generated 373 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:10:12.250280 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab98830-ea5d-4ede-9051-a22a96babd24 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:12.250375 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f5b7e7-cd62-4c22-85df-84d27440d503 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:12.260356 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 624/1246] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 11:10:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:10:12.261053 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab98830-ea5d-4ede-9051-a22a96babd24 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:12.271212 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab98830-ea5d-4ede-9051-a22a96babd24 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:12.308339 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f5b7e7-cd62-4c22-85df-84d27440d503 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:12.312965 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef0c73-3b01-4fd5-8f3a-f10d8b1ef536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:12.313575 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef0c73-3b01-4fd5-8f3a-f10d8b1ef536 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:12.313857 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef0c73-3b01-4fd5-8f3a-f10d8b1ef536 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:12.314163 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef0c73-3b01-4fd5-8f3a-f10d8b1ef536 admin admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:12.314817 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ef0c73-3b01-4fd5-8f3a-f10d8b1ef536 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:10:12.315154 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ef0c73-3b01-4fd5-8f3a-f10d8b1ef536 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:12.316750 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ef0c73-3b01-4fd5-8f3a-f10d8b1ef536 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:12.327545 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8e38ba-21f1-448d-b54a-17dc6e671cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:12.328141 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e38ba-21f1-448d-b54a-17dc6e671cd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:12.328418 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e38ba-21f1-448d-b54a-17dc6e671cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:12.328527 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 623/1247] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 11:10:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:10:12.329413 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef0c73-3b01-4fd5-8f3a-f10d8b1ef536 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:12.330192 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e38ba-21f1-448d-b54a-17dc6e671cd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:12.330946 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8e38ba-21f1-448d-b54a-17dc6e671cd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:10:12.331329 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8e38ba-21f1-448d-b54a-17dc6e671cd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:12.332979 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8e38ba-21f1-448d-b54a-17dc6e671cd8 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:12.339776 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef0c73-3b01-4fd5-8f3a-f10d8b1ef536 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:12.344369 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c467f2d9-0eb4-4f84-8f60-ed548cab24f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:12.344982 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c467f2d9-0eb4-4f84-8f60-ed548cab24f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:12.345262 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c467f2d9-0eb4-4f84-8f60-ed548cab24f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:12.345538 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c467f2d9-0eb4-4f84-8f60-ed548cab24f0 admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:12.345895 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 625/1248] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 11:10:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:10:12.346308 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c467f2d9-0eb4-4f84-8f60-ed548cab24f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:12.348275 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c467f2d9-0eb4-4f84-8f60-ed548cab24f0 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:12.353524 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8e38ba-21f1-448d-b54a-17dc6e671cd8 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:12.364672 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8e38ba-21f1-448d-b54a-17dc6e671cd8 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:12.369736 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e2579-57f6-4482-8fbe-4824dcda66a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:12.370361 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e2579-57f6-4482-8fbe-4824dcda66a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:12.370466 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 624/1249] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:10:12 2022] POST /identity/v3/users => generated 296 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:10:12.371174 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c467f2d9-0eb4-4f84-8f60-ed548cab24f0 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:12.373847 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e2579-57f6-4482-8fbe-4824dcda66a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:12.374284 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e2579-57f6-4482-8fbe-4824dcda66a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:12.374942 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9e2579-57f6-4482-8fbe-4824dcda66a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:12.377616 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9e2579-57f6-4482-8fbe-4824dcda66a5 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:12.380728 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c467f2d9-0eb4-4f84-8f60-ed548cab24f0 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:12.385854 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655cea86-6e44-4146-abf3-1e81268241b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:12.386469 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655cea86-6e44-4146-abf3-1e81268241b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:12.386754 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655cea86-6e44-4146-abf3-1e81268241b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:12.387032 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655cea86-6e44-4146-abf3-1e81268241b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:12.387651 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655cea86-6e44-4146-abf3-1e81268241b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:12.389571 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655cea86-6e44-4146-abf3-1e81268241b0 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:12.406333 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 626/1250] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:10:12 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:10:12.407111 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e2579-57f6-4482-8fbe-4824dcda66a5 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:12.412223 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:12.424184 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 625/1251] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:10:12 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:10:12.424184 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655cea86-6e44-4146-abf3-1e81268241b0 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:12.452065 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:12.475285 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e2579-57f6-4482-8fbe-4824dcda66a5 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:12.484077 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655cea86-6e44-4146-abf3-1e81268241b0 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:12.488721 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb697257-0a1f-429c-815b-8079143f8976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:12.489317 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb697257-0a1f-429c-815b-8079143f8976 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:12.489595 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb697257-0a1f-429c-815b-8079143f8976 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:12.489865 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb697257-0a1f-429c-815b-8079143f8976 admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:12.491020 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb697257-0a1f-429c-815b-8079143f8976 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:12.492920 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb697257-0a1f-429c-815b-8079143f8976 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:12.515000 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 626/1252] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:10:12 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:10:12.515781 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb697257-0a1f-429c-815b-8079143f8976 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:12.526780 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb697257-0a1f-429c-815b-8079143f8976 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:12.531713 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a119428-0c5f-47cb-9e47-0d85bf2e04eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:12.532422 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a119428-0c5f-47cb-9e47-0d85bf2e04eb admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:12.532709 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a119428-0c5f-47cb-9e47-0d85bf2e04eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:12.532990 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a119428-0c5f-47cb-9e47-0d85bf2e04eb admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:12.533613 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a119428-0c5f-47cb-9e47-0d85bf2e04eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:12.534498 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93c8891-83e6-4490-a2f8-a2fd8d612bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:12.535109 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93c8891-83e6-4490-a2f8-a2fd8d612bdc admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:12.535390 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93c8891-83e6-4490-a2f8-a2fd8d612bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:12.535546 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a119428-0c5f-47cb-9e47-0d85bf2e04eb admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:12.535656 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93c8891-83e6-4490-a2f8-a2fd8d612bdc admin admin] PATH_INFO: `/v3/projects` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:12.536285 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93c8891-83e6-4490-a2f8-a2fd8d612bdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:12.538243 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93c8891-83e6-4490-a2f8-a2fd8d612bdc admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:12.564379 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 627/1253] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:10:12 2022] POST /identity/v3/projects => generated 389 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:10:12.565045 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a119428-0c5f-47cb-9e47-0d85bf2e04eb admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:12.571224 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 627/1254] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:10:12 2022] POST /identity/v3/projects => generated 367 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:10:12.571224 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93c8891-83e6-4490-a2f8-a2fd8d612bdc admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:12.629909 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a119428-0c5f-47cb-9e47-0d85bf2e04eb admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:12.633782 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93c8891-83e6-4490-a2f8-a2fd8d612bdc admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:12.635179 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582882ac-d66d-46a2-ac7a-95ff50366693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:12.635788 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582882ac-d66d-46a2-ac7a-95ff50366693 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:12.636079 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582882ac-d66d-46a2-ac7a-95ff50366693 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:12.636349 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582882ac-d66d-46a2-ac7a-95ff50366693 admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:12.636977 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582882ac-d66d-46a2-ac7a-95ff50366693 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:12.638680 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f945d5f8-ed34-4f13-9aca-f108741f99c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:12.638918 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582882ac-d66d-46a2-ac7a-95ff50366693 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:12.639277 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945d5f8-ed34-4f13-9aca-f108741f99c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:12.639560 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945d5f8-ed34-4f13-9aca-f108741f99c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:12.639832 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945d5f8-ed34-4f13-9aca-f108741f99c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:12.640494 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f945d5f8-ed34-4f13-9aca-f108741f99c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:12.642409 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f945d5f8-ed34-4f13-9aca-f108741f99c0 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:12.669934 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 628/1255] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:10:12 2022] POST /identity/v3/projects => generated 379 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:10:12.669934 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582882ac-d66d-46a2-ac7a-95ff50366693 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:12.675289 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 628/1256] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:10:12 2022] POST /identity/v3/projects => generated 391 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:10:12.675289 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f945d5f8-ed34-4f13-9aca-f108741f99c0 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:12.694238 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:12.733804 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582882ac-d66d-46a2-ac7a-95ff50366693 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:12.735994 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f945d5f8-ed34-4f13-9aca-f108741f99c0 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:12.738398 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4abfb7-3470-43b1-b33e-04aa8958a45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:12.738999 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4abfb7-3470-43b1-b33e-04aa8958a45e admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:12.739278 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4abfb7-3470-43b1-b33e-04aa8958a45e admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:12.739553 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4abfb7-3470-43b1-b33e-04aa8958a45e admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:12.740700 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4abfb7-3470-43b1-b33e-04aa8958a45e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:12.741129 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca86347-972c-48f1-b7a1-c066a804e15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:12.741733 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca86347-972c-48f1-b7a1-c066a804e15f admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:12.742042 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca86347-972c-48f1-b7a1-c066a804e15f admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:12.742315 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca86347-972c-48f1-b7a1-c066a804e15f admin admin] PATH_INFO: `/v3/users` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:12.742409 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4abfb7-3470-43b1-b33e-04aa8958a45e admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:12.742943 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca86347-972c-48f1-b7a1-c066a804e15f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:12.744839 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca86347-972c-48f1-b7a1-c066a804e15f admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:12.752243 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 629/1257] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:10:12.754240 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4abfb7-3470-43b1-b33e-04aa8958a45e admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:12.770160 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 629/1258] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:10:12 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:10:12.770160 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca86347-972c-48f1-b7a1-c066a804e15f admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:12.770417 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4abfb7-3470-43b1-b33e-04aa8958a45e admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:12.773176 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892a8b35-cd16-4575-802e-df0e031f1720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:12.773772 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a8b35-cd16-4575-802e-df0e031f1720 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:12.774606 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a8b35-cd16-4575-802e-df0e031f1720 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:12.774883 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a8b35-cd16-4575-802e-df0e031f1720 admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:12.775648 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892a8b35-cd16-4575-802e-df0e031f1720 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:12.777539 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892a8b35-cd16-4575-802e-df0e031f1720 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:12.777708 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca86347-972c-48f1-b7a1-c066a804e15f admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:12.782533 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f08389-10c5-4650-9e2d-6263e2670efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:12.783120 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f08389-10c5-4650-9e2d-6263e2670efa admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:12.783400 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f08389-10c5-4650-9e2d-6263e2670efa admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:12.783671 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f08389-10c5-4650-9e2d-6263e2670efa admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:12.784313 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f08389-10c5-4650-9e2d-6263e2670efa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:12.785917 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f08389-10c5-4650-9e2d-6263e2670efa admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:12.793435 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:12.797926 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 630/1259] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:10:12.799376 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f08389-10c5-4650-9e2d-6263e2670efa admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:12.809457 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 630/1260] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:10:12 2022] POST /identity/v3/users => generated 287 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:10:12.810540 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892a8b35-cd16-4575-802e-df0e031f1720 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:12.814843 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f08389-10c5-4650-9e2d-6263e2670efa admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:12.819501 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2394ff0-9aa0-4a64-84c5-e3e014fcb753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:12.820104 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2394ff0-9aa0-4a64-84c5-e3e014fcb753 admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:12.820402 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2394ff0-9aa0-4a64-84c5-e3e014fcb753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:12.820660 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2394ff0-9aa0-4a64-84c5-e3e014fcb753 admin admin] PATH_INFO: `/v3/users` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:12.820894 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892a8b35-cd16-4575-802e-df0e031f1720 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:12.821294 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2394ff0-9aa0-4a64-84c5-e3e014fcb753 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:12.823253 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2394ff0-9aa0-4a64-84c5-e3e014fcb753 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:12.825466 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0993b6-7399-4914-9aeb-b8974a90611d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:12.826086 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0993b6-7399-4914-9aeb-b8974a90611d admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:12.826480 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0993b6-7399-4914-9aeb-b8974a90611d admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:12.826756 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0993b6-7399-4914-9aeb-b8974a90611d admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:12.827370 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0993b6-7399-4914-9aeb-b8974a90611d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:12.829253 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0993b6-7399-4914-9aeb-b8974a90611d admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:12.845121 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 631/1261] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:10:12 2022] POST /identity/v3/users => generated 295 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:10:12.846014 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2394ff0-9aa0-4a64-84c5-e3e014fcb753 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:12.850698 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 631/1262] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:10:12 2022] POST /identity/v3/users => generated 284 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:10:12.851455 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0993b6-7399-4914-9aeb-b8974a90611d admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:12.858323 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2394ff0-9aa0-4a64-84c5-e3e014fcb753 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:12.860584 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0993b6-7399-4914-9aeb-b8974a90611d admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:12.863208 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd83342-d8ff-47b5-922a-7fca8e3310e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:12.863806 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd83342-d8ff-47b5-922a-7fca8e3310e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:12.864138 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd83342-d8ff-47b5-922a-7fca8e3310e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:12.864414 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd83342-d8ff-47b5-922a-7fca8e3310e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:12.865067 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd83342-d8ff-47b5-922a-7fca8e3310e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:12.865253 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b593ffb7-b0bf-46d2-9ebe-a40841817def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:12.865807 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593ffb7-b0bf-46d2-9ebe-a40841817def admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:12.866110 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593ffb7-b0bf-46d2-9ebe-a40841817def admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:12.866378 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593ffb7-b0bf-46d2-9ebe-a40841817def admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:12.866977 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b593ffb7-b0bf-46d2-9ebe-a40841817def admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:12.867151 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd83342-d8ff-47b5-922a-7fca8e3310e1 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:12.868826 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b593ffb7-b0bf-46d2-9ebe-a40841817def admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:12.891181 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 632/1263] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:10:12 2022] POST /identity/v3/users => generated 290 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:10:12.892276 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd83342-d8ff-47b5-922a-7fca8e3310e1 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:12.895347 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 632/1264] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:10:12 2022] POST /identity/v3/users => generated 296 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:10:12.896280 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b593ffb7-b0bf-46d2-9ebe-a40841817def admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:12.903300 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd83342-d8ff-47b5-922a-7fca8e3310e1 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:12.907218 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b593ffb7-b0bf-46d2-9ebe-a40841817def admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:12.907855 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cd1f45-eb5b-4f13-b8c9-3996b5dc3115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:12.908492 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cd1f45-eb5b-4f13-b8c9-3996b5dc3115 admin admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:12.908767 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cd1f45-eb5b-4f13-b8c9-3996b5dc3115 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:12.909040 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cd1f45-eb5b-4f13-b8c9-3996b5dc3115 admin admin] PATH_INFO: `/v3/projects/0576ca0aded64e92ac2367e48eb013f5/users/40cee429ccf740e38ee817309fc5ec01/roles/ea564961b1db4eb4a1d4d880964611b2` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:12.911840 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0242b7f1-708d-49b9-a94b-a8b4aacb01c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:12.912454 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0242b7f1-708d-49b9-a94b-a8b4aacb01c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:12.912741 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0242b7f1-708d-49b9-a94b-a8b4aacb01c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:12.913061 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0242b7f1-708d-49b9-a94b-a8b4aacb01c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:12.913703 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0242b7f1-708d-49b9-a94b-a8b4aacb01c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:12.915315 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0242b7f1-708d-49b9-a94b-a8b4aacb01c8 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:12.923137 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cd1f45-eb5b-4f13-b8c9-3996b5dc3115 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0576ca0aded64e92ac2367e48eb013f5, user_id=40cee429ccf740e38ee817309fc5ec01, role_id=ea564961b1db4eb4a1d4d880964611b2)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:12.925287 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 633/1265] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:10:12.925755 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cd1f45-eb5b-4f13-b8c9-3996b5dc3115 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:12.926172 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0242b7f1-708d-49b9-a94b-a8b4aacb01c8 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:12.936464 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0242b7f1-708d-49b9-a94b-a8b4aacb01c8 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:12.939629 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 633/1266] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:10:12 2022] PUT /identity/v3/projects/0576ca0aded64e92ac2367e48eb013f5/users/40cee429ccf740e38ee817309fc5ec01/roles/ea564961b1db4eb4a1d4d880964611b2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:10:12.940696 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cd1f45-eb5b-4f13-b8c9-3996b5dc3115 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:12.993198 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd340d61-e714-4f57-a231-4686f3c1d5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:12.993717 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd340d61-e714-4f57-a231-4686f3c1d5ec admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:12.994024 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd340d61-e714-4f57-a231-4686f3c1d5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:12.994300 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd340d61-e714-4f57-a231-4686f3c1d5ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:12.994929 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd340d61-e714-4f57-a231-4686f3c1d5ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:12.996756 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd340d61-e714-4f57-a231-4686f3c1d5ec admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:13.002719 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cd1f45-eb5b-4f13-b8c9-3996b5dc3115 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:13.006964 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 634/1267] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:10:13.007763 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd340d61-e714-4f57-a231-4686f3c1d5ec admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:13.008469 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09be65df-66f1-4eb6-8f42-516731baa2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:13.009085 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be65df-66f1-4eb6-8f42-516731baa2d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:13.009369 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be65df-66f1-4eb6-8f42-516731baa2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:13.009647 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be65df-66f1-4eb6-8f42-516731baa2d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:13.010584 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09be65df-66f1-4eb6-8f42-516731baa2d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:13.012213 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09be65df-66f1-4eb6-8f42-516731baa2d8 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:13.017437 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd340d61-e714-4f57-a231-4686f3c1d5ec admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:13.025560 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 634/1268] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:10:13.025705 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28848bd6-e9fe-45f8-be77-05b2f2b9da58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:13.025705 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28848bd6-e9fe-45f8-be77-05b2f2b9da58 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:13.025884 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09be65df-66f1-4eb6-8f42-516731baa2d8 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:13.026011 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28848bd6-e9fe-45f8-be77-05b2f2b9da58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:13.026011 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28848bd6-e9fe-45f8-be77-05b2f2b9da58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:13.026011 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28848bd6-e9fe-45f8-be77-05b2f2b9da58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:13.026278 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28848bd6-e9fe-45f8-be77-05b2f2b9da58 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:13.033673 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09be65df-66f1-4eb6-8f42-516731baa2d8 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:13.039582 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 635/1269] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:10:13.039582 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28848bd6-e9fe-45f8-be77-05b2f2b9da58 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:13.041632 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d440ec-d6be-4a34-96a4-013e7f7b65ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:13.042259 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d440ec-d6be-4a34-96a4-013e7f7b65ac admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:13.042544 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d440ec-d6be-4a34-96a4-013e7f7b65ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:13.042821 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d440ec-d6be-4a34-96a4-013e7f7b65ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:13.043464 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d440ec-d6be-4a34-96a4-013e7f7b65ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:13.045040 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d440ec-d6be-4a34-96a4-013e7f7b65ac admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:13.046912 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28848bd6-e9fe-45f8-be77-05b2f2b9da58 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:13.051896 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82b5750-9fac-403a-8d2f-16c9072309c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:13.052493 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b5750-9fac-403a-8d2f-16c9072309c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:13.052751 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b5750-9fac-403a-8d2f-16c9072309c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:13.053027 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b5750-9fac-403a-8d2f-16c9072309c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:13.053679 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82b5750-9fac-403a-8d2f-16c9072309c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:13.055333 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 635/1270] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:10:13.055483 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82b5750-9fac-403a-8d2f-16c9072309c0 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:13.058898 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d440ec-d6be-4a34-96a4-013e7f7b65ac admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:13.067769 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 636/1271] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:10:13.067769 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82b5750-9fac-403a-8d2f-16c9072309c0 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:13.069742 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d440ec-d6be-4a34-96a4-013e7f7b65ac admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:13.075692 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce172f5-945a-4c04-817c-d253b3761d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:13.076094 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82b5750-9fac-403a-8d2f-16c9072309c0 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:13.076288 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce172f5-945a-4c04-817c-d253b3761d14 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:13.076593 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce172f5-945a-4c04-817c-d253b3761d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:13.076881 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce172f5-945a-4c04-817c-d253b3761d14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:13.077539 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce172f5-945a-4c04-817c-d253b3761d14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:13.079129 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce172f5-945a-4c04-817c-d253b3761d14 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:13.080907 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54104fdb-b3ad-4207-a817-10d8c97ab2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:13.081834 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54104fdb-b3ad-4207-a817-10d8c97ab2f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:13.082144 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54104fdb-b3ad-4207-a817-10d8c97ab2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:13.082419 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54104fdb-b3ad-4207-a817-10d8c97ab2f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:13.083074 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54104fdb-b3ad-4207-a817-10d8c97ab2f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:13.085284 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54104fdb-b3ad-4207-a817-10d8c97ab2f4 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:13.094416 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 636/1272] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:10:13.094416 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce172f5-945a-4c04-817c-d253b3761d14 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:13.095175 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 637/1273] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:10:13.098388 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54104fdb-b3ad-4207-a817-10d8c97ab2f4 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:13.102407 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce172f5-945a-4c04-817c-d253b3761d14 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:13.105271 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54104fdb-b3ad-4207-a817-10d8c97ab2f4 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:13.107159 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a0b134-e810-44da-8e4c-bf48d0466a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:13.107755 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a0b134-e810-44da-8e4c-bf48d0466a0d admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:13.108037 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a0b134-e810-44da-8e4c-bf48d0466a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:13.108312 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a0b134-e810-44da-8e4c-bf48d0466a0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:13.108947 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a0b134-e810-44da-8e4c-bf48d0466a0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:13.109841 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9d8ca6-dada-4b2e-80e4-b84bc9345fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:13.110498 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d8ca6-dada-4b2e-80e4-b84bc9345fee admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:13.110693 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a0b134-e810-44da-8e4c-bf48d0466a0d admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:13.110801 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d8ca6-dada-4b2e-80e4-b84bc9345fee admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:13.111039 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d8ca6-dada-4b2e-80e4-b84bc9345fee admin admin] PATH_INFO: `/v3/projects/7b8173db049b4a469a60d79c3057d8fe/users/1d0a5a3d9ae74777928373a5961b3297/roles/7c3871c0ab68438b9014489d50b53a22` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:13.120756 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 637/1274] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:10:13.121795 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a0b134-e810-44da-8e4c-bf48d0466a0d admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:13.125537 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9d8ca6-dada-4b2e-80e4-b84bc9345fee admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b8173db049b4a469a60d79c3057d8fe, user_id=1d0a5a3d9ae74777928373a5961b3297, role_id=7c3871c0ab68438b9014489d50b53a22)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:13.127082 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:13.128572 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9d8ca6-dada-4b2e-80e4-b84bc9345fee admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:13.133448 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a0b134-e810-44da-8e4c-bf48d0466a0d admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:13.140405 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2332a950-039d-4674-9b58-eaf7b0076514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:13.141075 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332a950-039d-4674-9b58-eaf7b0076514 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:13.141424 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332a950-039d-4674-9b58-eaf7b0076514 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:13.141768 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332a950-039d-4674-9b58-eaf7b0076514 admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:13.142402 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 638/1275] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:10:13 2022] PUT /identity/v3/projects/7b8173db049b4a469a60d79c3057d8fe/users/1d0a5a3d9ae74777928373a5961b3297/roles/7c3871c0ab68438b9014489d50b53a22 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:10:13.142567 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2332a950-039d-4674-9b58-eaf7b0076514 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:13.143280 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9d8ca6-dada-4b2e-80e4-b84bc9345fee admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:13.144245 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2332a950-039d-4674-9b58-eaf7b0076514 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:13.158351 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 638/1276] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:10:13.158351 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2332a950-039d-4674-9b58-eaf7b0076514 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:13.165575 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2332a950-039d-4674-9b58-eaf7b0076514 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:13.199631 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:13.212584 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9d8ca6-dada-4b2e-80e4-b84bc9345fee admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:13.217339 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f9a6ed-b285-4773-a60b-740ab8b71f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:13.217974 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9a6ed-b285-4773-a60b-740ab8b71f64 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:13.218257 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9a6ed-b285-4773-a60b-740ab8b71f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:13.218532 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9a6ed-b285-4773-a60b-740ab8b71f64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:13.219178 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f9a6ed-b285-4773-a60b-740ab8b71f64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:13.220772 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f9a6ed-b285-4773-a60b-740ab8b71f64 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:13.222446 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21d5d93-e1fe-44bc-8956-4a1c7eb06468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:13.223056 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d5d93-e1fe-44bc-8956-4a1c7eb06468 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:13.223337 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d5d93-e1fe-44bc-8956-4a1c7eb06468 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:13.223613 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d5d93-e1fe-44bc-8956-4a1c7eb06468 admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:13.224255 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21d5d93-e1fe-44bc-8956-4a1c7eb06468 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:13.225899 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21d5d93-e1fe-44bc-8956-4a1c7eb06468 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:13.231836 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 639/1277] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:10:13.233237 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f9a6ed-b285-4773-a60b-740ab8b71f64 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:13.235951 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 639/1278] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:10:13.236778 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21d5d93-e1fe-44bc-8956-4a1c7eb06468 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:13.245070 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f9a6ed-b285-4773-a60b-740ab8b71f64 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:13.247008 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21d5d93-e1fe-44bc-8956-4a1c7eb06468 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:13.249986 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b81329-67dd-4bde-b738-b625dd94ff49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:13.250572 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b81329-67dd-4bde-b738-b625dd94ff49 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:13.250848 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b81329-67dd-4bde-b738-b625dd94ff49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:13.251121 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b81329-67dd-4bde-b738-b625dd94ff49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:13.251556 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb524f51-df11-4028-8e2d-d47ec379d334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:13.251744 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b81329-67dd-4bde-b738-b625dd94ff49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:13.252129 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb524f51-df11-4028-8e2d-d47ec379d334 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:13.252410 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb524f51-df11-4028-8e2d-d47ec379d334 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:13.252685 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb524f51-df11-4028-8e2d-d47ec379d334 admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:13.253320 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb524f51-df11-4028-8e2d-d47ec379d334 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:13.253423 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b81329-67dd-4bde-b738-b625dd94ff49 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:13.254908 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb524f51-df11-4028-8e2d-d47ec379d334 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:13.264525 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 640/1279] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:10:13.265282 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b81329-67dd-4bde-b738-b625dd94ff49 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:13.268022 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 640/1280] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:10:13.268022 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb524f51-df11-4028-8e2d-d47ec379d334 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:13.276695 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb524f51-df11-4028-8e2d-d47ec379d334 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:13.277725 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b81329-67dd-4bde-b738-b625dd94ff49 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:13.281282 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a41fa56-5e4b-4d91-b756-0cb071baf733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:13.281970 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a41fa56-5e4b-4d91-b756-0cb071baf733 admin admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:13.282280 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a41fa56-5e4b-4d91-b756-0cb071baf733 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:13.282506 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a3dbfd-f49f-4173-b6fe-7db9aea9d367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:13.282665 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a41fa56-5e4b-4d91-b756-0cb071baf733 admin admin] PATH_INFO: `/v3/projects/0576ca0aded64e92ac2367e48eb013f5/users/40cee429ccf740e38ee817309fc5ec01/roles/ea564961b1db4eb4a1d4d880964611b2` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:13.283144 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a3dbfd-f49f-4173-b6fe-7db9aea9d367 admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:13.283427 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a3dbfd-f49f-4173-b6fe-7db9aea9d367 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:13.283702 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a3dbfd-f49f-4173-b6fe-7db9aea9d367 admin admin] PATH_INFO: `/v3/projects/c5e6e2487c2446a9a5f49cf49bf29a72/users/79598ed299054f4db683c45ba5820164/roles/7c3871c0ab68438b9014489d50b53a22` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:13.284567 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a41fa56-5e4b-4d91-b756-0cb071baf733 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0576ca0aded64e92ac2367e48eb013f5, user_id=40cee429ccf740e38ee817309fc5ec01, role_id=ea564961b1db4eb4a1d4d880964611b2)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:13.287229 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a41fa56-5e4b-4d91-b756-0cb071baf733 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:13.297176 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 641/1281] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:10:13 2022] PUT /identity/v3/projects/0576ca0aded64e92ac2367e48eb013f5/users/40cee429ccf740e38ee817309fc5ec01/roles/ea564961b1db4eb4a1d4d880964611b2 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:10:13.298325 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a3dbfd-f49f-4173-b6fe-7db9aea9d367 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5e6e2487c2446a9a5f49cf49bf29a72, user_id=79598ed299054f4db683c45ba5820164, role_id=7c3871c0ab68438b9014489d50b53a22)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:13.298435 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6cf2f6-37a8-401b-af77-e28af5986a3c None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:13.298700 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6cf2f6-37a8-401b-af77-e28af5986a3c None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:13.298972 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6cf2f6-37a8-401b-af77-e28af5986a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:13.300950 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a3dbfd-f49f-4173-b6fe-7db9aea9d367 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:13.315760 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 641/1282] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:10:13 2022] PUT /identity/v3/projects/c5e6e2487c2446a9a5f49cf49bf29a72/users/79598ed299054f4db683c45ba5820164/roles/7c3871c0ab68438b9014489d50b53a22 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:10:13.316746 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a3dbfd-f49f-4173-b6fe-7db9aea9d367 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:13.327686 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-4c6cf2f6-37a8-401b-af77-e28af5986a3c None None] MFA Rules not processed for user `1d0a5a3d9ae74777928373a5961b3297`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:13.328910 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-4c6cf2f6-37a8-401b-af77-e28af5986a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:13.384347 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a3dbfd-f49f-4173-b6fe-7db9aea9d367 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:13.389087 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be27e57-23d1-4ef8-9682-4679ce3b0b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:13.389738 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be27e57-23d1-4ef8-9682-4679ce3b0b18 admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:13.390321 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be27e57-23d1-4ef8-9682-4679ce3b0b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:13.390605 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be27e57-23d1-4ef8-9682-4679ce3b0b18 admin admin] PATH_INFO: `/v3/projects/7a9870610ab042aeb2a2247af02c92b0/users/e13f9d5aba0a4a179106517b1337b7f1/roles/7c3871c0ab68438b9014489d50b53a22` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:13.393528 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 642/1283] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:13.394493 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6cf2f6-37a8-401b-af77-e28af5986a3c None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:13.404869 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6cf2f6-37a8-401b-af77-e28af5986a3c None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:13.409072 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be27e57-23d1-4ef8-9682-4679ce3b0b18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a9870610ab042aeb2a2247af02c92b0, user_id=e13f9d5aba0a4a179106517b1337b7f1, role_id=7c3871c0ab68438b9014489d50b53a22)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:13.409713 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e65d7f7-6a63-4589-ad79-322a78acff2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:13.410404 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e65d7f7-6a63-4589-ad79-322a78acff2a admin admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:13.410686 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e65d7f7-6a63-4589-ad79-322a78acff2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:13.410963 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e65d7f7-6a63-4589-ad79-322a78acff2a admin admin] PATH_INFO: `/v3/projects/24eb4bc2c8e448ea91f00e7ac1cd33b5/users/3b8d890413d4480d96ce9c9be80076d7/roles/7c3871c0ab68438b9014489d50b53a22` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:13.411738 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be27e57-23d1-4ef8-9682-4679ce3b0b18 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:13.430035 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 642/1284] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:10:13 2022] PUT /identity/v3/projects/7a9870610ab042aeb2a2247af02c92b0/users/e13f9d5aba0a4a179106517b1337b7f1/roles/7c3871c0ab68438b9014489d50b53a22 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:10:13.431661 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be27e57-23d1-4ef8-9682-4679ce3b0b18 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:13.433657 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e65d7f7-6a63-4589-ad79-322a78acff2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=24eb4bc2c8e448ea91f00e7ac1cd33b5, user_id=3b8d890413d4480d96ce9c9be80076d7, role_id=7c3871c0ab68438b9014489d50b53a22)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:13.437584 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e65d7f7-6a63-4589-ad79-322a78acff2a admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:13.459066 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 643/1285] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:10:13 2022] PUT /identity/v3/projects/24eb4bc2c8e448ea91f00e7ac1cd33b5/users/3b8d890413d4480d96ce9c9be80076d7/roles/7c3871c0ab68438b9014489d50b53a22 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:10:13.459874 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e65d7f7-6a63-4589-ad79-322a78acff2a admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:13.489893 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:13.505880 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be27e57-23d1-4ef8-9682-4679ce3b0b18 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:13.522825 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e65d7f7-6a63-4589-ad79-322a78acff2a admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:13.527568 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8072f9a7-e37b-47d8-a118-f620e141a49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:13.528225 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072f9a7-e37b-47d8-a118-f620e141a49e admin admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:13.528513 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072f9a7-e37b-47d8-a118-f620e141a49e admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:13.528788 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072f9a7-e37b-47d8-a118-f620e141a49e admin admin] PATH_INFO: `/v3/projects/e4fe457bf3f642c7a7f0a3dafde30ce1/users/f441da37833c45cb962821d7caed9690/roles/7c3871c0ab68438b9014489d50b53a22` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:13.543839 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8072f9a7-e37b-47d8-a118-f620e141a49e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4fe457bf3f642c7a7f0a3dafde30ce1, user_id=f441da37833c45cb962821d7caed9690, role_id=7c3871c0ab68438b9014489d50b53a22)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:13.545077 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:13.546638 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8072f9a7-e37b-47d8-a118-f620e141a49e admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:13.559862 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 644/1286] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:10:13 2022] PUT /identity/v3/projects/e4fe457bf3f642c7a7f0a3dafde30ce1/users/f441da37833c45cb962821d7caed9690/roles/7c3871c0ab68438b9014489d50b53a22 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:10:13.560628 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8072f9a7-e37b-47d8-a118-f620e141a49e admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:13.564392 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62eb85f-a127-495b-b021-9658973d3a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:13.565091 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62eb85f-a127-495b-b021-9658973d3a38 admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:13.565375 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62eb85f-a127-495b-b021-9658973d3a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:13.565671 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62eb85f-a127-495b-b021-9658973d3a38 admin admin] PATH_INFO: `/v3/projects/e0064c136a3547feb0d3de8594dd2027/users/23b45ea447ac4bb0b4ea99a7957a974d/roles/7c3871c0ab68438b9014489d50b53a22` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:13.581704 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62eb85f-a127-495b-b021-9658973d3a38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0064c136a3547feb0d3de8594dd2027, user_id=23b45ea447ac4bb0b4ea99a7957a974d, role_id=7c3871c0ab68438b9014489d50b53a22)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:13.584397 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62eb85f-a127-495b-b021-9658973d3a38 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:13.596821 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 643/1287] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:10:13 2022] PUT /identity/v3/projects/e0064c136a3547feb0d3de8594dd2027/users/23b45ea447ac4bb0b4ea99a7957a974d/roles/7c3871c0ab68438b9014489d50b53a22 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:10:13.598049 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef864c9f-bd3f-4778-8225-d32ad1e294bb None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:13.598347 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef864c9f-bd3f-4778-8225-d32ad1e294bb None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:13.598612 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef864c9f-bd3f-4778-8225-d32ad1e294bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:13.627098 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-ef864c9f-bd3f-4778-8225-d32ad1e294bb None None] MFA Rules not processed for user `40cee429ccf740e38ee817309fc5ec01`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:13.628274 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-ef864c9f-bd3f-4778-8225-d32ad1e294bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:13.629721 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8072f9a7-e37b-47d8-a118-f620e141a49e admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:13.684752 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e52be-dbff-4bcd-b97e-d4689c56d418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:13.685556 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e52be-dbff-4bcd-b97e-d4689c56d418 admin admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:13.685930 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e52be-dbff-4bcd-b97e-d4689c56d418 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:13.686322 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e52be-dbff-4bcd-b97e-d4689c56d418 admin admin] PATH_INFO: `/v3/projects/36c3373824594845825502222de2f336/users/1674289511b749d4b23c4441714e437d/roles/7c3871c0ab68438b9014489d50b53a22` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:13.694777 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 644/1288] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:13 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:13.699482 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa0963-98a3-4643-bef0-8f02a5880fea None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:13.699482 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa0963-98a3-4643-bef0-8f02a5880fea None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:13.699482 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa0963-98a3-4643-bef0-8f02a5880fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:13.701022 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096e52be-dbff-4bcd-b97e-d4689c56d418 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36c3373824594845825502222de2f336, user_id=1674289511b749d4b23c4441714e437d, role_id=7c3871c0ab68438b9014489d50b53a22)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:13.703975 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096e52be-dbff-4bcd-b97e-d4689c56d418 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:13.719580 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 645/1289] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:10:13 2022] PUT /identity/v3/projects/36c3373824594845825502222de2f336/users/1674289511b749d4b23c4441714e437d/roles/7c3871c0ab68438b9014489d50b53a22 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:10:13.720837 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4060a05-21d9-4655-817d-870d1776dfc3 None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:13.721128 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4060a05-21d9-4655-817d-870d1776dfc3 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:13.721404 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4060a05-21d9-4655-817d-870d1776dfc3 None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:13.723336 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 646/1290] 10.222.0.25 () {54 vars in 961 bytes} [Thu Oct 13 11:10:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:10:13.725139 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ffdbf-c831-4e33-9216-9e1dbf6c3a56 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:13.725428 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ffdbf-c831-4e33-9216-9e1dbf6c3a56 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:13.725710 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ffdbf-c831-4e33-9216-9e1dbf6c3a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:13.726521 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-34aa0963-98a3-4643-bef0-8f02a5880fea None None] MFA Rules not processed for user `79598ed299054f4db683c45ba5820164`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:13.727777 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-34aa0963-98a3-4643-bef0-8f02a5880fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:13.754465 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-e80ffdbf-c831-4e33-9216-9e1dbf6c3a56 None None] MFA Rules not processed for user `e13f9d5aba0a4a179106517b1337b7f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:13.755687 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-e80ffdbf-c831-4e33-9216-9e1dbf6c3a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:13.784903 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:13.795482 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 645/1291] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:13.799932 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa0c7e-8eb5-4cbb-b948-f8dc32480689 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:13.800381 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa0c7e-8eb5-4cbb-b948-f8dc32480689 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:13.800656 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa0c7e-8eb5-4cbb-b948-f8dc32480689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:13.820470 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-9bfa0c7e-8eb5-4cbb-b948-f8dc32480689 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:13.821676 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-9bfa0c7e-8eb5-4cbb-b948-f8dc32480689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:13.828151 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 647/1292] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:13.829448 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc8238-e295-458e-810a-3e1a793f59ea None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:13.829735 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc8238-e295-458e-810a-3e1a793f59ea None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:13.830053 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc8238-e295-458e-810a-3e1a793f59ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:13.850113 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-e9cc8238-e295-458e-810a-3e1a793f59ea None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:13.851311 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-e9cc8238-e295-458e-810a-3e1a793f59ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:13.856849 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:13.883347 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 646/1293] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:13.884783 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d2587-bd8b-4851-a665-680f53af035e None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:13.885091 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d2587-bd8b-4851-a665-680f53af035e None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:13.885363 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d2587-bd8b-4851-a665-680f53af035e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:13.914481 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-5e2d2587-bd8b-4851-a665-680f53af035e None None] MFA Rules not processed for user `23b45ea447ac4bb0b4ea99a7957a974d`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:13.915725 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-5e2d2587-bd8b-4851-a665-680f53af035e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:13.925663 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 648/1294] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:13.926595 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cc8238-e295-458e-810a-3e1a793f59ea None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:13.980047 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cc8238-e295-458e-810a-3e1a793f59ea None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:13.983696 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 647/1295] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:13.983826 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17333428-c420-4d2d-9963-fa6eaaf6b757 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f4c2fc51f54f0e977648b13efaed1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:13.984432 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17333428-c420-4d2d-9963-fa6eaaf6b757 service cinder] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:13.984711 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17333428-c420-4d2d-9963-fa6eaaf6b757 service cinder] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:13.985005 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17333428-c420-4d2d-9963-fa6eaaf6b757 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:13.985708 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548fa58a-dc0c-4755-a397-033eff257cc7 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:13.986165 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548fa58a-dc0c-4755-a397-033eff257cc7 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:13.986599 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548fa58a-dc0c-4755-a397-033eff257cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:14.004641 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-548fa58a-dc0c-4755-a397-033eff257cc7 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:14.005866 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-548fa58a-dc0c-4755-a397-033eff257cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:14.013307 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 648/1296] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:14.014475 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a11b78-b379-4057-bbf3-cecb24343cbc None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:14.014761 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a11b78-b379-4057-bbf3-cecb24343cbc None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:14.015028 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a11b78-b379-4057-bbf3-cecb24343cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:14.045745 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17333428-c420-4d2d-9963-fa6eaaf6b757 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:14.047072 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17333428-c420-4d2d-9963-fa6eaaf6b757 service cinder] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:14.051316 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-47a11b78-b379-4057-bbf3-cecb24343cbc None None] MFA Rules not processed for user `78384fbffdd346578855e7214b335d8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:14.052507 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-47a11b78-b379-4057-bbf3-cecb24343cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:14.056961 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 649/1297] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:10:13 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:10:14.058207 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff7d95-27f9-4d05-aa39-2fb39f8bdf42 None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:14.058487 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff7d95-27f9-4d05-aa39-2fb39f8bdf42 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:14.058756 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff7d95-27f9-4d05-aa39-2fb39f8bdf42 None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:14.060258 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 650/1298] 10.222.0.25 () {54 vars in 961 bytes} [Thu Oct 13 11:10:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:10:14.060939 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff7d95-27f9-4d05-aa39-2fb39f8bdf42 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:14.074078 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff7d95-27f9-4d05-aa39-2fb39f8bdf42 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:14.078779 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85edeaf4-4192-40a7-bee4-f9eb973d6a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:14.079361 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85edeaf4-4192-40a7-bee4-f9eb973d6a6d admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:14.079643 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85edeaf4-4192-40a7-bee4-f9eb973d6a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:14.079911 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85edeaf4-4192-40a7-bee4-f9eb973d6a6d admin admin] PATH_INFO: `/v3/projects` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:14.080531 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85edeaf4-4192-40a7-bee4-f9eb973d6a6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:14.082452 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85edeaf4-4192-40a7-bee4-f9eb973d6a6d admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:14.110387 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:14.123119 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 651/1299] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:10:14 2022] POST /identity/v3/projects => generated 373 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:10:14.124233 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85edeaf4-4192-40a7-bee4-f9eb973d6a6d admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:14.125118 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 649/1300] 10.222.0.25 () {58 vars in 1058 bytes} [Thu Oct 13 11:10:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:14.126011 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-85edeaf4-4192-40a7-bee4-f9eb973d6a6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:14.126165 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a11b78-b379-4057-bbf3-cecb24343cbc None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:14.127401 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-47a11b78-b379-4057-bbf3-cecb24343cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:14.182539 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:14.189985 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85edeaf4-4192-40a7-bee4-f9eb973d6a6d admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:14.194464 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6073310-c60e-4e7f-ae50-34c553331e1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:14.194622 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a11b78-b379-4057-bbf3-cecb24343cbc None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:14.195071 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6073310-c60e-4e7f-ae50-34c553331e1d service neutron] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:14.195349 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6073310-c60e-4e7f-ae50-34c553331e1d service neutron] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:14.195618 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6073310-c60e-4e7f-ae50-34c553331e1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:14.198375 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010f68f-06f0-4e2a-abd4-98c594cd9676 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:14.199015 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010f68f-06f0-4e2a-abd4-98c594cd9676 service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:14.199290 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010f68f-06f0-4e2a-abd4-98c594cd9676 service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:14.199674 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010f68f-06f0-4e2a-abd4-98c594cd9676 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:14.256718 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6073310-c60e-4e7f-ae50-34c553331e1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:14.258215 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6073310-c60e-4e7f-ae50-34c553331e1d service neutron] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:14.262745 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4010f68f-06f0-4e2a-abd4-98c594cd9676 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:14.264161 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4010f68f-06f0-4e2a-abd4-98c594cd9676 service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:14.267967 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 652/1301] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:10:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:10:14.268576 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6073310-c60e-4e7f-ae50-34c553331e1d service neutron] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:14.274369 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 650/1302] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:10:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:10:14.275595 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010f68f-06f0-4e2a-abd4-98c594cd9676 service neutron] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:14.277920 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6073310-c60e-4e7f-ae50-34c553331e1d service neutron] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:14.282668 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433d92ad-9676-432e-9d12-db947d4b1868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:14.283265 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d92ad-9676-432e-9d12-db947d4b1868 admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:14.283471 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010f68f-06f0-4e2a-abd4-98c594cd9676 service neutron] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:14.283588 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d92ad-9676-432e-9d12-db947d4b1868 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:14.283799 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d92ad-9676-432e-9d12-db947d4b1868 admin admin] PATH_INFO: `/v3/projects` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:14.284425 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433d92ad-9676-432e-9d12-db947d4b1868 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:14.286397 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433d92ad-9676-432e-9d12-db947d4b1868 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:14.287699 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f77e37-756f-4d1d-94e8-2297edc2cce5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:14.288298 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f77e37-756f-4d1d-94e8-2297edc2cce5 service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:14.288565 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f77e37-756f-4d1d-94e8-2297edc2cce5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:14.288832 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f77e37-756f-4d1d-94e8-2297edc2cce5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:14.299013 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f77e37-756f-4d1d-94e8-2297edc2cce5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:14.300519 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f77e37-756f-4d1d-94e8-2297edc2cce5 service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:14.312265 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 651/1303] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:10:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:10:14.314208 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ce737-29bf-434d-b449-13f2038a7663 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:14.314503 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ce737-29bf-434d-b449-13f2038a7663 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:14.314781 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ce737-29bf-434d-b449-13f2038a7663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:14.318549 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 653/1304] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:10:14 2022] POST /identity/v3/projects => generated 367 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:10:14.318747 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433d92ad-9676-432e-9d12-db947d4b1868 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:14.338454 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-265ce737-29bf-434d-b449-13f2038a7663 None None] MFA Rules not processed for user `78384fbffdd346578855e7214b335d8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:14.339815 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-265ce737-29bf-434d-b449-13f2038a7663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:14.392690 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433d92ad-9676-432e-9d12-db947d4b1868 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:14.398424 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce6b865-795d-4a42-ba70-a5cd3e8cd774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:14.399416 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6b865-795d-4a42-ba70-a5cd3e8cd774 admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:14.399792 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6b865-795d-4a42-ba70-a5cd3e8cd774 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:14.400169 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6b865-795d-4a42-ba70-a5cd3e8cd774 admin admin] PATH_INFO: `/v3/users` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:14.400908 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce6b865-795d-4a42-ba70-a5cd3e8cd774 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:14.403644 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce6b865-795d-4a42-ba70-a5cd3e8cd774 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:14.416015 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 652/1305] 10.222.0.25 () {58 vars in 1058 bytes} [Thu Oct 13 11:10:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:14.417284 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265ce737-29bf-434d-b449-13f2038a7663 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:14.432070 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 654/1306] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:10:14 2022] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:10:14.432270 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265ce737-29bf-434d-b449-13f2038a7663 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:14.432438 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce6b865-795d-4a42-ba70-a5cd3e8cd774 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:14.438370 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a08582f-fbf1-4a56-8abb-c3eccff197c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78384fbffdd346578855e7214b335d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:14.439112 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08582f-fbf1-4a56-8abb-c3eccff197c6 service nova] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:14.439483 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08582f-fbf1-4a56-8abb-c3eccff197c6 service nova] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:14.439942 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08582f-fbf1-4a56-8abb-c3eccff197c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:14.452188 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:14.497565 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce6b865-795d-4a42-ba70-a5cd3e8cd774 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:14.501825 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf23c6c-c401-411f-a05b-34b0f5907d00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f4c2fc51f54f0e977648b13efaed1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:14.502498 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf23c6c-c401-411f-a05b-34b0f5907d00 service cinder] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:14.502782 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf23c6c-c401-411f-a05b-34b0f5907d00 service cinder] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:14.503053 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf23c6c-c401-411f-a05b-34b0f5907d00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:14.510056 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a08582f-fbf1-4a56-8abb-c3eccff197c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:14.511712 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a08582f-fbf1-4a56-8abb-c3eccff197c6 service nova] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:14.522356 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 653/1307] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:10:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:10:14.522973 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a08582f-fbf1-4a56-8abb-c3eccff197c6 service nova] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:14.535244 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a08582f-fbf1-4a56-8abb-c3eccff197c6 service nova] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:14.540829 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9919b0db-8291-4171-a31e-4db35c6c640e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:14.541461 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919b0db-8291-4171-a31e-4db35c6c640e admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:14.541743 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919b0db-8291-4171-a31e-4db35c6c640e admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:14.542048 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919b0db-8291-4171-a31e-4db35c6c640e admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:14.542905 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9919b0db-8291-4171-a31e-4db35c6c640e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:14.546259 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9919b0db-8291-4171-a31e-4db35c6c640e admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:14.564268 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:14.576664 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf23c6c-c401-411f-a05b-34b0f5907d00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:14.578883 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf23c6c-c401-411f-a05b-34b0f5907d00 service cinder] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:14.583738 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 654/1308] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:10:14 2022] POST /identity/v3/users => generated 290 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:10:14.585517 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9919b0db-8291-4171-a31e-4db35c6c640e admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:14.590966 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 655/1309] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:10:14 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:10:14.592052 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf23c6c-c401-411f-a05b-34b0f5907d00 service cinder] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:14.603467 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9919b0db-8291-4171-a31e-4db35c6c640e admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:14.605601 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf23c6c-c401-411f-a05b-34b0f5907d00 service cinder] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:14.610917 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699b026f-99ec-49b4-84f0-69898eb23291 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78384fbffdd346578855e7214b335d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:14.611257 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e7d3c2-5f11-4cd2-bee9-120555bb93f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:14.611599 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b026f-99ec-49b4-84f0-69898eb23291 service nova] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:14.611927 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b026f-99ec-49b4-84f0-69898eb23291 service nova] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:14.612288 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b026f-99ec-49b4-84f0-69898eb23291 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:14.612783 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7d3c2-5f11-4cd2-bee9-120555bb93f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:14.613440 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7d3c2-5f11-4cd2-bee9-120555bb93f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:14.613921 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7d3c2-5f11-4cd2-bee9-120555bb93f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:14.614950 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e7d3c2-5f11-4cd2-bee9-120555bb93f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:14.617411 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e7d3c2-5f11-4cd2-bee9-120555bb93f7 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:14.633468 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 656/1310] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:10:14.634460 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e7d3c2-5f11-4cd2-bee9-120555bb93f7 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:14.645041 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e7d3c2-5f11-4cd2-bee9-120555bb93f7 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:14.651120 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bab392-5dbf-4e6a-a6ca-e66d48cb6aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:14.651852 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bab392-5dbf-4e6a-a6ca-e66d48cb6aca admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:14.652234 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bab392-5dbf-4e6a-a6ca-e66d48cb6aca admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:14.652585 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bab392-5dbf-4e6a-a6ca-e66d48cb6aca admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:14.653457 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bab392-5dbf-4e6a-a6ca-e66d48cb6aca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:14.656471 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bab392-5dbf-4e6a-a6ca-e66d48cb6aca admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:14.669570 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 657/1311] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:10:14.670528 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bab392-5dbf-4e6a-a6ca-e66d48cb6aca admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:14.684013 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bab392-5dbf-4e6a-a6ca-e66d48cb6aca admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:14.692368 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ac796f-a261-49b0-b6ac-689a062bc29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:14.693734 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac796f-a261-49b0-b6ac-689a062bc29e admin admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:14.694083 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac796f-a261-49b0-b6ac-689a062bc29e admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:14.694378 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac796f-a261-49b0-b6ac-689a062bc29e admin admin] PATH_INFO: `/v3/projects/920d426f482c485693dab3696faa7394/users/cf9f99ace5d249c0ad75c6b6da0b610d/roles/ea564961b1db4eb4a1d4d880964611b2` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:14.698472 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699b026f-99ec-49b4-84f0-69898eb23291 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:14.700700 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699b026f-99ec-49b4-84f0-69898eb23291 service nova] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:14.713896 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ac796f-a261-49b0-b6ac-689a062bc29e admin admin] RBAC: Authorizing `identity:create_grant(project_id=920d426f482c485693dab3696faa7394, user_id=cf9f99ace5d249c0ad75c6b6da0b610d, role_id=ea564961b1db4eb4a1d4d880964611b2)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:14.716892 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ac796f-a261-49b0-b6ac-689a062bc29e admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:14.727175 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 655/1312] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:10:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:10:14.728445 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699b026f-99ec-49b4-84f0-69898eb23291 service nova] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:14.740759 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 658/1313] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:10:14 2022] PUT /identity/v3/projects/920d426f482c485693dab3696faa7394/users/cf9f99ace5d249c0ad75c6b6da0b610d/roles/ea564961b1db4eb4a1d4d880964611b2 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:10:14.742406 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ac796f-a261-49b0-b6ac-689a062bc29e admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:14.758795 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699b026f-99ec-49b4-84f0-69898eb23291 service nova] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:14.877239 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ac796f-a261-49b0-b6ac-689a062bc29e admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:14.890640 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a345110e-4086-4a9a-a6f2-1da33ad3b530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:14.891280 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a345110e-4086-4a9a-a6f2-1da33ad3b530 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:14.891607 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a345110e-4086-4a9a-a6f2-1da33ad3b530 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:14.891886 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a345110e-4086-4a9a-a6f2-1da33ad3b530 admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:14.893340 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a345110e-4086-4a9a-a6f2-1da33ad3b530 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:14.895489 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a345110e-4086-4a9a-a6f2-1da33ad3b530 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:14.903312 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ea3dc5-7650-4b65-824e-5f8c43dba32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:14.904038 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea3dc5-7650-4b65-824e-5f8c43dba32a admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:14.904312 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea3dc5-7650-4b65-824e-5f8c43dba32a admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:14.904580 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea3dc5-7650-4b65-824e-5f8c43dba32a admin admin] PATH_INFO: `/v3/projects/70ea8060f339405c9b11981ac2f4564b/users/a7875a71207647748f789c8404b1be73/roles/ea564961b1db4eb4a1d4d880964611b2` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:14.923254 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 659/1314] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 13 11:10:14.925793 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a707c2-ff06-43b0-a296-3a873ac1e62d None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:14.926112 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a707c2-ff06-43b0-a296-3a873ac1e62d None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:14.927562 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a707c2-ff06-43b0-a296-3a873ac1e62d None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:14.930193 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 660/1315] 10.222.0.25 () {54 vars in 912 bytes} [Thu Oct 13 11:10:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:10:14.937921 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a707c2-ff06-43b0-a296-3a873ac1e62d None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:14.939521 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ea3dc5-7650-4b65-824e-5f8c43dba32a admin admin] RBAC: Authorizing `identity:create_grant(project_id=70ea8060f339405c9b11981ac2f4564b, user_id=a7875a71207647748f789c8404b1be73, role_id=ea564961b1db4eb4a1d4d880964611b2)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:14.942891 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ea3dc5-7650-4b65-824e-5f8c43dba32a admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:14.961153 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 656/1316] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:10:14 2022] PUT /identity/v3/projects/70ea8060f339405c9b11981ac2f4564b/users/a7875a71207647748f789c8404b1be73/roles/ea564961b1db4eb4a1d4d880964611b2 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:10:14.964262 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542146c-87e2-45a8-bb06-53dd3acd8015 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:14.964262 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542146c-87e2-45a8-bb06-53dd3acd8015 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:14.964262 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542146c-87e2-45a8-bb06-53dd3acd8015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:14.969427 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a707c2-ff06-43b0-a296-3a873ac1e62d None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:15.018302 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-6542146c-87e2-45a8-bb06-53dd3acd8015 None None] MFA Rules not processed for user `78384fbffdd346578855e7214b335d8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:15.022245 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-6542146c-87e2-45a8-bb06-53dd3acd8015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:15.030824 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:15.101612 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7f1e7f-294b-4c8d-82e0-387037676c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:15.102527 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f1e7f-294b-4c8d-82e0-387037676c4f admin admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:15.102910 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f1e7f-294b-4c8d-82e0-387037676c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:15.103330 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f1e7f-294b-4c8d-82e0-387037676c4f admin admin] PATH_INFO: `/v3/projects/920d426f482c485693dab3696faa7394/users/cf9f99ace5d249c0ad75c6b6da0b610d/roles/ea564961b1db4eb4a1d4d880964611b2` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:15.105533 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7f1e7f-294b-4c8d-82e0-387037676c4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=920d426f482c485693dab3696faa7394, user_id=cf9f99ace5d249c0ad75c6b6da0b610d, role_id=ea564961b1db4eb4a1d4d880964611b2)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:15.109424 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7f1e7f-294b-4c8d-82e0-387037676c4f admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:15.122514 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 661/1317] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:10:14 2022] PUT /identity/v3/projects/920d426f482c485693dab3696faa7394/users/cf9f99ace5d249c0ad75c6b6da0b610d/roles/ea564961b1db4eb4a1d4d880964611b2 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:10:15.123758 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7f1e7f-294b-4c8d-82e0-387037676c4f admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:15.134040 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 657/1318] 10.222.0.25 () {58 vars in 1009 bytes} [Thu Oct 13 11:10:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:15.138705 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60134188-5a95-4540-a760-d7a7d436a5e5 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:15.139215 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60134188-5a95-4540-a760-d7a7d436a5e5 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:15.139503 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60134188-5a95-4540-a760-d7a7d436a5e5 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:15.143058 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 658/1319] 10.222.0.25 () {54 vars in 912 bytes} [Thu Oct 13 11:10:15 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:10:15.144077 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746acfce-1aa0-46f2-8a92-fd358ca0b5f4 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:15.144362 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746acfce-1aa0-46f2-8a92-fd358ca0b5f4 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:15.144660 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746acfce-1aa0-46f2-8a92-fd358ca0b5f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:15.182681 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:15.216681 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-746acfce-1aa0-46f2-8a92-fd358ca0b5f4 None None] MFA Rules not processed for user `cf9f99ace5d249c0ad75c6b6da0b610d`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:15.218066 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-746acfce-1aa0-46f2-8a92-fd358ca0b5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:15.253363 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7f1e7f-294b-4c8d-82e0-387037676c4f admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:15.261417 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f4213b-b07a-414f-aa8d-24314c6b8f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:15.262324 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f4213b-b07a-414f-aa8d-24314c6b8f6b admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:15.262697 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f4213b-b07a-414f-aa8d-24314c6b8f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:15.263102 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f4213b-b07a-414f-aa8d-24314c6b8f6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:15.264375 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f4213b-b07a-414f-aa8d-24314c6b8f6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:15.266364 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f4213b-b07a-414f-aa8d-24314c6b8f6b admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:15.284316 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 662/1320] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:10:15 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:10:15.286374 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f4213b-b07a-414f-aa8d-24314c6b8f6b admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:15.310153 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 659/1321] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:15 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:15.312329 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2721b52f-3437-4345-8b42-0f1877902bbd None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:15.312482 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2721b52f-3437-4345-8b42-0f1877902bbd None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:15.312673 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2721b52f-3437-4345-8b42-0f1877902bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:15.354728 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-2721b52f-3437-4345-8b42-0f1877902bbd None None] MFA Rules not processed for user `78384fbffdd346578855e7214b335d8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:15.356033 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-2721b52f-3437-4345-8b42-0f1877902bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:15.363638 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f4213b-b07a-414f-aa8d-24314c6b8f6b admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:15.368375 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c77d2ad-cb29-4c1e-a6d5-797a626699c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f4c2fc51f54f0e977648b13efaed1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:15.368855 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77d2ad-cb29-4c1e-a6d5-797a626699c7 service cinder] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:15.369193 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77d2ad-cb29-4c1e-a6d5-797a626699c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:15.369528 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77d2ad-cb29-4c1e-a6d5-797a626699c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:15.460340 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:15.464800 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c77d2ad-cb29-4c1e-a6d5-797a626699c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:15.466991 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c77d2ad-cb29-4c1e-a6d5-797a626699c7 service cinder] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:15.478407 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 660/1322] 10.222.0.25 () {58 vars in 1009 bytes} [Thu Oct 13 11:10:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:15.479363 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2721b52f-3437-4345-8b42-0f1877902bbd None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:15.490030 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 663/1323] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:10:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:10:15.493550 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c77d2ad-cb29-4c1e-a6d5-797a626699c7 service cinder] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:15.502277 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2721b52f-3437-4345-8b42-0f1877902bbd None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:15.516935 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eccf1c-0036-4e80-a420-2ccdd9a9912a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:15.517627 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eccf1c-0036-4e80-a420-2ccdd9a9912a admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:15.517902 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eccf1c-0036-4e80-a420-2ccdd9a9912a admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:15.520022 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c77d2ad-cb29-4c1e-a6d5-797a626699c7 service cinder] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:15.520336 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eccf1c-0036-4e80-a420-2ccdd9a9912a admin admin] PATH_INFO: `/v3/projects/70ea8060f339405c9b11981ac2f4564b/users/a7875a71207647748f789c8404b1be73/roles/ea564961b1db4eb4a1d4d880964611b2` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:15.524990 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eccf1c-0036-4e80-a420-2ccdd9a9912a admin admin] RBAC: Authorizing `identity:create_grant(project_id=70ea8060f339405c9b11981ac2f4564b, user_id=a7875a71207647748f789c8404b1be73, role_id=ea564961b1db4eb4a1d4d880964611b2)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:15.527698 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eccf1c-0036-4e80-a420-2ccdd9a9912a admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:15.530463 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7351f4ba-ab85-4eed-9d52-1e98f1125dd1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f4c2fc51f54f0e977648b13efaed1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:15.531019 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7351f4ba-ab85-4eed-9d52-1e98f1125dd1 service cinder] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:15.531295 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7351f4ba-ab85-4eed-9d52-1e98f1125dd1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:15.531563 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7351f4ba-ab85-4eed-9d52-1e98f1125dd1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:15.551599 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7351f4ba-ab85-4eed-9d52-1e98f1125dd1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:15.567676 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7351f4ba-ab85-4eed-9d52-1e98f1125dd1 service cinder] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:15.570385 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 661/1324] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:10:15 2022] PUT /identity/v3/projects/70ea8060f339405c9b11981ac2f4564b/users/a7875a71207647748f789c8404b1be73/roles/ea564961b1db4eb4a1d4d880964611b2 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:10:15.581284 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f25515a-3967-43e0-800e-7cd07bdd07c0 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:15.582405 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f25515a-3967-43e0-800e-7cd07bdd07c0 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:15.582405 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f25515a-3967-43e0-800e-7cd07bdd07c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:15.598619 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 664/1325] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:10:15 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:10:15.627824 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-9f25515a-3967-43e0-800e-7cd07bdd07c0 None None] MFA Rules not processed for user `a7875a71207647748f789c8404b1be73`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:15.628742 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-9f25515a-3967-43e0-800e-7cd07bdd07c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:15.725632 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7351f4ba-ab85-4eed-9d52-1e98f1125dd1 service cinder] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:15.736675 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7351f4ba-ab85-4eed-9d52-1e98f1125dd1 service cinder] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:15.833675 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:15.858054 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 662/1326] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:15 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:15.859031 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f25515a-3967-43e0-800e-7cd07bdd07c0 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:15.883176 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd240107-242e-43b0-b0d0-53f0e212baf7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f4c2fc51f54f0e977648b13efaed1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:15.883295 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd240107-242e-43b0-b0d0-53f0e212baf7 service cinder] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:15.883556 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd240107-242e-43b0-b0d0-53f0e212baf7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:15.883830 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd240107-242e-43b0-b0d0-53f0e212baf7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:15.933632 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f25515a-3967-43e0-800e-7cd07bdd07c0 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:15.938653 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d84f213-d176-4563-8989-e478e73d43dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f4c2fc51f54f0e977648b13efaed1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:15.939210 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84f213-d176-4563-8989-e478e73d43dd service cinder] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:15.939496 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84f213-d176-4563-8989-e478e73d43dd service cinder] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:15.939985 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84f213-d176-4563-8989-e478e73d43dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:16.008157 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd240107-242e-43b0-b0d0-53f0e212baf7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:16.010090 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd240107-242e-43b0-b0d0-53f0e212baf7 service cinder] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:16.055864 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d84f213-d176-4563-8989-e478e73d43dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:16.057479 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d84f213-d176-4563-8989-e478e73d43dd service cinder] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:16.059413 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 665/1327] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:10:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:10:16.079107 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 663/1328] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:10:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:10:16.313084 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd240107-242e-43b0-b0d0-53f0e212baf7 service cinder] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:16.326848 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d84f213-d176-4563-8989-e478e73d43dd service cinder] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:16.337915 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d84f213-d176-4563-8989-e478e73d43dd service cinder] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:16.353547 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8c7576-ed4b-4a36-8793-ba9016c8588a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f4c2fc51f54f0e977648b13efaed1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:16.354204 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c7576-ed4b-4a36-8793-ba9016c8588a service cinder] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:16.354486 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c7576-ed4b-4a36-8793-ba9016c8588a service cinder] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:16.354763 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c7576-ed4b-4a36-8793-ba9016c8588a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:16.395438 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8c7576-ed4b-4a36-8793-ba9016c8588a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:16.397681 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8c7576-ed4b-4a36-8793-ba9016c8588a service cinder] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:16.427080 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 664/1329] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:10:16 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 13 11:10:16.490036 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd240107-242e-43b0-b0d0-53f0e212baf7 service cinder] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:16.501537 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82cb1f4-f805-4cf4-8d10-62bfe0540a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:16.510422 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82cb1f4-f805-4cf4-8d10-62bfe0540a25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:16.510677 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82cb1f4-f805-4cf4-8d10-62bfe0540a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:16.510831 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82cb1f4-f805-4cf4-8d10-62bfe0540a25 admin admin] PATH_INFO: `/v3/users/1d0a5a3d9ae74777928373a5961b3297` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:16.515860 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82cb1f4-f805-4cf4-8d10-62bfe0540a25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d0a5a3d9ae74777928373a5961b3297)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:16.516904 dv-cinder-861001-1-smb devstack@keystone.service[81551]: WARNING py.warnings [None req-c82cb1f4-f805-4cf4-8d10-62bfe0540a25 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 13 11:10:16.516904 dv-cinder-861001-1-smb devstack@keystone.service[81551]: warnings.warn(msg) Oct 13 11:10:16.516904 dv-cinder-861001-1-smb devstack@keystone.service[81551]: Oct 13 11:10:16.518163 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82cb1f4-f805-4cf4-8d10-62bfe0540a25 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:16.590377 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:16.650805 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-c82cb1f4-f805-4cf4-8d10-62bfe0540a25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d0a5a3d9ae74777928373a5961b3297'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:16.666369 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-c82cb1f4-f805-4cf4-8d10-62bfe0540a25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d0a5a3d9ae74777928373a5961b3297'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:16.667218 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-c82cb1f4-f805-4cf4-8d10-62bfe0540a25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d0a5a3d9ae74777928373a5961b3297'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:16.668006 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-c82cb1f4-f805-4cf4-8d10-62bfe0540a25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d0a5a3d9ae74777928373a5961b3297'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:16.680441 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-c82cb1f4-f805-4cf4-8d10-62bfe0540a25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d0a5a3d9ae74777928373a5961b3297'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:16.697257 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8c7576-ed4b-4a36-8793-ba9016c8588a service cinder] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:16.707745 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8c7576-ed4b-4a36-8793-ba9016c8588a service cinder] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:16.718969 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb7a39e-2868-4b84-a2e4-41935b96c734 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f4c2fc51f54f0e977648b13efaed1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:16.722350 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7a39e-2868-4b84-a2e4-41935b96c734 service cinder] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:16.722710 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7a39e-2868-4b84-a2e4-41935b96c734 service cinder] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:16.724558 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7a39e-2868-4b84-a2e4-41935b96c734 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:16.733063 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-2eb7a39e-2868-4b84-a2e4-41935b96c734 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:16.773441 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 666/1330] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:10:16 2022] DELETE /identity/v3/users/1d0a5a3d9ae74777928373a5961b3297 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:10:16.779264 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29794c14-2f10-4982-81f7-b1428bd80dc6 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:16.779264 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29794c14-2f10-4982-81f7-b1428bd80dc6 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:16.779264 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29794c14-2f10-4982-81f7-b1428bd80dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:16.843281 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-29794c14-2f10-4982-81f7-b1428bd80dc6 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:16.845214 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-29794c14-2f10-4982-81f7-b1428bd80dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:16.948688 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb7a39e-2868-4b84-a2e4-41935b96c734 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:16.948877 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb7a39e-2868-4b84-a2e4-41935b96c734 service cinder] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:16.979877 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 665/1331] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:10:16 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 13 11:10:16.983336 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 667/1332] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 11:10:17.020128 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb7a39e-2868-4b84-a2e4-41935b96c734 service cinder] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:17.021585 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-2eb7a39e-2868-4b84-a2e4-41935b96c734 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:17.084414 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:17.141155 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb7a39e-2868-4b84-a2e4-41935b96c734 service cinder] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:17.251071 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffdcd0c-4c18-4fb0-9706-efffbd61238d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:17.251567 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffdcd0c-4c18-4fb0-9706-efffbd61238d service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:17.251846 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffdcd0c-4c18-4fb0-9706-efffbd61238d service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:17.252120 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffdcd0c-4c18-4fb0-9706-efffbd61238d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:17.273965 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffdcd0c-4c18-4fb0-9706-efffbd61238d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:17.275303 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffdcd0c-4c18-4fb0-9706-efffbd61238d service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:17.297997 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 666/1333] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:10:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:10:18.596214 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29794c14-2f10-4982-81f7-b1428bd80dc6 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:18.598832 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-29794c14-2f10-4982-81f7-b1428bd80dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:18.630085 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29794c14-2f10-4982-81f7-b1428bd80dc6 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:18.647543 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9db3536-2d78-4dec-b1a6-5a5407c1f744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:18.649498 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db3536-2d78-4dec-b1a6-5a5407c1f744 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:18.650518 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db3536-2d78-4dec-b1a6-5a5407c1f744 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:18.653791 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db3536-2d78-4dec-b1a6-5a5407c1f744 admin admin] PATH_INFO: `/v3/projects/7b8173db049b4a469a60d79c3057d8fe` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:18.655548 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9db3536-2d78-4dec-b1a6-5a5407c1f744 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b8173db049b4a469a60d79c3057d8fe)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:18.657762 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9db3536-2d78-4dec-b1a6-5a5407c1f744 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:18.829407 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-c9db3536-2d78-4dec-b1a6-5a5407c1f744 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b8173db049b4a469a60d79c3057d8fe', 'request_id': 'req-c9db3536-2d78-4dec-b1a6-5a5407c1f744'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:18.844695 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-c9db3536-2d78-4dec-b1a6-5a5407c1f744 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b8173db049b4a469a60d79c3057d8fe', 'request_id': 'req-c9db3536-2d78-4dec-b1a6-5a5407c1f744'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:18.852683 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-c9db3536-2d78-4dec-b1a6-5a5407c1f744 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b8173db049b4a469a60d79c3057d8fe', 'request_id': 'req-c9db3536-2d78-4dec-b1a6-5a5407c1f744'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:18.876328 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-c9db3536-2d78-4dec-b1a6-5a5407c1f744 admin admin] The token cache is being invalidate because project 7b8173db049b4a469a60d79c3057d8fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:10:18.876806 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-c9db3536-2d78-4dec-b1a6-5a5407c1f744 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:18.877642 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-c9db3536-2d78-4dec-b1a6-5a5407c1f744 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:18.885129 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 668/1334] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:10:18 2022] DELETE /identity/v3/projects/7b8173db049b4a469a60d79c3057d8fe => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:10:18.885335 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ed71d4-41e6-49d5-9c47-06182d02ea24 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:18.885860 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ed71d4-41e6-49d5-9c47-06182d02ea24 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:18.885860 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ed71d4-41e6-49d5-9c47-06182d02ea24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:18.929169 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-12ed71d4-41e6-49d5-9c47-06182d02ea24 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:18.930457 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-12ed71d4-41e6-49d5-9c47-06182d02ea24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:19.083368 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 667/1335] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:19.085008 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2872db-4690-48b3-a02a-8d1b2a42ee07 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:19.085724 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2872db-4690-48b3-a02a-8d1b2a42ee07 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:19.085724 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2872db-4690-48b3-a02a-8d1b2a42ee07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:19.139204 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-9f2872db-4690-48b3-a02a-8d1b2a42ee07 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:19.141270 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-9f2872db-4690-48b3-a02a-8d1b2a42ee07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:19.221901 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 669/1336] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:19.223975 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ed71d4-41e6-49d5-9c47-06182d02ea24 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:19.234688 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ed71d4-41e6-49d5-9c47-06182d02ea24 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:19.255600 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1b9dce-7654-4f4f-bd9b-441681302a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:19.257249 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1b9dce-7654-4f4f-bd9b-441681302a25 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:19.257807 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1b9dce-7654-4f4f-bd9b-441681302a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:19.258309 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1b9dce-7654-4f4f-bd9b-441681302a25 admin admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:19.259249 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1b9dce-7654-4f4f-bd9b-441681302a25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:10:19.260036 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1b9dce-7654-4f4f-bd9b-441681302a25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:19.264366 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1b9dce-7654-4f4f-bd9b-441681302a25 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:19.307092 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2872db-4690-48b3-a02a-8d1b2a42ee07 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:19.309617 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 668/1337] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 11:10:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:10:19.322765 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2872db-4690-48b3-a02a-8d1b2a42ee07 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:19.339913 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023f64a2-a193-4692-953f-e1f8606d0b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:19.340722 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f64a2-a193-4692-953f-e1f8606d0b01 admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:19.341190 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f64a2-a193-4692-953f-e1f8606d0b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:19.341774 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f64a2-a193-4692-953f-e1f8606d0b01 admin admin] PATH_INFO: `/v3/projects` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:19.342647 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023f64a2-a193-4692-953f-e1f8606d0b01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:19.344672 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023f64a2-a193-4692-953f-e1f8606d0b01 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:19.382981 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:19.408347 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 670/1338] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:10:19 2022] POST /identity/v3/projects => generated 405 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 11:10:19.413749 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1b9dce-7654-4f4f-bd9b-441681302a25 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:19.433977 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1b9dce-7654-4f4f-bd9b-441681302a25 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:19.656054 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c6fae-0a61-4e28-858e-8ee195a384d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:19.656990 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c6fae-0a61-4e28-858e-8ee195a384d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:19.657789 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c6fae-0a61-4e28-858e-8ee195a384d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:19.660669 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c6fae-0a61-4e28-858e-8ee195a384d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:19.662950 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860c6fae-0a61-4e28-858e-8ee195a384d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:19.665115 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860c6fae-0a61-4e28-858e-8ee195a384d1 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:19.719547 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 669/1339] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:10:19 2022] POST /identity/v3/users => generated 303 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:10:19.723692 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023f64a2-a193-4692-953f-e1f8606d0b01 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:19.739886 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023f64a2-a193-4692-953f-e1f8606d0b01 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:19.765565 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a406a0f6-83c1-4a09-bb1c-80dc3f328130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:19.766445 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a406a0f6-83c1-4a09-bb1c-80dc3f328130 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:19.767357 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a406a0f6-83c1-4a09-bb1c-80dc3f328130 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:19.767357 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a406a0f6-83c1-4a09-bb1c-80dc3f328130 admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:19.767992 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a406a0f6-83c1-4a09-bb1c-80dc3f328130 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:19.769688 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a406a0f6-83c1-4a09-bb1c-80dc3f328130 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:19.814454 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 671/1340] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:10:19 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:10:19.819153 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c6fae-0a61-4e28-858e-8ee195a384d1 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:19.839916 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c6fae-0a61-4e28-858e-8ee195a384d1 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:19.852729 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a1d2ef-042f-4819-aff1-a842563345a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:19.853664 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a1d2ef-042f-4819-aff1-a842563345a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:19.853973 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a1d2ef-042f-4819-aff1-a842563345a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:19.855230 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a1d2ef-042f-4819-aff1-a842563345a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:19.855918 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a1d2ef-042f-4819-aff1-a842563345a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:19.857916 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a1d2ef-042f-4819-aff1-a842563345a9 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:19.861712 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:19.894531 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 670/1341] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:10:19 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:10:19.898463 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a406a0f6-83c1-4a09-bb1c-80dc3f328130 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:19.911730 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a406a0f6-83c1-4a09-bb1c-80dc3f328130 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:19.928810 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f990b-0543-4ba4-b3ac-be4d48af5f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:19.929483 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f990b-0543-4ba4-b3ac-be4d48af5f5b admin admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:19.929763 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f990b-0543-4ba4-b3ac-be4d48af5f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:19.930056 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f990b-0543-4ba4-b3ac-be4d48af5f5b admin admin] PATH_INFO: `/v3/projects/d137604629084887a110c0558beccfb1/users/c1a838f881d84582b392d0f9b8edf55b/roles/7c3871c0ab68438b9014489d50b53a22` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:19.964865 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2f990b-0543-4ba4-b3ac-be4d48af5f5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d137604629084887a110c0558beccfb1, user_id=c1a838f881d84582b392d0f9b8edf55b, role_id=7c3871c0ab68438b9014489d50b53a22)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:19.969664 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2f990b-0543-4ba4-b3ac-be4d48af5f5b admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:20.032709 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 672/1342] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:10:19 2022] PUT /identity/v3/projects/d137604629084887a110c0558beccfb1/users/c1a838f881d84582b392d0f9b8edf55b/roles/7c3871c0ab68438b9014489d50b53a22 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:10:20.044549 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c691a0-7e73-47e8-977d-2699956af769 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:20.045066 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c691a0-7e73-47e8-977d-2699956af769 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:20.045565 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c691a0-7e73-47e8-977d-2699956af769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:20.113521 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f990b-0543-4ba4-b3ac-be4d48af5f5b admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:20.113521 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-4d2f990b-0543-4ba4-b3ac-be4d48af5f5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:20.135627 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-c4c691a0-7e73-47e8-977d-2699956af769 None None] MFA Rules not processed for user `c1a838f881d84582b392d0f9b8edf55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:20.140729 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-c4c691a0-7e73-47e8-977d-2699956af769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:20.339584 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f990b-0543-4ba4-b3ac-be4d48af5f5b admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:20.352439 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49fe32c-61b5-4ad5-8aff-dd33c45117f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:20.354222 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49fe32c-61b5-4ad5-8aff-dd33c45117f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:20.357012 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49fe32c-61b5-4ad5-8aff-dd33c45117f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:20.375645 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49fe32c-61b5-4ad5-8aff-dd33c45117f9 admin admin] PATH_INFO: `/v3/users/79598ed299054f4db683c45ba5820164` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:20.379908 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49fe32c-61b5-4ad5-8aff-dd33c45117f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79598ed299054f4db683c45ba5820164)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:20.383195 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49fe32c-61b5-4ad5-8aff-dd33c45117f9 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:20.400654 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 671/1343] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:20 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:20.406558 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c691a0-7e73-47e8-977d-2699956af769 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:20.437332 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c691a0-7e73-47e8-977d-2699956af769 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:20.443983 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55cc06a-4a90-4d4b-b834-428f97fa9365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:20.445026 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55cc06a-4a90-4d4b-b834-428f97fa9365 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:20.446443 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55cc06a-4a90-4d4b-b834-428f97fa9365 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:20.447221 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55cc06a-4a90-4d4b-b834-428f97fa9365 admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:20.447947 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55cc06a-4a90-4d4b-b834-428f97fa9365 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:20.450013 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55cc06a-4a90-4d4b-b834-428f97fa9365 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:20.536549 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-f49fe32c-61b5-4ad5-8aff-dd33c45117f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79598ed299054f4db683c45ba5820164'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:20.539038 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 672/1344] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:10:20 2022] POST /identity/v3/projects => generated 405 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:10:20.541467 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55cc06a-4a90-4d4b-b834-428f97fa9365 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:20.555113 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-f49fe32c-61b5-4ad5-8aff-dd33c45117f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79598ed299054f4db683c45ba5820164'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:20.555113 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-f49fe32c-61b5-4ad5-8aff-dd33c45117f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79598ed299054f4db683c45ba5820164'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:20.555113 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-f49fe32c-61b5-4ad5-8aff-dd33c45117f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79598ed299054f4db683c45ba5820164'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:20.568748 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-f49fe32c-61b5-4ad5-8aff-dd33c45117f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79598ed299054f4db683c45ba5820164'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:20.606082 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 673/1345] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:10:20 2022] DELETE /identity/v3/users/79598ed299054f4db683c45ba5820164 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:10:20.610166 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f09b9f-4898-463a-ba47-1e7955452cbe None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:20.610470 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f09b9f-4898-463a-ba47-1e7955452cbe None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:20.610741 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f09b9f-4898-463a-ba47-1e7955452cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:20.704657 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-46f09b9f-4898-463a-ba47-1e7955452cbe None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:20.707441 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-46f09b9f-4898-463a-ba47-1e7955452cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:20.830899 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55cc06a-4a90-4d4b-b834-428f97fa9365 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:20.991041 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:21.078897 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dcbc30-41fd-4de1-af0e-0c143c04cd6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:21.089035 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dcbc30-41fd-4de1-af0e-0c143c04cd6f admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:21.096239 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dcbc30-41fd-4de1-af0e-0c143c04cd6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:21.100624 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dcbc30-41fd-4de1-af0e-0c143c04cd6f admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:21.108692 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dcbc30-41fd-4de1-af0e-0c143c04cd6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:21.111274 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dcbc30-41fd-4de1-af0e-0c143c04cd6f admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:21.120347 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 674/1346] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 511 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:21.197263 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 673/1347] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:10:20 2022] POST /identity/v3/users => generated 309 bytes in 655 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:10:21.198626 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f09b9f-4898-463a-ba47-1e7955452cbe None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:21.200447 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-46f09b9f-4898-463a-ba47-1e7955452cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:21.231652 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f09b9f-4898-463a-ba47-1e7955452cbe None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:21.246970 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d648856d-fbf2-4f5b-95ba-88dfa33e710d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:21.247941 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d648856d-fbf2-4f5b-95ba-88dfa33e710d admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:21.248526 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d648856d-fbf2-4f5b-95ba-88dfa33e710d admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:21.248947 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d648856d-fbf2-4f5b-95ba-88dfa33e710d admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:21.249928 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d648856d-fbf2-4f5b-95ba-88dfa33e710d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:21.251338 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dcbc30-41fd-4de1-af0e-0c143c04cd6f admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:21.254315 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-10dcbc30-41fd-4de1-af0e-0c143c04cd6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:21.259555 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d648856d-fbf2-4f5b-95ba-88dfa33e710d admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:21.266895 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:21.316865 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 675/1348] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:10:21 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:10:21.322639 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d648856d-fbf2-4f5b-95ba-88dfa33e710d admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:21.367119 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d648856d-fbf2-4f5b-95ba-88dfa33e710d admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:21.392580 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec59151-164a-4be0-aac3-4010013f9bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:21.393269 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec59151-164a-4be0-aac3-4010013f9bdf admin admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:21.393547 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec59151-164a-4be0-aac3-4010013f9bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:21.393810 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec59151-164a-4be0-aac3-4010013f9bdf admin admin] PATH_INFO: `/v3/projects/4309890b349b464f9fe251665ffeabfe/users/2f9c73b3523d4b8c976151ac123978c6/roles/ea564961b1db4eb4a1d4d880964611b2` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:21.457741 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec59151-164a-4be0-aac3-4010013f9bdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=4309890b349b464f9fe251665ffeabfe, user_id=2f9c73b3523d4b8c976151ac123978c6, role_id=ea564961b1db4eb4a1d4d880964611b2)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:21.460790 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec59151-164a-4be0-aac3-4010013f9bdf admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:21.517281 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dcbc30-41fd-4de1-af0e-0c143c04cd6f admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:21.517737 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 676/1349] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:10:21 2022] PUT /identity/v3/projects/4309890b349b464f9fe251665ffeabfe/users/2f9c73b3523d4b8c976151ac123978c6/roles/ea564961b1db4eb4a1d4d880964611b2 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:10:21.523907 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec59151-164a-4be0-aac3-4010013f9bdf admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:21.705772 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad64e72-186c-432b-86bf-d70c088c94c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:21.706451 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad64e72-186c-432b-86bf-d70c088c94c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:21.706716 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad64e72-186c-432b-86bf-d70c088c94c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:21.707475 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad64e72-186c-432b-86bf-d70c088c94c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:21.780492 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec59151-164a-4be0-aac3-4010013f9bdf admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:21.798755 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc00740-2806-4637-9209-7d5366c83bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:21.799755 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc00740-2806-4637-9209-7d5366c83bda admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:21.800212 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc00740-2806-4637-9209-7d5366c83bda admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:21.800638 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc00740-2806-4637-9209-7d5366c83bda admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:21.801465 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc00740-2806-4637-9209-7d5366c83bda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:21.808788 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc00740-2806-4637-9209-7d5366c83bda admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:21.852029 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 677/1350] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:10:21 2022] GET /identity/v3/roles => generated 1420 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:10:21.852974 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc00740-2806-4637-9209-7d5366c83bda admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:21.874670 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad64e72-186c-432b-86bf-d70c088c94c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:21.884993 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad64e72-186c-432b-86bf-d70c088c94c4 service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:21.890956 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc00740-2806-4637-9209-7d5366c83bda admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:21.914777 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d63281-0f56-4d4c-9121-a4c0b445c055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:21.915688 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d63281-0f56-4d4c-9121-a4c0b445c055 admin admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:21.918553 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d63281-0f56-4d4c-9121-a4c0b445c055 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:21.918998 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d63281-0f56-4d4c-9121-a4c0b445c055 admin admin] PATH_INFO: `/v3/projects/4309890b349b464f9fe251665ffeabfe/users/2f9c73b3523d4b8c976151ac123978c6/roles/ea564961b1db4eb4a1d4d880964611b2` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:21.922613 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 674/1351] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:10:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 672 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:10:21.923399 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d63281-0f56-4d4c-9121-a4c0b445c055 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4309890b349b464f9fe251665ffeabfe, user_id=2f9c73b3523d4b8c976151ac123978c6, role_id=ea564961b1db4eb4a1d4d880964611b2)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:21.931868 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d63281-0f56-4d4c-9121-a4c0b445c055 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:21.972999 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 678/1352] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:10:21 2022] PUT /identity/v3/projects/4309890b349b464f9fe251665ffeabfe/users/2f9c73b3523d4b8c976151ac123978c6/roles/ea564961b1db4eb4a1d4d880964611b2 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:10:21.985840 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1459911c-dabf-48f6-b3fa-7bc8b76f46ff None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:21.986349 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1459911c-dabf-48f6-b3fa-7bc8b76f46ff None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:21.986791 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1459911c-dabf-48f6-b3fa-7bc8b76f46ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:22.045655 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d63281-0f56-4d4c-9121-a4c0b445c055 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:22.055617 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-61d63281-0f56-4d4c-9121-a4c0b445c055 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:22.090639 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-1459911c-dabf-48f6-b3fa-7bc8b76f46ff None None] MFA Rules not processed for user `2f9c73b3523d4b8c976151ac123978c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:22.094701 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-1459911c-dabf-48f6-b3fa-7bc8b76f46ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:22.207578 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:22.243920 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 675/1353] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:21 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:22.269870 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1459911c-dabf-48f6-b3fa-7bc8b76f46ff None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:22.271953 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-1459911c-dabf-48f6-b3fa-7bc8b76f46ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:22.342200 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d63281-0f56-4d4c-9121-a4c0b445c055 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:22.361340 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc4a654-f9a4-42f8-ad21-18b44f30f12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:22.362397 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc4a654-f9a4-42f8-ad21-18b44f30f12e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:22.362984 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc4a654-f9a4-42f8-ad21-18b44f30f12e admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:22.363407 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc4a654-f9a4-42f8-ad21-18b44f30f12e admin admin] PATH_INFO: `/v3/users/23b45ea447ac4bb0b4ea99a7957a974d` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:22.366416 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc4a654-f9a4-42f8-ad21-18b44f30f12e admin admin] RBAC: Authorizing `identity:delete_user(user_id=23b45ea447ac4bb0b4ea99a7957a974d)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:22.369091 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc4a654-f9a4-42f8-ad21-18b44f30f12e admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:22.413203 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1459911c-dabf-48f6-b3fa-7bc8b76f46ff None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:22.419971 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301ea2d5-0394-4dcd-9366-408b6bc71516 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f4c2fc51f54f0e977648b13efaed1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:22.421445 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ea2d5-0394-4dcd-9366-408b6bc71516 service cinder] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:22.421728 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ea2d5-0394-4dcd-9366-408b6bc71516 service cinder] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:22.422022 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ea2d5-0394-4dcd-9366-408b6bc71516 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:22.461034 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301ea2d5-0394-4dcd-9366-408b6bc71516 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:22.465483 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301ea2d5-0394-4dcd-9366-408b6bc71516 service cinder] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:22.478466 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:22.507998 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 676/1354] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:10:22 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:10:22.520239 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-2fc4a654-f9a4-42f8-ad21-18b44f30f12e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23b45ea447ac4bb0b4ea99a7957a974d'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:22.531422 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-2fc4a654-f9a4-42f8-ad21-18b44f30f12e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23b45ea447ac4bb0b4ea99a7957a974d'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:22.532544 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-2fc4a654-f9a4-42f8-ad21-18b44f30f12e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23b45ea447ac4bb0b4ea99a7957a974d'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:22.533675 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-2fc4a654-f9a4-42f8-ad21-18b44f30f12e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23b45ea447ac4bb0b4ea99a7957a974d'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:22.546474 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-2fc4a654-f9a4-42f8-ad21-18b44f30f12e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23b45ea447ac4bb0b4ea99a7957a974d'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:22.588904 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 679/1355] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:10:22 2022] DELETE /identity/v3/users/23b45ea447ac4bb0b4ea99a7957a974d => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:10:22.594821 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f6a0e-eaed-4154-89c7-2463ea8b92ef None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:22.595350 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f6a0e-eaed-4154-89c7-2463ea8b92ef None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:22.596667 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f6a0e-eaed-4154-89c7-2463ea8b92ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:22.654801 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-fe4f6a0e-eaed-4154-89c7-2463ea8b92ef None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:22.659104 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-fe4f6a0e-eaed-4154-89c7-2463ea8b92ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:22.904016 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 677/1356] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:22.944289 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc4a654-f9a4-42f8-ad21-18b44f30f12e admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:22.945805 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-2fc4a654-f9a4-42f8-ad21-18b44f30f12e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:23.079500 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc4a654-f9a4-42f8-ad21-18b44f30f12e admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:23.090549 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527d4f54-d278-40c6-876f-fbb7197aad07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:23.093445 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d4f54-d278-40c6-876f-fbb7197aad07 service neutron] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:23.093743 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d4f54-d278-40c6-876f-fbb7197aad07 service neutron] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:23.096499 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d4f54-d278-40c6-876f-fbb7197aad07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:23.122584 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4f6a0e-eaed-4154-89c7-2463ea8b92ef None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:23.124182 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-fe4f6a0e-eaed-4154-89c7-2463ea8b92ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:23.137794 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527d4f54-d278-40c6-876f-fbb7197aad07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:23.139248 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527d4f54-d278-40c6-876f-fbb7197aad07 service neutron] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:23.152599 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4f6a0e-eaed-4154-89c7-2463ea8b92ef None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:23.161380 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 680/1357] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:10:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:10:23.170472 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9414ef7-1f00-46c0-b7fb-e522ac88a6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:23.173756 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9414ef7-1f00-46c0-b7fb-e522ac88a6e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:23.174396 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9414ef7-1f00-46c0-b7fb-e522ac88a6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:23.176140 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9414ef7-1f00-46c0-b7fb-e522ac88a6e1 admin admin] PATH_INFO: `/v3/users/c1a838f881d84582b392d0f9b8edf55b` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:23.182782 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9414ef7-1f00-46c0-b7fb-e522ac88a6e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1a838f881d84582b392d0f9b8edf55b)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:23.185359 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9414ef7-1f00-46c0-b7fb-e522ac88a6e1 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:23.303751 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527d4f54-d278-40c6-876f-fbb7197aad07 service neutron] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:23.305261 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-527d4f54-d278-40c6-876f-fbb7197aad07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:23.315238 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-f9414ef7-1f00-46c0-b7fb-e522ac88a6e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1a838f881d84582b392d0f9b8edf55b'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:23.317775 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-f9414ef7-1f00-46c0-b7fb-e522ac88a6e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1a838f881d84582b392d0f9b8edf55b'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:23.319125 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-f9414ef7-1f00-46c0-b7fb-e522ac88a6e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1a838f881d84582b392d0f9b8edf55b'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:23.355958 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-f9414ef7-1f00-46c0-b7fb-e522ac88a6e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1a838f881d84582b392d0f9b8edf55b'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:23.370848 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527d4f54-d278-40c6-876f-fbb7197aad07 service neutron] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:23.375941 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-f9414ef7-1f00-46c0-b7fb-e522ac88a6e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1a838f881d84582b392d0f9b8edf55b'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:23.407636 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4fab4d-a754-418a-894e-65ad6ce1fdd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:23.411336 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4fab4d-a754-418a-894e-65ad6ce1fdd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:23.414647 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 678/1358] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:10:23 2022] DELETE /identity/v3/users/c1a838f881d84582b392d0f9b8edf55b => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:10:23.417664 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4fab4d-a754-418a-894e-65ad6ce1fdd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:23.418196 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4fab4d-a754-418a-894e-65ad6ce1fdd5 admin admin] PATH_INFO: `/v3/projects/c5e6e2487c2446a9a5f49cf49bf29a72` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:23.420106 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c19a8-76f1-4053-b8ae-ad35305dc457 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:23.424026 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c19a8-76f1-4053-b8ae-ad35305dc457 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:23.424546 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c19a8-76f1-4053-b8ae-ad35305dc457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:23.425303 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4fab4d-a754-418a-894e-65ad6ce1fdd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5e6e2487c2446a9a5f49cf49bf29a72)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:23.433877 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4fab4d-a754-418a-894e-65ad6ce1fdd5 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:23.496398 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-fd5c19a8-76f1-4053-b8ae-ad35305dc457 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:23.502521 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-fd5c19a8-76f1-4053-b8ae-ad35305dc457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:23.511551 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:23.613274 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-6b4fab4d-a754-418a-894e-65ad6ce1fdd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5e6e2487c2446a9a5f49cf49bf29a72', 'request_id': 'req-6b4fab4d-a754-418a-894e-65ad6ce1fdd5'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:23.639255 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-6b4fab4d-a754-418a-894e-65ad6ce1fdd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5e6e2487c2446a9a5f49cf49bf29a72', 'request_id': 'req-6b4fab4d-a754-418a-894e-65ad6ce1fdd5'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:23.660638 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-6b4fab4d-a754-418a-894e-65ad6ce1fdd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5e6e2487c2446a9a5f49cf49bf29a72', 'request_id': 'req-6b4fab4d-a754-418a-894e-65ad6ce1fdd5'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:23.702204 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-6b4fab4d-a754-418a-894e-65ad6ce1fdd5 admin admin] The token cache is being invalidate because project c5e6e2487c2446a9a5f49cf49bf29a72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:10:23.702496 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-6b4fab4d-a754-418a-894e-65ad6ce1fdd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:23.706136 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-6b4fab4d-a754-418a-894e-65ad6ce1fdd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:23.712929 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 681/1359] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:10:23 2022] DELETE /identity/v3/projects/c5e6e2487c2446a9a5f49cf49bf29a72 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:10:23.725960 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d4917-3092-491f-ac70-8e2d49e5522b None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:23.727141 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d4917-3092-491f-ac70-8e2d49e5522b None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:23.727434 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d4917-3092-491f-ac70-8e2d49e5522b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:23.788412 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 679/1360] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:23.812244 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-299d4917-3092-491f-ac70-8e2d49e5522b None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:23.815722 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-299d4917-3092-491f-ac70-8e2d49e5522b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:23.891000 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5c19a8-76f1-4053-b8ae-ad35305dc457 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:23.891000 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-fd5c19a8-76f1-4053-b8ae-ad35305dc457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:23.948020 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:24.012246 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 682/1361] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:24.019188 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f55a2-eb33-4570-83de-1fea77994dc8 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:24.020425 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f55a2-eb33-4570-83de-1fea77994dc8 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:24.021030 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f55a2-eb33-4570-83de-1fea77994dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:24.057979 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5c19a8-76f1-4053-b8ae-ad35305dc457 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:24.100510 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-838f55a2-eb33-4570-83de-1fea77994dc8 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:24.108414 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-838f55a2-eb33-4570-83de-1fea77994dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:24.162109 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 683/1362] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:24.164573 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838f55a2-eb33-4570-83de-1fea77994dc8 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:24.208754 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838f55a2-eb33-4570-83de-1fea77994dc8 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:24.229785 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a17dec9-0a00-4bc7-9d12-ac438cb3f995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:24.230633 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a17dec9-0a00-4bc7-9d12-ac438cb3f995 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:24.237044 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a17dec9-0a00-4bc7-9d12-ac438cb3f995 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:24.237044 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a17dec9-0a00-4bc7-9d12-ac438cb3f995 admin admin] PATH_INFO: `/v3/domains` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:24.238429 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a17dec9-0a00-4bc7-9d12-ac438cb3f995 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:10:24.238429 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a17dec9-0a00-4bc7-9d12-ac438cb3f995 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:24.239806 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a17dec9-0a00-4bc7-9d12-ac438cb3f995 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:24.293775 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe2788-5cf3-4dd5-9b86-86fae6d2349c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:24.294451 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe2788-5cf3-4dd5-9b86-86fae6d2349c service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:24.294738 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe2788-5cf3-4dd5-9b86-86fae6d2349c service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:24.295010 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe2788-5cf3-4dd5-9b86-86fae6d2349c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:24.305784 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 684/1363] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 11:10:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:10:24.309918 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a17dec9-0a00-4bc7-9d12-ac438cb3f995 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:24.337331 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fe2788-5cf3-4dd5-9b86-86fae6d2349c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:24.338849 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fe2788-5cf3-4dd5-9b86-86fae6d2349c service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:24.350316 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a17dec9-0a00-4bc7-9d12-ac438cb3f995 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:24.365543 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b364a-84d8-4012-8a65-bb190b8a4938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:24.366234 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b364a-84d8-4012-8a65-bb190b8a4938 admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:24.366515 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b364a-84d8-4012-8a65-bb190b8a4938 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:24.366799 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b364a-84d8-4012-8a65-bb190b8a4938 admin admin] PATH_INFO: `/v3/projects` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:24.367439 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6b364a-84d8-4012-8a65-bb190b8a4938 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:24.369349 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6b364a-84d8-4012-8a65-bb190b8a4938 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:24.379570 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 680/1364] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:10:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:10:24.447907 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 685/1365] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:10:24 2022] POST /identity/v3/projects => generated 405 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:10:24.452237 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe2788-5cf3-4dd5-9b86-86fae6d2349c service neutron] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:24.455481 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352d20d-5c70-4c1c-a4d0-52a0d83790ec None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:24.455744 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352d20d-5c70-4c1c-a4d0-52a0d83790ec None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:24.456019 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352d20d-5c70-4c1c-a4d0-52a0d83790ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:24.466577 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe2788-5cf3-4dd5-9b86-86fae6d2349c service neutron] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:24.523191 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-0352d20d-5c70-4c1c-a4d0-52a0d83790ec None None] MFA Rules not processed for user `f441da37833c45cb962821d7caed9690`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:24.524302 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-0352d20d-5c70-4c1c-a4d0-52a0d83790ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:24.643693 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 686/1366] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:24 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:24.657657 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632326c1-4fea-4d8a-8e78-c8c0504ebeb4 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:24.658849 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632326c1-4fea-4d8a-8e78-c8c0504ebeb4 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:24.659435 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632326c1-4fea-4d8a-8e78-c8c0504ebeb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:24.679377 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d94fdd-ed5e-4b4a-b319-cebdea070de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:24.680473 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d94fdd-ed5e-4b4a-b319-cebdea070de3 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:24.681466 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d94fdd-ed5e-4b4a-b319-cebdea070de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:24.683273 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d94fdd-ed5e-4b4a-b319-cebdea070de3 admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:24.687072 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d94fdd-ed5e-4b4a-b319-cebdea070de3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:24.692041 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d94fdd-ed5e-4b4a-b319-cebdea070de3 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:24.728329 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-632326c1-4fea-4d8a-8e78-c8c0504ebeb4 None None] MFA Rules not processed for user `f441da37833c45cb962821d7caed9690`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:24.729828 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-632326c1-4fea-4d8a-8e78-c8c0504ebeb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:24.737043 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:24.759288 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 681/1367] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:10:24 2022] POST /identity/v3/users => generated 303 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:10:24.763586 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d94fdd-ed5e-4b4a-b319-cebdea070de3 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:24.765376 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 687/1368] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:24 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:24.777054 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632326c1-4fea-4d8a-8e78-c8c0504ebeb4 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:24.779704 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-632326c1-4fea-4d8a-8e78-c8c0504ebeb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:24.795987 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d94fdd-ed5e-4b4a-b319-cebdea070de3 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:24.808243 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d136236-0060-4a3c-9f31-cad4f0f917da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:24.809805 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d136236-0060-4a3c-9f31-cad4f0f917da admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:24.809805 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d136236-0060-4a3c-9f31-cad4f0f917da admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:24.810123 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d136236-0060-4a3c-9f31-cad4f0f917da admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:24.812325 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d136236-0060-4a3c-9f31-cad4f0f917da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:24.818436 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d136236-0060-4a3c-9f31-cad4f0f917da admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:24.857318 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 682/1369] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 13 11:10:24.862087 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d136236-0060-4a3c-9f31-cad4f0f917da admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:24.888116 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d136236-0060-4a3c-9f31-cad4f0f917da admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:24.908948 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3f08a5-4d82-46e5-924c-18f59b5b8bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:24.909759 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f08a5-4d82-46e5-924c-18f59b5b8bc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:24.910055 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f08a5-4d82-46e5-924c-18f59b5b8bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:24.913552 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f08a5-4d82-46e5-924c-18f59b5b8bc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:24.917380 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3f08a5-4d82-46e5-924c-18f59b5b8bc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:24.920412 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3f08a5-4d82-46e5-924c-18f59b5b8bc9 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:24.937438 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 683/1370] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:10:24.938827 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3f08a5-4d82-46e5-924c-18f59b5b8bc9 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:24.944836 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-2d3f08a5-4d82-46e5-924c-18f59b5b8bc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:24.966455 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3f08a5-4d82-46e5-924c-18f59b5b8bc9 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:24.984888 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632326c1-4fea-4d8a-8e78-c8c0504ebeb4 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:24.995062 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f47136d-b267-4545-80b9-03b1c13cb28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:24.995729 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47136d-b267-4545-80b9-03b1c13cb28c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:24.997427 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47136d-b267-4545-80b9-03b1c13cb28c admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:24.998164 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47136d-b267-4545-80b9-03b1c13cb28c admin admin] PATH_INFO: `/v3/projects/e0064c136a3547feb0d3de8594dd2027` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:25.000683 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f47136d-b267-4545-80b9-03b1c13cb28c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0064c136a3547feb0d3de8594dd2027)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:25.001176 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8477f97-337e-40cd-a724-d5f163a65b0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78384fbffdd346578855e7214b335d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:25.001734 dv-cinder-861001-1-smb devstack@keystone.service[81550]: WARNING py.warnings [None req-8f47136d-b267-4545-80b9-03b1c13cb28c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 13 11:10:25.001734 dv-cinder-861001-1-smb devstack@keystone.service[81550]: warnings.warn(msg) Oct 13 11:10:25.001734 dv-cinder-861001-1-smb devstack@keystone.service[81550]: Oct 13 11:10:25.002276 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8477f97-337e-40cd-a724-d5f163a65b0d service nova] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:25.002651 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8477f97-337e-40cd-a724-d5f163a65b0d service nova] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:25.003017 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8477f97-337e-40cd-a724-d5f163a65b0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:25.004566 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f47136d-b267-4545-80b9-03b1c13cb28c admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:25.023629 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8477f97-337e-40cd-a724-d5f163a65b0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:25.028132 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8477f97-337e-40cd-a724-d5f163a65b0d service nova] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:25.042303 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:25.062092 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 688/1371] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:10:24 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:10:25.063456 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8477f97-337e-40cd-a724-d5f163a65b0d service nova] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:25.096768 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8477f97-337e-40cd-a724-d5f163a65b0d service nova] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:25.148457 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-8f47136d-b267-4545-80b9-03b1c13cb28c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0064c136a3547feb0d3de8594dd2027', 'request_id': 'req-8f47136d-b267-4545-80b9-03b1c13cb28c'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:25.167748 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-8f47136d-b267-4545-80b9-03b1c13cb28c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0064c136a3547feb0d3de8594dd2027', 'request_id': 'req-8f47136d-b267-4545-80b9-03b1c13cb28c'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:25.210372 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-8f47136d-b267-4545-80b9-03b1c13cb28c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0064c136a3547feb0d3de8594dd2027', 'request_id': 'req-8f47136d-b267-4545-80b9-03b1c13cb28c'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:25.242408 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-8f47136d-b267-4545-80b9-03b1c13cb28c admin admin] The token cache is being invalidate because project e0064c136a3547feb0d3de8594dd2027 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:10:25.243269 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-8f47136d-b267-4545-80b9-03b1c13cb28c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:25.245894 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-8f47136d-b267-4545-80b9-03b1c13cb28c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:25.250277 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 684/1372] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:10:24 2022] DELETE /identity/v3/projects/e0064c136a3547feb0d3de8594dd2027 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:10:25.251289 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f47136d-b267-4545-80b9-03b1c13cb28c admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:25.254843 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee628a7b-30a9-4063-91a9-08b23712ed8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:25.255544 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee628a7b-30a9-4063-91a9-08b23712ed8d admin admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:25.256885 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee628a7b-30a9-4063-91a9-08b23712ed8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:25.257166 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee628a7b-30a9-4063-91a9-08b23712ed8d admin admin] PATH_INFO: `/v3/projects/9ef6f26ea95e4c6c86221aa205dbbe1f/users/a9f5926b1dad45b1bb81745b772d3920/roles/7c3871c0ab68438b9014489d50b53a22` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:25.257934 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-8f47136d-b267-4545-80b9-03b1c13cb28c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:25.284764 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee628a7b-30a9-4063-91a9-08b23712ed8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ef6f26ea95e4c6c86221aa205dbbe1f, user_id=a9f5926b1dad45b1bb81745b772d3920, role_id=7c3871c0ab68438b9014489d50b53a22)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:25.288673 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee628a7b-30a9-4063-91a9-08b23712ed8d admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:25.303886 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f47136d-b267-4545-80b9-03b1c13cb28c admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:25.326629 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ebb0b-ddd5-4716-a209-2eb794680c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:25.327547 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ebb0b-ddd5-4716-a209-2eb794680c17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:25.328360 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ebb0b-ddd5-4716-a209-2eb794680c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:25.328901 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ebb0b-ddd5-4716-a209-2eb794680c17 admin admin] PATH_INFO: `/v3/projects/d137604629084887a110c0558beccfb1` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:25.331033 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 689/1373] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:10:25 2022] PUT /identity/v3/projects/9ef6f26ea95e4c6c86221aa205dbbe1f/users/a9f5926b1dad45b1bb81745b772d3920/roles/7c3871c0ab68438b9014489d50b53a22 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:10:25.331760 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500ebb0b-ddd5-4716-a209-2eb794680c17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d137604629084887a110c0558beccfb1)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:25.332093 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee628a7b-30a9-4063-91a9-08b23712ed8d admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:25.334248 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500ebb0b-ddd5-4716-a209-2eb794680c17 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:25.340557 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-ee628a7b-30a9-4063-91a9-08b23712ed8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:25.471075 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee628a7b-30a9-4063-91a9-08b23712ed8d admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:25.495786 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-500ebb0b-ddd5-4716-a209-2eb794680c17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd137604629084887a110c0558beccfb1', 'request_id': 'req-500ebb0b-ddd5-4716-a209-2eb794680c17'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:25.520931 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-500ebb0b-ddd5-4716-a209-2eb794680c17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd137604629084887a110c0558beccfb1', 'request_id': 'req-500ebb0b-ddd5-4716-a209-2eb794680c17'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:25.530354 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-500ebb0b-ddd5-4716-a209-2eb794680c17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd137604629084887a110c0558beccfb1', 'request_id': 'req-500ebb0b-ddd5-4716-a209-2eb794680c17'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:25.545278 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-500ebb0b-ddd5-4716-a209-2eb794680c17 admin admin] The token cache is being invalidate because project d137604629084887a110c0558beccfb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:10:25.546020 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-500ebb0b-ddd5-4716-a209-2eb794680c17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:25.546873 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-500ebb0b-ddd5-4716-a209-2eb794680c17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:25.550343 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 685/1374] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:10:25 2022] DELETE /identity/v3/projects/d137604629084887a110c0558beccfb1 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:10:25.553230 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f07ac-8ca7-4db1-a818-bc841d36c192 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:25.553954 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f07ac-8ca7-4db1-a818-bc841d36c192 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:25.554403 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f07ac-8ca7-4db1-a818-bc841d36c192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:25.635919 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88328232-0dce-4028-b235-f064e87366b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:25.636581 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88328232-0dce-4028-b235-f064e87366b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:25.636845 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88328232-0dce-4028-b235-f064e87366b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:25.637118 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88328232-0dce-4028-b235-f064e87366b4 admin admin] PATH_INFO: `/v3/users/a7875a71207647748f789c8404b1be73` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:25.638841 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88328232-0dce-4028-b235-f064e87366b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7875a71207647748f789c8404b1be73)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:25.642473 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-720f07ac-8ca7-4db1-a818-bc841d36c192 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:25.643747 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-720f07ac-8ca7-4db1-a818-bc841d36c192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:25.648939 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88328232-0dce-4028-b235-f064e87366b4 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:25.652737 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 686/1375] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:25.653690 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f07ac-8ca7-4db1-a818-bc841d36c192 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:25.658871 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-720f07ac-8ca7-4db1-a818-bc841d36c192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:25.693969 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f07ac-8ca7-4db1-a818-bc841d36c192 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:25.699766 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8744b6e1-b619-4c5c-b273-922e3afc8524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:25.700535 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744b6e1-b619-4c5c-b273-922e3afc8524 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:25.700734 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744b6e1-b619-4c5c-b273-922e3afc8524 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:25.700971 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744b6e1-b619-4c5c-b273-922e3afc8524 admin admin] PATH_INFO: `/v3/users/4dfff6f5944c4c76a3bf26368580af64` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:25.707695 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8744b6e1-b619-4c5c-b273-922e3afc8524 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dfff6f5944c4c76a3bf26368580af64)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:25.714352 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8744b6e1-b619-4c5c-b273-922e3afc8524 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:25.753105 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:25.773637 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:25.779754 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-88328232-0dce-4028-b235-f064e87366b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7875a71207647748f789c8404b1be73'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:25.792074 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-88328232-0dce-4028-b235-f064e87366b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7875a71207647748f789c8404b1be73'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:25.792854 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-88328232-0dce-4028-b235-f064e87366b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7875a71207647748f789c8404b1be73'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:25.793663 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-88328232-0dce-4028-b235-f064e87366b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7875a71207647748f789c8404b1be73'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:25.805528 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-88328232-0dce-4028-b235-f064e87366b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7875a71207647748f789c8404b1be73'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:25.814541 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-8744b6e1-b619-4c5c-b273-922e3afc8524 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dfff6f5944c4c76a3bf26368580af64'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:25.815236 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-8744b6e1-b619-4c5c-b273-922e3afc8524 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dfff6f5944c4c76a3bf26368580af64'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:25.815854 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-8744b6e1-b619-4c5c-b273-922e3afc8524 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dfff6f5944c4c76a3bf26368580af64'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:25.836270 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 690/1376] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:10:25 2022] DELETE /identity/v3/users/a7875a71207647748f789c8404b1be73 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:10:25.836270 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88328232-0dce-4028-b235-f064e87366b4 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:25.839850 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-8744b6e1-b619-4c5c-b273-922e3afc8524 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dfff6f5944c4c76a3bf26368580af64'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:25.854538 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-88328232-0dce-4028-b235-f064e87366b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:25.855458 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-8744b6e1-b619-4c5c-b273-922e3afc8524 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dfff6f5944c4c76a3bf26368580af64'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:25.884269 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 687/1377] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:10:25 2022] DELETE /identity/v3/users/4dfff6f5944c4c76a3bf26368580af64 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:10:25.885338 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8744b6e1-b619-4c5c-b273-922e3afc8524 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:25.887125 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-8744b6e1-b619-4c5c-b273-922e3afc8524 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:25.977671 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8744b6e1-b619-4c5c-b273-922e3afc8524 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:25.984080 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6086ed-fbed-4842-a77e-6eece2d91967 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:25.984862 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6086ed-fbed-4842-a77e-6eece2d91967 service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:25.985542 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6086ed-fbed-4842-a77e-6eece2d91967 service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:25.986054 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6086ed-fbed-4842-a77e-6eece2d91967 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:25.988737 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-cb6086ed-fbed-4842-a77e-6eece2d91967 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:26.019878 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88328232-0dce-4028-b235-f064e87366b4 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:26.184623 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51f6213-002f-487b-bd53-bb06aa082dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:26.185413 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f6213-002f-487b-bd53-bb06aa082dce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:26.185694 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f6213-002f-487b-bd53-bb06aa082dce admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:26.186092 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f6213-002f-487b-bd53-bb06aa082dce admin admin] PATH_INFO: `/v3/users/2f9c73b3523d4b8c976151ac123978c6` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:26.187575 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51f6213-002f-487b-bd53-bb06aa082dce admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f9c73b3523d4b8c976151ac123978c6)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:26.191084 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51f6213-002f-487b-bd53-bb06aa082dce admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:26.247076 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6086ed-fbed-4842-a77e-6eece2d91967 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:26.248666 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6086ed-fbed-4842-a77e-6eece2d91967 service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:26.270816 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-c51f6213-002f-487b-bd53-bb06aa082dce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f9c73b3523d4b8c976151ac123978c6'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:26.275097 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 688/1378] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:10:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:10:26.278455 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a7e225-4049-494b-9422-5ee354f28609 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:26.279412 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a7e225-4049-494b-9422-5ee354f28609 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:26.282387 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a7e225-4049-494b-9422-5ee354f28609 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:26.284537 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 689/1379] 10.222.0.25 () {54 vars in 912 bytes} [Thu Oct 13 11:10:26 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:10:26.289846 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da163c-4498-4e42-b1a5-ac11124a930c None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:26.290316 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da163c-4498-4e42-b1a5-ac11124a930c None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:26.290695 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da163c-4498-4e42-b1a5-ac11124a930c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:26.297219 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-c51f6213-002f-487b-bd53-bb06aa082dce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f9c73b3523d4b8c976151ac123978c6'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:26.298199 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-c51f6213-002f-487b-bd53-bb06aa082dce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f9c73b3523d4b8c976151ac123978c6'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:26.299426 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-c51f6213-002f-487b-bd53-bb06aa082dce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f9c73b3523d4b8c976151ac123978c6'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:26.306963 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:26.331691 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-c51f6213-002f-487b-bd53-bb06aa082dce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f9c73b3523d4b8c976151ac123978c6'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:26.332613 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-d0da163c-4498-4e42-b1a5-ac11124a930c None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:26.338261 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-d0da163c-4498-4e42-b1a5-ac11124a930c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:26.367974 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 690/1380] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:26.370235 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d8263-3e52-4c31-9829-b7f138f07b76 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:26.372320 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d8263-3e52-4c31-9829-b7f138f07b76 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:26.372705 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d8263-3e52-4c31-9829-b7f138f07b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:26.389374 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 691/1381] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:10:25 2022] DELETE /identity/v3/users/2f9c73b3523d4b8c976151ac123978c6 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:10:26.395439 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51f6213-002f-487b-bd53-bb06aa082dce admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:26.397910 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-c51f6213-002f-487b-bd53-bb06aa082dce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:26.491650 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-667d8263-3e52-4c31-9829-b7f138f07b76 None None] MFA Rules not processed for user `085e8bffed444287bc5f805461c3fb55`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:26.493409 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-667d8263-3e52-4c31-9829-b7f138f07b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:26.563481 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51f6213-002f-487b-bd53-bb06aa082dce admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:26.570545 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152bb51a-32d4-4b4a-804a-ae28d4f83cd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:26.571453 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152bb51a-32d4-4b4a-804a-ae28d4f83cd9 service neutron] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:26.571902 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152bb51a-32d4-4b4a-804a-ae28d4f83cd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:26.572333 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152bb51a-32d4-4b4a-804a-ae28d4f83cd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:26.582119 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:26.635423 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 691/1382] 10.222.0.25 () {58 vars in 1009 bytes} [Thu Oct 13 11:10:26 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:26.702748 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152bb51a-32d4-4b4a-804a-ae28d4f83cd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:26.704794 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152bb51a-32d4-4b4a-804a-ae28d4f83cd9 service neutron] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:26.710732 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667d8263-3e52-4c31-9829-b7f138f07b76 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:26.722453 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667d8263-3e52-4c31-9829-b7f138f07b76 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:26.731879 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d74668-0c66-4d4b-bf57-95def274a817 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:26.733198 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d74668-0c66-4d4b-bf57-95def274a817 service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:26.734849 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d74668-0c66-4d4b-bf57-95def274a817 service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:26.735648 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d74668-0c66-4d4b-bf57-95def274a817 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:26.744966 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 692/1383] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:10:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 13 11:10:26.749934 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d74668-0c66-4d4b-bf57-95def274a817 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:26.751955 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d74668-0c66-4d4b-bf57-95def274a817 service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:26.767992 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 692/1384] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:10:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 13 11:10:27.124012 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152bb51a-32d4-4b4a-804a-ae28d4f83cd9 service neutron] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:27.128638 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-152bb51a-32d4-4b4a-804a-ae28d4f83cd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:27.148025 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152bb51a-32d4-4b4a-804a-ae28d4f83cd9 service neutron] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:27.164170 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9c9517-63d7-42ce-aecd-eab9ff1b5f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:27.165125 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c9517-63d7-42ce-aecd-eab9ff1b5f1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:27.165591 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c9517-63d7-42ce-aecd-eab9ff1b5f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:27.165929 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c9517-63d7-42ce-aecd-eab9ff1b5f1b admin admin] PATH_INFO: `/v3/projects/70ea8060f339405c9b11981ac2f4564b` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:27.201405 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9c9517-63d7-42ce-aecd-eab9ff1b5f1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=70ea8060f339405c9b11981ac2f4564b)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:27.211661 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9c9517-63d7-42ce-aecd-eab9ff1b5f1b admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:27.343433 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-5f9c9517-63d7-42ce-aecd-eab9ff1b5f1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70ea8060f339405c9b11981ac2f4564b', 'request_id': 'req-5f9c9517-63d7-42ce-aecd-eab9ff1b5f1b'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:27.362103 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-5f9c9517-63d7-42ce-aecd-eab9ff1b5f1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70ea8060f339405c9b11981ac2f4564b', 'request_id': 'req-5f9c9517-63d7-42ce-aecd-eab9ff1b5f1b'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:27.379493 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-5f9c9517-63d7-42ce-aecd-eab9ff1b5f1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70ea8060f339405c9b11981ac2f4564b', 'request_id': 'req-5f9c9517-63d7-42ce-aecd-eab9ff1b5f1b'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:27.409423 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-5f9c9517-63d7-42ce-aecd-eab9ff1b5f1b admin admin] The token cache is being invalidate because project 70ea8060f339405c9b11981ac2f4564b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:10:27.410557 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-5f9c9517-63d7-42ce-aecd-eab9ff1b5f1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:27.413636 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-5f9c9517-63d7-42ce-aecd-eab9ff1b5f1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:27.417331 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 693/1385] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:10:27 2022] DELETE /identity/v3/projects/70ea8060f339405c9b11981ac2f4564b => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:10:27.424297 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca01f1c-7982-4388-a042-9b54539dd2c0 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:27.424787 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca01f1c-7982-4388-a042-9b54539dd2c0 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:27.425087 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca01f1c-7982-4388-a042-9b54539dd2c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:27.490471 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-6ca01f1c-7982-4388-a042-9b54539dd2c0 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:27.502727 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-6ca01f1c-7982-4388-a042-9b54539dd2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:27.652389 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 693/1386] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:27.658917 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d595e2-2f95-44ac-baf5-0b83f9bf2435 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:27.659225 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d595e2-2f95-44ac-baf5-0b83f9bf2435 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:27.659711 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d595e2-2f95-44ac-baf5-0b83f9bf2435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:27.698981 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-a8d595e2-2f95-44ac-baf5-0b83f9bf2435 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:27.705077 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-a8d595e2-2f95-44ac-baf5-0b83f9bf2435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:27.724082 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 694/1387] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:27.728820 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca01f1c-7982-4388-a042-9b54539dd2c0 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:27.741126 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca01f1c-7982-4388-a042-9b54539dd2c0 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:27.758365 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b573ebe4-35fd-4861-9a4f-3bc33be093d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:27.759189 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b573ebe4-35fd-4861-9a4f-3bc33be093d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:27.759473 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b573ebe4-35fd-4861-9a4f-3bc33be093d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:27.759792 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b573ebe4-35fd-4861-9a4f-3bc33be093d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:27.760562 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b573ebe4-35fd-4861-9a4f-3bc33be093d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:10:27.760909 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b573ebe4-35fd-4861-9a4f-3bc33be093d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:27.766021 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b573ebe4-35fd-4861-9a4f-3bc33be093d1 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:27.801538 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 694/1388] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 11:10:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:10:27.805825 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d595e2-2f95-44ac-baf5-0b83f9bf2435 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:27.810706 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:27.823771 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d595e2-2f95-44ac-baf5-0b83f9bf2435 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:27.844266 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa1611-5119-4b2a-b44d-f2f63d9937d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:27.846735 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa1611-5119-4b2a-b44d-f2f63d9937d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:27.847064 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa1611-5119-4b2a-b44d-f2f63d9937d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:27.847453 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa1611-5119-4b2a-b44d-f2f63d9937d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:27.848058 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffa1611-5119-4b2a-b44d-f2f63d9937d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:27.861211 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffa1611-5119-4b2a-b44d-f2f63d9937d7 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:27.928747 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 695/1389] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:10:27 2022] POST /identity/v3/projects => generated 387 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 11:10:27.932537 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b573ebe4-35fd-4861-9a4f-3bc33be093d1 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:27.974599 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b573ebe4-35fd-4861-9a4f-3bc33be093d1 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:28.022169 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa1611-5119-4b2a-b44d-f2f63d9937d7 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:28.024863 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-2ffa1611-5119-4b2a-b44d-f2f63d9937d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:28.104693 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec651e2c-b671-436b-b768-85461edc96f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:28.105460 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec651e2c-b671-436b-b768-85461edc96f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:28.106335 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec651e2c-b671-436b-b768-85461edc96f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:28.106757 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec651e2c-b671-436b-b768-85461edc96f7 admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:28.107532 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec651e2c-b671-436b-b768-85461edc96f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:28.110247 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec651e2c-b671-436b-b768-85461edc96f7 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:28.155852 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 695/1390] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:10:27 2022] POST /identity/v3/users => generated 294 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:10:28.160257 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec651e2c-b671-436b-b768-85461edc96f7 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:28.173523 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec651e2c-b671-436b-b768-85461edc96f7 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:28.181506 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaae7c7-ad4d-4e41-9260-408c6f224aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:28.183346 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaae7c7-ad4d-4e41-9260-408c6f224aa2 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:28.183809 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaae7c7-ad4d-4e41-9260-408c6f224aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:28.184279 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaae7c7-ad4d-4e41-9260-408c6f224aa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:28.185440 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaae7c7-ad4d-4e41-9260-408c6f224aa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:28.187971 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaae7c7-ad4d-4e41-9260-408c6f224aa2 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:28.209571 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 696/1391] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:10:28 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:10:28.210907 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaae7c7-ad4d-4e41-9260-408c6f224aa2 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:28.240784 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaae7c7-ad4d-4e41-9260-408c6f224aa2 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:28.243290 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa1611-5119-4b2a-b44d-f2f63d9937d7 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:28.250153 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea2d3b-6470-48a7-9cef-2bafe028c5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:28.256283 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea2d3b-6470-48a7-9cef-2bafe028c5a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:28.256722 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea2d3b-6470-48a7-9cef-2bafe028c5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:28.257242 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea2d3b-6470-48a7-9cef-2bafe028c5a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:28.258204 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ea2d3b-6470-48a7-9cef-2bafe028c5a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:28.258988 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0e1416-c78c-41b3-8e3a-6c3faa6420f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:28.259828 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e1416-c78c-41b3-8e3a-6c3faa6420f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:28.260165 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ea2d3b-6470-48a7-9cef-2bafe028c5a6 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:28.260612 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e1416-c78c-41b3-8e3a-6c3faa6420f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:28.262223 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e1416-c78c-41b3-8e3a-6c3faa6420f4 admin admin] PATH_INFO: `/v3/projects/4309890b349b464f9fe251665ffeabfe` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:28.267157 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0e1416-c78c-41b3-8e3a-6c3faa6420f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4309890b349b464f9fe251665ffeabfe)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:28.272124 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0e1416-c78c-41b3-8e3a-6c3faa6420f4 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:28.296026 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 697/1392] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:10:28 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:10:28.300747 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea2d3b-6470-48a7-9cef-2bafe028c5a6 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:28.311768 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea2d3b-6470-48a7-9cef-2bafe028c5a6 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:28.318755 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85111e91-7a66-4c68-9f0a-a3e106e3d99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:28.319644 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85111e91-7a66-4c68-9f0a-a3e106e3d99e admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:28.320277 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85111e91-7a66-4c68-9f0a-a3e106e3d99e admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:28.320560 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85111e91-7a66-4c68-9f0a-a3e106e3d99e admin admin] PATH_INFO: `/v3/projects/4a9e9f3eb4114858838c5385b11b7207/users/e8b80a7931874e01aba0d6df3c52a506/roles/7c3871c0ab68438b9014489d50b53a22` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:28.372015 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85111e91-7a66-4c68-9f0a-a3e106e3d99e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a9e9f3eb4114858838c5385b11b7207, user_id=e8b80a7931874e01aba0d6df3c52a506, role_id=7c3871c0ab68438b9014489d50b53a22)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:28.374278 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-0a0e1416-c78c-41b3-8e3a-6c3faa6420f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4309890b349b464f9fe251665ffeabfe', 'request_id': 'req-0a0e1416-c78c-41b3-8e3a-6c3faa6420f4'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:28.377258 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85111e91-7a66-4c68-9f0a-a3e106e3d99e admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:28.395091 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-0a0e1416-c78c-41b3-8e3a-6c3faa6420f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4309890b349b464f9fe251665ffeabfe', 'request_id': 'req-0a0e1416-c78c-41b3-8e3a-6c3faa6420f4'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:28.426597 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-0a0e1416-c78c-41b3-8e3a-6c3faa6420f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4309890b349b464f9fe251665ffeabfe', 'request_id': 'req-0a0e1416-c78c-41b3-8e3a-6c3faa6420f4'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:28.427246 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 698/1393] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:10:28 2022] PUT /identity/v3/projects/4a9e9f3eb4114858838c5385b11b7207/users/e8b80a7931874e01aba0d6df3c52a506/roles/7c3871c0ab68438b9014489d50b53a22 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:10:28.429357 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85111e91-7a66-4c68-9f0a-a3e106e3d99e admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:28.435414 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-85111e91-7a66-4c68-9f0a-a3e106e3d99e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:28.454172 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-0a0e1416-c78c-41b3-8e3a-6c3faa6420f4 admin admin] The token cache is being invalidate because project 4309890b349b464f9fe251665ffeabfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:10:28.454442 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-0a0e1416-c78c-41b3-8e3a-6c3faa6420f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:28.459653 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-0a0e1416-c78c-41b3-8e3a-6c3faa6420f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:28.472967 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:28.473187 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 696/1394] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:10:28 2022] DELETE /identity/v3/projects/4309890b349b464f9fe251665ffeabfe => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 11:10:28.473447 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea969721-b53b-45a5-bcee-3ad7e4cb543a None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:28.473745 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea969721-b53b-45a5-bcee-3ad7e4cb543a None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:28.474055 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea969721-b53b-45a5-bcee-3ad7e4cb543a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:28.534151 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-ea969721-b53b-45a5-bcee-3ad7e4cb543a None None] MFA Rules not processed for user `e8b80a7931874e01aba0d6df3c52a506`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:28.542124 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-ea969721-b53b-45a5-bcee-3ad7e4cb543a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:28.575698 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85111e91-7a66-4c68-9f0a-a3e106e3d99e admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:28.584972 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27ea3da-9270-4414-b495-6845c42dcc44 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed4bb75e68a640fc92ddd47fad61a25a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:28.585529 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ea3da-9270-4414-b495-6845c42dcc44 service placement] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:28.585814 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ea3da-9270-4414-b495-6845c42dcc44 service placement] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:28.586112 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ea3da-9270-4414-b495-6845c42dcc44 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:28.592243 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-d27ea3da-9270-4414-b495-6845c42dcc44 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:28.617562 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27ea3da-9270-4414-b495-6845c42dcc44 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:28.620605 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27ea3da-9270-4414-b495-6845c42dcc44 service placement] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:28.646033 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 699/1395] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:10:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:10:28.648261 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7dab9-e635-4acb-838e-de1c545ea73f None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:28.648261 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7dab9-e635-4acb-838e-de1c545ea73f None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:28.648500 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7dab9-e635-4acb-838e-de1c545ea73f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:28.674214 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:28.684438 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-8af7dab9-e635-4acb-838e-de1c545ea73f None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:28.685923 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-8af7dab9-e635-4acb-838e-de1c545ea73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:28.686577 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 697/1396] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:28 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:28.691091 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea969721-b53b-45a5-bcee-3ad7e4cb543a None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:28.695732 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-ea969721-b53b-45a5-bcee-3ad7e4cb543a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:28.801644 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 700/1397] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:28.809768 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48bc4f2-c0b7-411d-9d74-09255f62ef12 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:28.810088 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48bc4f2-c0b7-411d-9d74-09255f62ef12 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:28.810361 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48bc4f2-c0b7-411d-9d74-09255f62ef12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:28.859574 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-f48bc4f2-c0b7-411d-9d74-09255f62ef12 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:28.863814 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-f48bc4f2-c0b7-411d-9d74-09255f62ef12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:28.889052 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea969721-b53b-45a5-bcee-3ad7e4cb543a None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:28.906564 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de892f6-3247-4a35-ae2f-87134493e5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:28.907478 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de892f6-3247-4a35-ae2f-87134493e5fe admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:28.907960 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de892f6-3247-4a35-ae2f-87134493e5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:28.908444 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de892f6-3247-4a35-ae2f-87134493e5fe admin admin] PATH_INFO: `/v3/projects` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:28.909083 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 701/1398] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:28.909825 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de892f6-3247-4a35-ae2f-87134493e5fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:28.910045 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48bc4f2-c0b7-411d-9d74-09255f62ef12 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:28.912810 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de892f6-3247-4a35-ae2f-87134493e5fe admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:28.934449 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48bc4f2-c0b7-411d-9d74-09255f62ef12 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:28.964057 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a2faa-45ba-4cc9-9a94-8ad5aad876c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:28.964834 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a2faa-45ba-4cc9-9a94-8ad5aad876c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:28.965210 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a2faa-45ba-4cc9-9a94-8ad5aad876c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:28.966105 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a2faa-45ba-4cc9-9a94-8ad5aad876c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:28.967566 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712a2faa-45ba-4cc9-9a94-8ad5aad876c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:10:28.967984 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712a2faa-45ba-4cc9-9a94-8ad5aad876c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:28.970212 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712a2faa-45ba-4cc9-9a94-8ad5aad876c5 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:28.992140 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 698/1399] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:10:28 2022] POST /identity/v3/projects => generated 385 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:10:28.993425 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de892f6-3247-4a35-ae2f-87134493e5fe admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:29.012154 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 702/1400] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 11:10:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:10:29.014926 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a2faa-45ba-4cc9-9a94-8ad5aad876c5 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:29.037460 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a2faa-45ba-4cc9-9a94-8ad5aad876c5 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:29.142669 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eede574-895b-4196-841f-89b92dca0ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:29.143601 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eede574-895b-4196-841f-89b92dca0ac0 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:29.143944 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eede574-895b-4196-841f-89b92dca0ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:29.144248 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eede574-895b-4196-841f-89b92dca0ac0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:29.145274 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eede574-895b-4196-841f-89b92dca0ac0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:29.148011 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eede574-895b-4196-841f-89b92dca0ac0 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:29.226374 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:29.261044 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 703/1401] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:10:29 2022] POST /identity/v3/projects => generated 367 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:10:29.262473 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eede574-895b-4196-841f-89b92dca0ac0 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:29.264692 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-2eede574-895b-4196-841f-89b92dca0ac0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:29.434533 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eede574-895b-4196-841f-89b92dca0ac0 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:29.446585 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17dcd3c-2606-439a-8b03-0c61b663f3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:29.454726 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17dcd3c-2606-439a-8b03-0c61b663f3b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:29.455517 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17dcd3c-2606-439a-8b03-0c61b663f3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:29.456009 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17dcd3c-2606-439a-8b03-0c61b663f3b4 admin admin] PATH_INFO: `/v3/projects/e522f7d57d4f48059325b3607bb05756` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:29.459589 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17dcd3c-2606-439a-8b03-0c61b663f3b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e522f7d57d4f48059325b3607bb05756)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:29.462904 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17dcd3c-2606-439a-8b03-0c61b663f3b4 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:29.568587 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de892f6-3247-4a35-ae2f-87134493e5fe admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:29.628683 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-a17dcd3c-2606-439a-8b03-0c61b663f3b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e522f7d57d4f48059325b3607bb05756', 'request_id': 'req-a17dcd3c-2606-439a-8b03-0c61b663f3b4'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:29.650776 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-a17dcd3c-2606-439a-8b03-0c61b663f3b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e522f7d57d4f48059325b3607bb05756', 'request_id': 'req-a17dcd3c-2606-439a-8b03-0c61b663f3b4'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:29.657780 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5d31cf-87c7-4c42-b669-a34961dfa20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:29.658843 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d31cf-87c7-4c42-b669-a34961dfa20a admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:29.659160 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d31cf-87c7-4c42-b669-a34961dfa20a admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:29.659653 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d31cf-87c7-4c42-b669-a34961dfa20a admin admin] PATH_INFO: `/v3/users` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:29.660783 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5d31cf-87c7-4c42-b669-a34961dfa20a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:29.663800 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5d31cf-87c7-4c42-b669-a34961dfa20a admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:29.665137 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-a17dcd3c-2606-439a-8b03-0c61b663f3b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e522f7d57d4f48059325b3607bb05756', 'request_id': 'req-a17dcd3c-2606-439a-8b03-0c61b663f3b4'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:29.698153 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 699/1402] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:10:28 2022] POST /identity/v3/users => generated 299 bytes in 705 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:10:29.699074 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5d31cf-87c7-4c42-b669-a34961dfa20a admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:29.713314 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5d31cf-87c7-4c42-b669-a34961dfa20a admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:29.718714 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-a17dcd3c-2606-439a-8b03-0c61b663f3b4 admin admin] The token cache is being invalidate because project e522f7d57d4f48059325b3607bb05756 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:10:29.719421 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-a17dcd3c-2606-439a-8b03-0c61b663f3b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:29.722161 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-a17dcd3c-2606-439a-8b03-0c61b663f3b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:29.728053 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfcefcd-e82d-4625-a49a-10fce3cf93da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:29.728875 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfcefcd-e82d-4625-a49a-10fce3cf93da admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:29.729314 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfcefcd-e82d-4625-a49a-10fce3cf93da admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:29.729588 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfcefcd-e82d-4625-a49a-10fce3cf93da admin admin] PATH_INFO: `/v3/users` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:29.730212 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 704/1403] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:10:29 2022] DELETE /identity/v3/projects/e522f7d57d4f48059325b3607bb05756 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:10:29.733101 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17dcd3c-2606-439a-8b03-0c61b663f3b4 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:29.734433 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfcefcd-e82d-4625-a49a-10fce3cf93da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:29.742901 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfcefcd-e82d-4625-a49a-10fce3cf93da admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:29.746170 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-a17dcd3c-2606-439a-8b03-0c61b663f3b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:29.784680 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 700/1404] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:10:29 2022] POST /identity/v3/users => generated 284 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:10:29.786065 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfcefcd-e82d-4625-a49a-10fce3cf93da admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:29.788713 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17dcd3c-2606-439a-8b03-0c61b663f3b4 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:29.790771 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-ddfcefcd-e82d-4625-a49a-10fce3cf93da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:29.801173 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62ef96b-bd50-4516-a96c-c65bd4bcb26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:29.802209 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:29.802867 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62ef96b-bd50-4516-a96c-c65bd4bcb26f admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:29.803160 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62ef96b-bd50-4516-a96c-c65bd4bcb26f admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:29.805430 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62ef96b-bd50-4516-a96c-c65bd4bcb26f admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:29.806410 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62ef96b-bd50-4516-a96c-c65bd4bcb26f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:29.808161 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfcefcd-e82d-4625-a49a-10fce3cf93da admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:29.817553 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62ef96b-bd50-4516-a96c-c65bd4bcb26f admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:29.818655 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a739f022-65ea-4a9d-b91b-741bd0a71b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:29.819803 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a739f022-65ea-4a9d-b91b-741bd0a71b05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:29.819803 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a739f022-65ea-4a9d-b91b-741bd0a71b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:29.822052 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a739f022-65ea-4a9d-b91b-741bd0a71b05 admin admin] PATH_INFO: `/v3/users/40cee429ccf740e38ee817309fc5ec01` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:29.825320 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a739f022-65ea-4a9d-b91b-741bd0a71b05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40cee429ccf740e38ee817309fc5ec01)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:29.827471 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a739f022-65ea-4a9d-b91b-741bd0a71b05 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:29.841720 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 705/1405] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:10:29 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:10:29.843602 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62ef96b-bd50-4516-a96c-c65bd4bcb26f admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:29.847624 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-b62ef96b-bd50-4516-a96c-c65bd4bcb26f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:29.880326 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62ef96b-bd50-4516-a96c-c65bd4bcb26f admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:29.899731 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36c1f5c-0401-4351-ae33-b9c03464b0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:29.900501 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c1f5c-0401-4351-ae33-b9c03464b0e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:29.900827 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c1f5c-0401-4351-ae33-b9c03464b0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:29.901311 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c1f5c-0401-4351-ae33-b9c03464b0e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:29.902088 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36c1f5c-0401-4351-ae33-b9c03464b0e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:29.904477 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36c1f5c-0401-4351-ae33-b9c03464b0e1 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:29.928823 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 706/1406] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:10:29 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:10:29.932859 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36c1f5c-0401-4351-ae33-b9c03464b0e1 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:29.938699 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-a739f022-65ea-4a9d-b91b-741bd0a71b05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40cee429ccf740e38ee817309fc5ec01'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:29.947799 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36c1f5c-0401-4351-ae33-b9c03464b0e1 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:29.951947 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-a739f022-65ea-4a9d-b91b-741bd0a71b05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40cee429ccf740e38ee817309fc5ec01'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:29.954619 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-a739f022-65ea-4a9d-b91b-741bd0a71b05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40cee429ccf740e38ee817309fc5ec01'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:29.960819 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-a739f022-65ea-4a9d-b91b-741bd0a71b05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40cee429ccf740e38ee817309fc5ec01'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:29.975717 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d2710e-96f5-4ce7-8e42-50afce6c4085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:29.976582 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d2710e-96f5-4ce7-8e42-50afce6c4085 admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:29.976884 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d2710e-96f5-4ce7-8e42-50afce6c4085 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:29.977281 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d2710e-96f5-4ce7-8e42-50afce6c4085 admin admin] PATH_INFO: `/v3/projects/2fe2a8c4380c4508b6a23a474b79e2d7/users/c2d0aac38b044572ac100aa2183d8478/roles/ea564961b1db4eb4a1d4d880964611b2` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:29.987365 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-a739f022-65ea-4a9d-b91b-741bd0a71b05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40cee429ccf740e38ee817309fc5ec01'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:30.023784 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 701/1407] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:10:29 2022] DELETE /identity/v3/users/40cee429ccf740e38ee817309fc5ec01 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:10:30.024754 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a739f022-65ea-4a9d-b91b-741bd0a71b05 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:30.028771 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-a739f022-65ea-4a9d-b91b-741bd0a71b05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:30.031067 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d2710e-96f5-4ce7-8e42-50afce6c4085 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fe2a8c4380c4508b6a23a474b79e2d7, user_id=c2d0aac38b044572ac100aa2183d8478, role_id=ea564961b1db4eb4a1d4d880964611b2)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:30.040361 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d2710e-96f5-4ce7-8e42-50afce6c4085 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:30.072577 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 707/1408] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:10:29 2022] PUT /identity/v3/projects/2fe2a8c4380c4508b6a23a474b79e2d7/users/c2d0aac38b044572ac100aa2183d8478/roles/ea564961b1db4eb4a1d4d880964611b2 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:10:30.076370 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d2710e-96f5-4ce7-8e42-50afce6c4085 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:30.079536 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-e1d2710e-96f5-4ce7-8e42-50afce6c4085 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:30.185589 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a739f022-65ea-4a9d-b91b-741bd0a71b05 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:30.188474 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:30.227408 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d2710e-96f5-4ce7-8e42-50afce6c4085 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:30.240463 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa46ea0-59d7-4d1e-b003-f9fe97fc216e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:30.241204 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa46ea0-59d7-4d1e-b003-f9fe97fc216e admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:30.241584 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa46ea0-59d7-4d1e-b003-f9fe97fc216e admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:30.242481 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa46ea0-59d7-4d1e-b003-f9fe97fc216e admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:30.243343 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa46ea0-59d7-4d1e-b003-f9fe97fc216e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:30.245508 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa46ea0-59d7-4d1e-b003-f9fe97fc216e admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:30.272196 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 708/1409] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:10:30 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 13 11:10:30.276148 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa46ea0-59d7-4d1e-b003-f9fe97fc216e admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:30.307464 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa46ea0-59d7-4d1e-b003-f9fe97fc216e admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:30.323514 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326eb457-712e-467b-b476-aa2abd3f02d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:30.324864 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326eb457-712e-467b-b476-aa2abd3f02d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:30.325848 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326eb457-712e-467b-b476-aa2abd3f02d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:30.326082 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326eb457-712e-467b-b476-aa2abd3f02d2 admin admin] PATH_INFO: `/v3/projects/2fe2a8c4380c4508b6a23a474b79e2d7/users/c2d0aac38b044572ac100aa2183d8478/roles/ea564961b1db4eb4a1d4d880964611b2` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:30.337125 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e751160-9cff-4ea4-97c6-05aca799bea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:30.337903 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e751160-9cff-4ea4-97c6-05aca799bea2 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:30.338213 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e751160-9cff-4ea4-97c6-05aca799bea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:30.338488 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e751160-9cff-4ea4-97c6-05aca799bea2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:30.341544 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e751160-9cff-4ea4-97c6-05aca799bea2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:30.343391 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326eb457-712e-467b-b476-aa2abd3f02d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fe2a8c4380c4508b6a23a474b79e2d7, user_id=c2d0aac38b044572ac100aa2183d8478, role_id=ea564961b1db4eb4a1d4d880964611b2)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:30.344637 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e751160-9cff-4ea4-97c6-05aca799bea2 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:30.353174 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326eb457-712e-467b-b476-aa2abd3f02d2 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:30.375813 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 702/1410] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:10:30 2022] GET /identity/v3/roles => generated 1420 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:10:30.386976 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e751160-9cff-4ea4-97c6-05aca799bea2 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:30.405599 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e751160-9cff-4ea4-97c6-05aca799bea2 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:30.421724 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 709/1411] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:10:30 2022] PUT /identity/v3/projects/2fe2a8c4380c4508b6a23a474b79e2d7/users/c2d0aac38b044572ac100aa2183d8478/roles/ea564961b1db4eb4a1d4d880964611b2 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 11:10:30.435308 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42014065-c9f2-4c15-b152-f50d0d9c46eb None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:30.435999 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42014065-c9f2-4c15-b152-f50d0d9c46eb None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:30.435999 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42014065-c9f2-4c15-b152-f50d0d9c46eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:30.488689 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:30.525268 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-42014065-c9f2-4c15-b152-f50d0d9c46eb None None] MFA Rules not processed for user `c2d0aac38b044572ac100aa2183d8478`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:30.530907 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-42014065-c9f2-4c15-b152-f50d0d9c46eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:30.642847 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f154c62b-ff6f-4f62-86b7-3850c0b88d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:30.643552 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154c62b-ff6f-4f62-86b7-3850c0b88d90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:30.643827 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154c62b-ff6f-4f62-86b7-3850c0b88d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:30.644105 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154c62b-ff6f-4f62-86b7-3850c0b88d90 admin admin] PATH_INFO: `/v3/projects/278b8bd8b54845f8a3b0458e83adc161/users/399a003fd08c424a99133c48344813ab/roles/7c3871c0ab68438b9014489d50b53a22` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:30.666829 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f154c62b-ff6f-4f62-86b7-3850c0b88d90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=278b8bd8b54845f8a3b0458e83adc161, user_id=399a003fd08c424a99133c48344813ab, role_id=7c3871c0ab68438b9014489d50b53a22)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:30.670820 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f154c62b-ff6f-4f62-86b7-3850c0b88d90 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:30.692311 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 703/1412] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:10:30 2022] PUT /identity/v3/projects/278b8bd8b54845f8a3b0458e83adc161/users/399a003fd08c424a99133c48344813ab/roles/7c3871c0ab68438b9014489d50b53a22 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 11:10:30.710385 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f35ae7-71d2-44a7-86b5-15109fd8f626 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:30.710693 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f35ae7-71d2-44a7-86b5-15109fd8f626 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:30.710929 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f35ae7-71d2-44a7-86b5-15109fd8f626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:30.816015 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 710/1413] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:30 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 11:10:30.830254 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42014065-c9f2-4c15-b152-f50d0d9c46eb None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:30.840776 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-42014065-c9f2-4c15-b152-f50d0d9c46eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:30.886889 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-f0f35ae7-71d2-44a7-86b5-15109fd8f626 None None] MFA Rules not processed for user `399a003fd08c424a99133c48344813ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:30.889535 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-f0f35ae7-71d2-44a7-86b5-15109fd8f626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:31.047312 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42014065-c9f2-4c15-b152-f50d0d9c46eb None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:31.153585 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 704/1414] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 448 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:31.155401 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2929cc-015e-4bcf-a1f8-1cfe555aadab None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:31.155876 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2929cc-015e-4bcf-a1f8-1cfe555aadab None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:31.156329 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2929cc-015e-4bcf-a1f8-1cfe555aadab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:31.227683 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d9fe62-46bd-4c56-9de5-f6f47795c5ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f4c2fc51f54f0e977648b13efaed1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:31.228326 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d9fe62-46bd-4c56-9de5-f6f47795c5ea service cinder] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:31.228602 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d9fe62-46bd-4c56-9de5-f6f47795c5ea service cinder] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:31.228872 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d9fe62-46bd-4c56-9de5-f6f47795c5ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:31.264258 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-ea2929cc-015e-4bcf-a1f8-1cfe555aadab None None] MFA Rules not processed for user `a9f5926b1dad45b1bb81745b772d3920`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:31.267694 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-ea2929cc-015e-4bcf-a1f8-1cfe555aadab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:31.306932 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:31.417325 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d9fe62-46bd-4c56-9de5-f6f47795c5ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:31.418957 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d9fe62-46bd-4c56-9de5-f6f47795c5ea service cinder] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:31.443743 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 711/1415] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:10:30 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 613 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:10:31.444694 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d9fe62-46bd-4c56-9de5-f6f47795c5ea service cinder] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:31.450551 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 705/1416] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:31 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:31.454397 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-f7d9fe62-46bd-4c56-9de5-f6f47795c5ea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:31.455104 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2929cc-015e-4bcf-a1f8-1cfe555aadab None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:31.532510 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:31.595281 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d9fe62-46bd-4c56-9de5-f6f47795c5ea service cinder] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:31.601359 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8692a7-6802-40ac-88a1-1ccec5e6763e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:31.602355 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8692a7-6802-40ac-88a1-1ccec5e6763e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:31.602668 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8692a7-6802-40ac-88a1-1ccec5e6763e admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:31.603112 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8692a7-6802-40ac-88a1-1ccec5e6763e admin admin] PATH_INFO: `/v3/projects/0576ca0aded64e92ac2367e48eb013f5` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:31.604679 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8692a7-6802-40ac-88a1-1ccec5e6763e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0576ca0aded64e92ac2367e48eb013f5)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:31.606800 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8692a7-6802-40ac-88a1-1ccec5e6763e admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:31.628686 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2929cc-015e-4bcf-a1f8-1cfe555aadab None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:31.633677 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8698c1-0ffd-42a8-848f-fa803cf1d4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:31.634334 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8698c1-0ffd-42a8-848f-fa803cf1d4d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:31.634618 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8698c1-0ffd-42a8-848f-fa803cf1d4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:31.634891 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8698c1-0ffd-42a8-848f-fa803cf1d4d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:31.635536 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8698c1-0ffd-42a8-848f-fa803cf1d4d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:31.639443 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8698c1-0ffd-42a8-848f-fa803cf1d4d1 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:31.698732 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 706/1417] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:10:31 2022] POST /identity/v3/projects => generated 367 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:10:31.700296 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8698c1-0ffd-42a8-848f-fa803cf1d4d1 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:31.704711 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-4d8698c1-0ffd-42a8-848f-fa803cf1d4d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:31.742188 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-dd8692a7-6802-40ac-88a1-1ccec5e6763e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0576ca0aded64e92ac2367e48eb013f5', 'request_id': 'req-dd8692a7-6802-40ac-88a1-1ccec5e6763e'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:31.759006 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-dd8692a7-6802-40ac-88a1-1ccec5e6763e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0576ca0aded64e92ac2367e48eb013f5', 'request_id': 'req-dd8692a7-6802-40ac-88a1-1ccec5e6763e'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:31.768761 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-dd8692a7-6802-40ac-88a1-1ccec5e6763e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0576ca0aded64e92ac2367e48eb013f5', 'request_id': 'req-dd8692a7-6802-40ac-88a1-1ccec5e6763e'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:31.786380 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-dd8692a7-6802-40ac-88a1-1ccec5e6763e admin admin] The token cache is being invalidate because project 0576ca0aded64e92ac2367e48eb013f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:10:31.787440 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-dd8692a7-6802-40ac-88a1-1ccec5e6763e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:31.788221 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-dd8692a7-6802-40ac-88a1-1ccec5e6763e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:31.790321 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 712/1418] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:10:31 2022] DELETE /identity/v3/projects/0576ca0aded64e92ac2367e48eb013f5 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:10:31.791263 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8692a7-6802-40ac-88a1-1ccec5e6763e admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:31.792822 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-dd8692a7-6802-40ac-88a1-1ccec5e6763e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:31.851156 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8698c1-0ffd-42a8-848f-fa803cf1d4d1 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:31.941334 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:31.990968 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8692a7-6802-40ac-88a1-1ccec5e6763e admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:31.998844 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90daaf8-3d2b-4b9e-b482-2bd1f0bced22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:31.999777 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90daaf8-3d2b-4b9e-b482-2bd1f0bced22 admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:32.000346 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90daaf8-3d2b-4b9e-b482-2bd1f0bced22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:32.001652 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90daaf8-3d2b-4b9e-b482-2bd1f0bced22 admin admin] PATH_INFO: `/v3/projects` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:32.002505 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33c9d78-7d92-4d18-aac2-dd1f01064763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:32.003149 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90daaf8-3d2b-4b9e-b482-2bd1f0bced22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:32.003895 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c9d78-7d92-4d18-aac2-dd1f01064763 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:32.006889 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90daaf8-3d2b-4b9e-b482-2bd1f0bced22 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:32.007217 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c9d78-7d92-4d18-aac2-dd1f01064763 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:32.007863 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c9d78-7d92-4d18-aac2-dd1f01064763 admin admin] PATH_INFO: `/v3/users/e8b80a7931874e01aba0d6df3c52a506` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:32.010198 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33c9d78-7d92-4d18-aac2-dd1f01064763 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8b80a7931874e01aba0d6df3c52a506)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:32.014118 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33c9d78-7d92-4d18-aac2-dd1f01064763 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:32.076878 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 707/1419] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:10:31 2022] POST /identity/v3/projects => generated 405 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:10:32.078441 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9374271-aa1c-4e30-ae50-34e082aca277 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:32.078740 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9374271-aa1c-4e30-ae50-34e082aca277 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:32.079011 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9374271-aa1c-4e30-ae50-34e082aca277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:32.156281 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-f33c9d78-7d92-4d18-aac2-dd1f01064763 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8b80a7931874e01aba0d6df3c52a506'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:32.163318 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-f33c9d78-7d92-4d18-aac2-dd1f01064763 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8b80a7931874e01aba0d6df3c52a506'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:32.164449 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-f33c9d78-7d92-4d18-aac2-dd1f01064763 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8b80a7931874e01aba0d6df3c52a506'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:32.168896 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-b9374271-aa1c-4e30-ae50-34e082aca277 None None] MFA Rules not processed for user `3b8d890413d4480d96ce9c9be80076d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:32.174535 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-b9374271-aa1c-4e30-ae50-34e082aca277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:32.200720 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-f33c9d78-7d92-4d18-aac2-dd1f01064763 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8b80a7931874e01aba0d6df3c52a506'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:32.221601 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-f33c9d78-7d92-4d18-aac2-dd1f01064763 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8b80a7931874e01aba0d6df3c52a506'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:32.251491 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 713/1420] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:10:31 2022] DELETE /identity/v3/users/e8b80a7931874e01aba0d6df3c52a506 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:10:32.252331 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33c9d78-7d92-4d18-aac2-dd1f01064763 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:32.257226 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-f33c9d78-7d92-4d18-aac2-dd1f01064763 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:32.268142 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:32.375476 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 708/1421] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:32 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:32.377422 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4126d82-34d4-4abd-9e29-6978d65ce9bb None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:32.377721 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4126d82-34d4-4abd-9e29-6978d65ce9bb None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:32.378109 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4126d82-34d4-4abd-9e29-6978d65ce9bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:32.422921 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-d4126d82-34d4-4abd-9e29-6978d65ce9bb None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:32.424157 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-d4126d82-34d4-4abd-9e29-6978d65ce9bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:32.445738 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 709/1422] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:32.446718 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4126d82-34d4-4abd-9e29-6978d65ce9bb None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:32.453322 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-d4126d82-34d4-4abd-9e29-6978d65ce9bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:32.454722 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33c9d78-7d92-4d18-aac2-dd1f01064763 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:32.468266 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4126d82-34d4-4abd-9e29-6978d65ce9bb None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:32.473157 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab8c5f5-8e93-455e-8ffb-f82017199437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:32.473779 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab8c5f5-8e93-455e-8ffb-f82017199437 admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:32.474154 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab8c5f5-8e93-455e-8ffb-f82017199437 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:32.474433 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab8c5f5-8e93-455e-8ffb-f82017199437 admin admin] PATH_INFO: `/v3/users` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:32.475359 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab8c5f5-8e93-455e-8ffb-f82017199437 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:32.477829 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab8c5f5-8e93-455e-8ffb-f82017199437 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:32.478902 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b8377-b1fd-4d0d-b4b7-2674bb940a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:32.479538 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b8377-b1fd-4d0d-b4b7-2674bb940a6d admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:32.479817 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b8377-b1fd-4d0d-b4b7-2674bb940a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:32.480090 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b8377-b1fd-4d0d-b4b7-2674bb940a6d admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:32.487261 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897b8377-b1fd-4d0d-b4b7-2674bb940a6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:32.490479 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897b8377-b1fd-4d0d-b4b7-2674bb940a6d admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:32.530160 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 710/1423] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:10:32 2022] POST /identity/v3/users => generated 309 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:10:32.536343 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ceea2-6b03-4c80-902c-3fec5c9b598b None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:32.536767 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 714/1424] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:10:32 2022] POST /identity/v3/users => generated 290 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:10:32.537089 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ceea2-6b03-4c80-902c-3fec5c9b598b None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:32.537586 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ceea2-6b03-4c80-902c-3fec5c9b598b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:32.537755 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b8377-b1fd-4d0d-b4b7-2674bb940a6d admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:32.539844 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-897b8377-b1fd-4d0d-b4b7-2674bb940a6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:32.573356 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-278ceea2-6b03-4c80-902c-3fec5c9b598b None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:32.574632 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-278ceea2-6b03-4c80-902c-3fec5c9b598b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:32.587569 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 711/1425] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:32.588984 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e964f04-ea46-4625-bbad-c384c2e3a793 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:32.589271 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e964f04-ea46-4625-bbad-c384c2e3a793 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:32.589605 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e964f04-ea46-4625-bbad-c384c2e3a793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:32.657929 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-4e964f04-ea46-4625-bbad-c384c2e3a793 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:32.662907 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-4e964f04-ea46-4625-bbad-c384c2e3a793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:32.685691 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 712/1426] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:32.687468 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e964f04-ea46-4625-bbad-c384c2e3a793 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:32.702518 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:32.712524 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e964f04-ea46-4625-bbad-c384c2e3a793 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:32.724362 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30a85a8-fe81-4355-b62e-b6eca1251d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:32.725199 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a85a8-fe81-4355-b62e-b6eca1251d15 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:32.725627 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a85a8-fe81-4355-b62e-b6eca1251d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:32.726069 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a85a8-fe81-4355-b62e-b6eca1251d15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:32.726880 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30a85a8-fe81-4355-b62e-b6eca1251d15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:32.731562 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30a85a8-fe81-4355-b62e-b6eca1251d15 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:32.759697 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 713/1427] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:10:32.760169 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30a85a8-fe81-4355-b62e-b6eca1251d15 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:32.772864 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b8377-b1fd-4d0d-b4b7-2674bb940a6d admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:32.787331 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47549f58-4b6d-47e5-bb80-6edcc0506230 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78384fbffdd346578855e7214b335d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:32.787969 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47549f58-4b6d-47e5-bb80-6edcc0506230 service nova] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:32.788264 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47549f58-4b6d-47e5-bb80-6edcc0506230 service nova] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:32.788614 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47549f58-4b6d-47e5-bb80-6edcc0506230 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:32.798264 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30a85a8-fe81-4355-b62e-b6eca1251d15 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:32.819274 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22e6a06-14a8-4f43-9160-94fb907474a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:32.820023 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e6a06-14a8-4f43-9160-94fb907474a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:32.820316 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e6a06-14a8-4f43-9160-94fb907474a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:32.820590 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e6a06-14a8-4f43-9160-94fb907474a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:32.821257 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22e6a06-14a8-4f43-9160-94fb907474a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:32.829380 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22e6a06-14a8-4f43-9160-94fb907474a2 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:32.854303 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 714/1428] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:10:32.855583 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22e6a06-14a8-4f43-9160-94fb907474a2 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:32.863563 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-f22e6a06-14a8-4f43-9160-94fb907474a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:32.985554 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47549f58-4b6d-47e5-bb80-6edcc0506230 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:32.988927 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47549f58-4b6d-47e5-bb80-6edcc0506230 service nova] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:32.990472 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22e6a06-14a8-4f43-9160-94fb907474a2 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:33.002157 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55802fe1-f62b-4222-8b56-ec86f9ce2fa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:33.002782 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55802fe1-f62b-4222-8b56-ec86f9ce2fa0 service neutron] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:33.003169 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55802fe1-f62b-4222-8b56-ec86f9ce2fa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:33.003324 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55802fe1-f62b-4222-8b56-ec86f9ce2fa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:33.027983 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55802fe1-f62b-4222-8b56-ec86f9ce2fa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:33.029643 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55802fe1-f62b-4222-8b56-ec86f9ce2fa0 service neutron] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:33.031481 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 715/1429] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:10:32 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:10:33.033102 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c85687c-d76f-4f87-a066-7880e3051199 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:33.038898 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c85687c-d76f-4f87-a066-7880e3051199 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:33.044470 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c85687c-d76f-4f87-a066-7880e3051199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:33.051816 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 715/1430] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:10:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:10:33.071921 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55802fe1-f62b-4222-8b56-ec86f9ce2fa0 service neutron] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:33.107601 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55802fe1-f62b-4222-8b56-ec86f9ce2fa0 service neutron] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:33.119579 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-6c85687c-d76f-4f87-a066-7880e3051199 None None] MFA Rules not processed for user `1674289511b749d4b23c4441714e437d`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:33.123954 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-6c85687c-d76f-4f87-a066-7880e3051199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:33.126242 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eef3e4-0881-4c1e-af6c-02839201bc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:33.127517 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eef3e4-0881-4c1e-af6c-02839201bc87 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:33.128998 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eef3e4-0881-4c1e-af6c-02839201bc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:33.130381 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eef3e4-0881-4c1e-af6c-02839201bc87 admin admin] PATH_INFO: `/v3/domains` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:33.133106 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eef3e4-0881-4c1e-af6c-02839201bc87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:10:33.133430 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eef3e4-0881-4c1e-af6c-02839201bc87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:33.141585 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eef3e4-0881-4c1e-af6c-02839201bc87 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:33.193599 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 716/1431] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 11:10:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:10:33.193599 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14047ecc-a5a7-48af-8809-f8a4c25a4154 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:33.193599 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14047ecc-a5a7-48af-8809-f8a4c25a4154 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:33.196602 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14047ecc-a5a7-48af-8809-f8a4c25a4154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:33.291895 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 716/1432] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:33 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:33.295152 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c85687c-d76f-4f87-a066-7880e3051199 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:33.332372 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c85687c-d76f-4f87-a066-7880e3051199 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:33.344148 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e79694-fc04-48ee-8a77-9a1621d783b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:33.346515 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e79694-fc04-48ee-8a77-9a1621d783b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:33.346693 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e79694-fc04-48ee-8a77-9a1621d783b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:33.346974 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e79694-fc04-48ee-8a77-9a1621d783b9 admin admin] PATH_INFO: `/v3/projects/2a303078645a485f91263b3374fafaa6/users/be133261e57e40728cb4e594041e54d8/roles/ea564961b1db4eb4a1d4d880964611b2` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:33.389500 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-14047ecc-a5a7-48af-8809-f8a4c25a4154 None None] MFA Rules not processed for user `6e803a9cc6114c4f93869e50bca313e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:33.394014 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-14047ecc-a5a7-48af-8809-f8a4c25a4154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:33.409739 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e79694-fc04-48ee-8a77-9a1621d783b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a303078645a485f91263b3374fafaa6, user_id=be133261e57e40728cb4e594041e54d8, role_id=ea564961b1db4eb4a1d4d880964611b2)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:33.429703 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e79694-fc04-48ee-8a77-9a1621d783b9 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:33.480323 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:33.498600 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 717/1433] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:10:33 2022] PUT /identity/v3/projects/2a303078645a485f91263b3374fafaa6/users/be133261e57e40728cb4e594041e54d8/roles/ea564961b1db4eb4a1d4d880964611b2 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:10:33.511460 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e79694-fc04-48ee-8a77-9a1621d783b9 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:33.603948 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 717/1434] 10.222.0.25 () {58 vars in 1009 bytes} [Thu Oct 13 11:10:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 413 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:33.604936 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14047ecc-a5a7-48af-8809-f8a4c25a4154 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:33.645826 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14047ecc-a5a7-48af-8809-f8a4c25a4154 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:33.761695 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e79694-fc04-48ee-8a77-9a1621d783b9 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:33.773324 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c0d4eb-3ae4-416f-9143-5f0d33fe82db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:33.774698 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c0d4eb-3ae4-416f-9143-5f0d33fe82db admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:33.774979 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c0d4eb-3ae4-416f-9143-5f0d33fe82db admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:33.775253 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c0d4eb-3ae4-416f-9143-5f0d33fe82db admin admin] PATH_INFO: `/v3/projects/a805733b7a1049a488ec8df773bcc823/users/fcb936e4f71e48bc9eac7a4f9c4f0569/roles/ea564961b1db4eb4a1d4d880964611b2` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:33.780416 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:33.812343 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c0d4eb-3ae4-416f-9143-5f0d33fe82db admin admin] RBAC: Authorizing `identity:create_grant(project_id=a805733b7a1049a488ec8df773bcc823, user_id=fcb936e4f71e48bc9eac7a4f9c4f0569, role_id=ea564961b1db4eb4a1d4d880964611b2)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:33.819300 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfb93bc-4017-4fd4-97d0-6f244c853459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:33.819952 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c0d4eb-3ae4-416f-9143-5f0d33fe82db admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:33.820063 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb93bc-4017-4fd4-97d0-6f244c853459 admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:33.820690 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb93bc-4017-4fd4-97d0-6f244c853459 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:33.821029 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb93bc-4017-4fd4-97d0-6f244c853459 admin admin] PATH_INFO: `/v3/projects` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:33.821810 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfb93bc-4017-4fd4-97d0-6f244c853459 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:33.824251 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfb93bc-4017-4fd4-97d0-6f244c853459 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:33.847962 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 718/1435] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:10:33 2022] PUT /identity/v3/projects/a805733b7a1049a488ec8df773bcc823/users/fcb936e4f71e48bc9eac7a4f9c4f0569/roles/ea564961b1db4eb4a1d4d880964611b2 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:10:33.849286 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74286384-245c-4a93-9049-ab7844578a4b None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:33.849568 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74286384-245c-4a93-9049-ab7844578a4b None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:33.849840 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74286384-245c-4a93-9049-ab7844578a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:33.946908 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 718/1436] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:10:33 2022] POST /identity/v3/projects => generated 357 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:10:33.948078 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfb93bc-4017-4fd4-97d0-6f244c853459 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:33.959179 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-74286384-245c-4a93-9049-ab7844578a4b None None] MFA Rules not processed for user `1674289511b749d4b23c4441714e437d`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:33.965526 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-74286384-245c-4a93-9049-ab7844578a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:34.128102 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 719/1437] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:33 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:34.129221 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74286384-245c-4a93-9049-ab7844578a4b None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:34.131409 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfb93bc-4017-4fd4-97d0-6f244c853459 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:34.153996 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65acf843-643e-4398-9f0c-925d9fefad78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:34.154896 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65acf843-643e-4398-9f0c-925d9fefad78 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:34.155323 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65acf843-643e-4398-9f0c-925d9fefad78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:34.156236 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65acf843-643e-4398-9f0c-925d9fefad78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:34.157223 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65acf843-643e-4398-9f0c-925d9fefad78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:34.159170 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65acf843-643e-4398-9f0c-925d9fefad78 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:34.162034 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74286384-245c-4a93-9049-ab7844578a4b None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:34.175680 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c3b538-c12a-495c-816f-e8a515b87d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:34.178552 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c3b538-c12a-495c-816f-e8a515b87d9c admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:34.179910 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c3b538-c12a-495c-816f-e8a515b87d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:34.180341 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c3b538-c12a-495c-816f-e8a515b87d9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:34.182119 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c3b538-c12a-495c-816f-e8a515b87d9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:34.187354 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c3b538-c12a-495c-816f-e8a515b87d9c admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:34.190662 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 719/1438] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:10:33 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:10:34.191724 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65acf843-643e-4398-9f0c-925d9fefad78 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:34.199582 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-65acf843-643e-4398-9f0c-925d9fefad78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:34.218885 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 720/1439] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:10:34 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:10:34.222116 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c3b538-c12a-495c-816f-e8a515b87d9c admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:34.248609 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c3b538-c12a-495c-816f-e8a515b87d9c admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:34.263097 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7079b435-3221-4794-927f-8719f294132b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:34.263725 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7079b435-3221-4794-927f-8719f294132b admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:34.263999 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7079b435-3221-4794-927f-8719f294132b admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:34.264269 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7079b435-3221-4794-927f-8719f294132b admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:34.267826 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7079b435-3221-4794-927f-8719f294132b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:34.270030 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7079b435-3221-4794-927f-8719f294132b admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:34.341828 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 721/1440] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:10:34 2022] POST /identity/v3/users => generated 279 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:10:34.341828 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7079b435-3221-4794-927f-8719f294132b admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:34.375081 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:34.460988 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65acf843-643e-4398-9f0c-925d9fefad78 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:34.471135 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9569fb1-d4da-4154-a920-1dd9118b5da0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e24c779d0a604ef28dfc1235ee76a711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:34.471780 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9569fb1-d4da-4154-a920-1dd9118b5da0 service swift] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:34.472046 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9569fb1-d4da-4154-a920-1dd9118b5da0 service swift] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:34.472320 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9569fb1-d4da-4154-a920-1dd9118b5da0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:34.550186 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7079b435-3221-4794-927f-8719f294132b admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:34.564375 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf197e9-342b-4444-83dd-199bbd77c6eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78384fbffdd346578855e7214b335d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:34.565430 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf197e9-342b-4444-83dd-199bbd77c6eb service nova] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:34.566453 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf197e9-342b-4444-83dd-199bbd77c6eb service nova] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:34.566832 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf197e9-342b-4444-83dd-199bbd77c6eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:34.581782 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf197e9-342b-4444-83dd-199bbd77c6eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:34.586335 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf197e9-342b-4444-83dd-199bbd77c6eb service nova] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:34.593095 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9569fb1-d4da-4154-a920-1dd9118b5da0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:34.597221 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9569fb1-d4da-4154-a920-1dd9118b5da0 service swift] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:34.605652 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 722/1441] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:10:34 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:10:34.609910 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf197e9-342b-4444-83dd-199bbd77c6eb service nova] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:34.619963 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 720/1442] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Oct 13 11:10:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 13 11:10:34.629664 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9569fb1-d4da-4154-a920-1dd9118b5da0 service swift] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:34.640295 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf197e9-342b-4444-83dd-199bbd77c6eb service nova] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:34.659004 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9569fb1-d4da-4154-a920-1dd9118b5da0 service swift] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:34.666112 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3091a04-47e4-4d37-bb81-cff435d1dd60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:34.666674 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3091a04-47e4-4d37-bb81-cff435d1dd60 admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:34.667055 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3091a04-47e4-4d37-bb81-cff435d1dd60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:34.667420 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3091a04-47e4-4d37-bb81-cff435d1dd60 admin admin] PATH_INFO: `/v3/projects/2a303078645a485f91263b3374fafaa6/users/be133261e57e40728cb4e594041e54d8/roles/ea564961b1db4eb4a1d4d880964611b2` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:34.671600 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3091a04-47e4-4d37-bb81-cff435d1dd60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a303078645a485f91263b3374fafaa6, user_id=be133261e57e40728cb4e594041e54d8, role_id=ea564961b1db4eb4a1d4d880964611b2)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:34.686688 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4696bbd-8a50-4da6-b7cb-dd642e6c9aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:34.687350 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4696bbd-8a50-4da6-b7cb-dd642e6c9aaa admin admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:34.687630 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4696bbd-8a50-4da6-b7cb-dd642e6c9aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:34.687906 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4696bbd-8a50-4da6-b7cb-dd642e6c9aaa admin admin] PATH_INFO: `/v3/projects/a805733b7a1049a488ec8df773bcc823/users/fcb936e4f71e48bc9eac7a4f9c4f0569/roles/ea564961b1db4eb4a1d4d880964611b2` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:34.690669 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3091a04-47e4-4d37-bb81-cff435d1dd60 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:34.691520 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4696bbd-8a50-4da6-b7cb-dd642e6c9aaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=a805733b7a1049a488ec8df773bcc823, user_id=fcb936e4f71e48bc9eac7a4f9c4f0569, role_id=ea564961b1db4eb4a1d4d880964611b2)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:34.699434 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4696bbd-8a50-4da6-b7cb-dd642e6c9aaa admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:34.730078 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 723/1443] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:10:34 2022] PUT /identity/v3/projects/2a303078645a485f91263b3374fafaa6/users/be133261e57e40728cb4e594041e54d8/roles/ea564961b1db4eb4a1d4d880964611b2 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:10:34.732725 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3091a04-47e4-4d37-bb81-cff435d1dd60 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:34.742461 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 721/1444] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:10:34 2022] PUT /identity/v3/projects/a805733b7a1049a488ec8df773bcc823/users/fcb936e4f71e48bc9eac7a4f9c4f0569/roles/ea564961b1db4eb4a1d4d880964611b2 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:10:34.747790 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390726ea-29ff-40bc-92d4-11bdae4684c0 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:34.748110 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390726ea-29ff-40bc-92d4-11bdae4684c0 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:34.748418 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390726ea-29ff-40bc-92d4-11bdae4684c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:34.820969 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-390726ea-29ff-40bc-92d4-11bdae4684c0 None None] MFA Rules not processed for user `085e8bffed444287bc5f805461c3fb55`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:34.823018 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-390726ea-29ff-40bc-92d4-11bdae4684c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:34.857342 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:34.966755 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3091a04-47e4-4d37-bb81-cff435d1dd60 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:34.974837 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 722/1445] 10.222.0.30 () {58 vars in 1015 bytes} [Thu Oct 13 11:10:34 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:34.977921 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390726ea-29ff-40bc-92d4-11bdae4684c0 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:34.982572 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-390726ea-29ff-40bc-92d4-11bdae4684c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:35.259843 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390726ea-29ff-40bc-92d4-11bdae4684c0 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:35.266287 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af94043-b31b-4ab2-9526-baac7adcceab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:35.269191 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af94043-b31b-4ab2-9526-baac7adcceab admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:35.272292 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af94043-b31b-4ab2-9526-baac7adcceab admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:35.272692 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af94043-b31b-4ab2-9526-baac7adcceab admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:35.274241 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af94043-b31b-4ab2-9526-baac7adcceab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:35.281172 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721c98fc-4724-43af-8095-4c1268a76848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:35.283824 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c98fc-4724-43af-8095-4c1268a76848 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:35.284843 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c98fc-4724-43af-8095-4c1268a76848 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:35.288053 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c98fc-4724-43af-8095-4c1268a76848 admin admin] PATH_INFO: `/v3/projects/4a9e9f3eb4114858838c5385b11b7207` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:35.290059 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721c98fc-4724-43af-8095-4c1268a76848 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a9e9f3eb4114858838c5385b11b7207)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:35.306532 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af94043-b31b-4ab2-9526-baac7adcceab admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:35.306898 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721c98fc-4724-43af-8095-4c1268a76848 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:35.321598 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 724/1446] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:10:34 2022] GET /identity/v3/roles => generated 1420 bytes in 591 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:10:35.328896 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0143c179-6238-4be6-8d16-2f15d00f1ae1 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:35.329229 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0143c179-6238-4be6-8d16-2f15d00f1ae1 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:35.329509 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0143c179-6238-4be6-8d16-2f15d00f1ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:35.331774 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:35.467751 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-721c98fc-4724-43af-8095-4c1268a76848 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a9e9f3eb4114858838c5385b11b7207', 'request_id': 'req-721c98fc-4724-43af-8095-4c1268a76848'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:35.475529 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-0143c179-6238-4be6-8d16-2f15d00f1ae1 None None] MFA Rules not processed for user `fcb936e4f71e48bc9eac7a4f9c4f0569`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:35.476859 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-0143c179-6238-4be6-8d16-2f15d00f1ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:35.506069 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-721c98fc-4724-43af-8095-4c1268a76848 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a9e9f3eb4114858838c5385b11b7207', 'request_id': 'req-721c98fc-4724-43af-8095-4c1268a76848'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:35.536115 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-721c98fc-4724-43af-8095-4c1268a76848 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a9e9f3eb4114858838c5385b11b7207', 'request_id': 'req-721c98fc-4724-43af-8095-4c1268a76848'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:35.576700 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-721c98fc-4724-43af-8095-4c1268a76848 admin admin] The token cache is being invalidate because project 4a9e9f3eb4114858838c5385b11b7207 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:10:35.577651 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-721c98fc-4724-43af-8095-4c1268a76848 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:35.581298 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-721c98fc-4724-43af-8095-4c1268a76848 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:35.585433 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 723/1447] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:10:34 2022] DELETE /identity/v3/projects/4a9e9f3eb4114858838c5385b11b7207 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:10:35.589726 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721c98fc-4724-43af-8095-4c1268a76848 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:35.595320 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-721c98fc-4724-43af-8095-4c1268a76848 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:35.753435 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 725/1448] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:35 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 431 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:35.754517 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0143c179-6238-4be6-8d16-2f15d00f1ae1 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:35.757473 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-0143c179-6238-4be6-8d16-2f15d00f1ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:35.778961 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721c98fc-4724-43af-8095-4c1268a76848 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:35.794044 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b5805c-1cdd-41f7-a8fb-e4cc990e233a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:35.794770 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b5805c-1cdd-41f7-a8fb-e4cc990e233a service neutron] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:35.795169 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b5805c-1cdd-41f7-a8fb-e4cc990e233a service neutron] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:35.795324 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b5805c-1cdd-41f7-a8fb-e4cc990e233a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:35.800181 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-e6b5805c-1cdd-41f7-a8fb-e4cc990e233a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:35.824977 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b5805c-1cdd-41f7-a8fb-e4cc990e233a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:35.826569 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b5805c-1cdd-41f7-a8fb-e4cc990e233a service neutron] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:35.850019 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 724/1449] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:10:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:10:35.851005 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b5805c-1cdd-41f7-a8fb-e4cc990e233a service neutron] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:35.855325 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-e6b5805c-1cdd-41f7-a8fb-e4cc990e233a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:35.926312 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0143c179-6238-4be6-8d16-2f15d00f1ae1 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:35.946520 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f59e0d-28b1-4b64-9f9c-00a8b753715b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:35.947153 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f59e0d-28b1-4b64-9f9c-00a8b753715b admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:35.947483 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f59e0d-28b1-4b64-9f9c-00a8b753715b admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:35.947777 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f59e0d-28b1-4b64-9f9c-00a8b753715b admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:35.948699 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f59e0d-28b1-4b64-9f9c-00a8b753715b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:35.950520 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f59e0d-28b1-4b64-9f9c-00a8b753715b admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:35.952209 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:35.985331 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 726/1450] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:10:35 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:10:35.986207 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f59e0d-28b1-4b64-9f9c-00a8b753715b admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:35.993097 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-a6f59e0d-28b1-4b64-9f9c-00a8b753715b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:36.086389 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b5805c-1cdd-41f7-a8fb-e4cc990e233a service neutron] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:36.100694 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cf5c9d-af72-4808-a6c5-af838351c249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:36.101358 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cf5c9d-af72-4808-a6c5-af838351c249 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:36.101708 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cf5c9d-af72-4808-a6c5-af838351c249 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:36.102016 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cf5c9d-af72-4808-a6c5-af838351c249 admin admin] PATH_INFO: `/v3/users/c2d0aac38b044572ac100aa2183d8478` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:36.104221 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cf5c9d-af72-4808-a6c5-af838351c249 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2d0aac38b044572ac100aa2183d8478)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:36.108916 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cf5c9d-af72-4808-a6c5-af838351c249 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:36.148802 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f59e0d-28b1-4b64-9f9c-00a8b753715b admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:36.166654 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d4a172-79b6-42c0-b755-ee9a8fc81705 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f4c2fc51f54f0e977648b13efaed1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:36.166654 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4a172-79b6-42c0-b755-ee9a8fc81705 service cinder] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:36.166654 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4a172-79b6-42c0-b755-ee9a8fc81705 service cinder] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:36.166654 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4a172-79b6-42c0-b755-ee9a8fc81705 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:36.227177 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d4a172-79b6-42c0-b755-ee9a8fc81705 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:36.228754 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d4a172-79b6-42c0-b755-ee9a8fc81705 service cinder] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:36.239252 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:36.247899 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-37cf5c9d-af72-4808-a6c5-af838351c249 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2d0aac38b044572ac100aa2183d8478'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:36.282805 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 727/1451] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:10:35 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:10:36.285140 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d4a172-79b6-42c0-b755-ee9a8fc81705 service cinder] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:36.302278 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-37cf5c9d-af72-4808-a6c5-af838351c249 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2d0aac38b044572ac100aa2183d8478'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:36.305457 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-37cf5c9d-af72-4808-a6c5-af838351c249 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2d0aac38b044572ac100aa2183d8478'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:36.306304 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-37cf5c9d-af72-4808-a6c5-af838351c249 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2d0aac38b044572ac100aa2183d8478'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:36.326536 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-37cf5c9d-af72-4808-a6c5-af838351c249 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2d0aac38b044572ac100aa2183d8478'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:36.329551 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d4a172-79b6-42c0-b755-ee9a8fc81705 service cinder] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:36.367732 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f95dca-f0d5-452e-b635-1f5d8fea756b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:36.368422 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f95dca-f0d5-452e-b635-1f5d8fea756b admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:36.368704 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f95dca-f0d5-452e-b635-1f5d8fea756b admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:36.369166 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f95dca-f0d5-452e-b635-1f5d8fea756b admin admin] PATH_INFO: `/v3/projects/332e1c30020d4290baa9e5d15cc67b04/users/91b26536b3014ee3b9feaefe8caea8b5/roles/7c3871c0ab68438b9014489d50b53a22` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:36.412666 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 725/1452] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:10:35 2022] DELETE /identity/v3/users/c2d0aac38b044572ac100aa2183d8478 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:10:36.445847 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f95dca-f0d5-452e-b635-1f5d8fea756b admin admin] RBAC: Authorizing `identity:create_grant(project_id=332e1c30020d4290baa9e5d15cc67b04, user_id=91b26536b3014ee3b9feaefe8caea8b5, role_id=7c3871c0ab68438b9014489d50b53a22)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:36.450874 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f95dca-f0d5-452e-b635-1f5d8fea756b admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:36.498269 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 728/1453] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:10:36 2022] PUT /identity/v3/projects/332e1c30020d4290baa9e5d15cc67b04/users/91b26536b3014ee3b9feaefe8caea8b5/roles/7c3871c0ab68438b9014489d50b53a22 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:10:36.511711 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5324fb-cee2-4fcc-89e1-419ceab760a5 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:36.513026 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5324fb-cee2-4fcc-89e1-419ceab760a5 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:36.513371 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5324fb-cee2-4fcc-89e1-419ceab760a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:36.601523 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-4c5324fb-cee2-4fcc-89e1-419ceab760a5 None None] MFA Rules not processed for user `91b26536b3014ee3b9feaefe8caea8b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:36.619365 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-4c5324fb-cee2-4fcc-89e1-419ceab760a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:36.662603 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d3f1a-a18b-40ae-85ca-acb48c276cef None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:36.662891 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d3f1a-a18b-40ae-85ca-acb48c276cef None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:36.663175 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d3f1a-a18b-40ae-85ca-acb48c276cef None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:36.665047 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 729/1454] 10.222.0.25 () {54 vars in 912 bytes} [Thu Oct 13 11:10:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 11:10:36.673781 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0eaaf8-4c91-47c5-833a-17a8ad6b2d7d None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:36.674162 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0eaaf8-4c91-47c5-833a-17a8ad6b2d7d None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:36.674554 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0eaaf8-4c91-47c5-833a-17a8ad6b2d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:36.716404 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-3c0eaaf8-4c91-47c5-833a-17a8ad6b2d7d None None] MFA Rules not processed for user `085e8bffed444287bc5f805461c3fb55`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:36.720594 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-3c0eaaf8-4c91-47c5-833a-17a8ad6b2d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:36.917735 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 730/1455] 10.222.0.25 () {58 vars in 1009 bytes} [Thu Oct 13 11:10:36 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 11:10:36.958876 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 726/1456] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:36 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 448 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:36.963162 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0eaaf8-4c91-47c5-833a-17a8ad6b2d7d None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:36.964683 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-3c0eaaf8-4c91-47c5-833a-17a8ad6b2d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:37.079509 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5324fb-cee2-4fcc-89e1-419ceab760a5 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:37.081246 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-4c5324fb-cee2-4fcc-89e1-419ceab760a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:37.107451 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5324fb-cee2-4fcc-89e1-419ceab760a5 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:37.131483 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adfd9fb-8d80-4459-9948-95a48ed97097 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:37.132518 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adfd9fb-8d80-4459-9948-95a48ed97097 service neutron] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:37.132989 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adfd9fb-8d80-4459-9948-95a48ed97097 service neutron] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:37.133472 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adfd9fb-8d80-4459-9948-95a48ed97097 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:37.163152 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0eaaf8-4c91-47c5-833a-17a8ad6b2d7d None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:37.196166 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a24c5dc-a6d5-4f9f-bcf6-c76f188dde93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:37.196739 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adfd9fb-8d80-4459-9948-95a48ed97097 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:37.196860 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24c5dc-a6d5-4f9f-bcf6-c76f188dde93 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:37.197072 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24c5dc-a6d5-4f9f-bcf6-c76f188dde93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:37.197357 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24c5dc-a6d5-4f9f-bcf6-c76f188dde93 admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:37.198043 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a24c5dc-a6d5-4f9f-bcf6-c76f188dde93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:37.200048 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a24c5dc-a6d5-4f9f-bcf6-c76f188dde93 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:37.215643 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adfd9fb-8d80-4459-9948-95a48ed97097 service neutron] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:37.264473 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 727/1457] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:10:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 13 11:10:37.316909 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 731/1458] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:10:36 2022] POST /identity/v3/projects => generated 357 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:10:37.321000 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adfd9fb-8d80-4459-9948-95a48ed97097 service neutron] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:37.341460 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adfd9fb-8d80-4459-9948-95a48ed97097 service neutron] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:37.574965 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e4191b-4d61-4f46-9df3-d33cfc72acdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:37.575870 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4191b-4d61-4f46-9df3-d33cfc72acdb admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:37.577285 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4191b-4d61-4f46-9df3-d33cfc72acdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:37.577740 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4191b-4d61-4f46-9df3-d33cfc72acdb admin admin] PATH_INFO: `/v3/users` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:37.581798 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e4191b-4d61-4f46-9df3-d33cfc72acdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:37.584770 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e4191b-4d61-4f46-9df3-d33cfc72acdb admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:37.649548 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 728/1459] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:10:37 2022] POST /identity/v3/users => generated 285 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:10:37.653625 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a24c5dc-a6d5-4f9f-bcf6-c76f188dde93 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:37.678003 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a24c5dc-a6d5-4f9f-bcf6-c76f188dde93 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:37.700055 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6075e1ed-8836-469a-a5d1-e8730cac435b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:37.700754 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075e1ed-8836-469a-a5d1-e8730cac435b admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:37.700991 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075e1ed-8836-469a-a5d1-e8730cac435b admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:37.705644 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075e1ed-8836-469a-a5d1-e8730cac435b admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:37.706605 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6075e1ed-8836-469a-a5d1-e8730cac435b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:37.708255 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6075e1ed-8836-469a-a5d1-e8730cac435b admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:37.715402 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:37.742270 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08cdf0-c85f-4e94-be2f-fbed8f7fed6f None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:37.742270 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08cdf0-c85f-4e94-be2f-fbed8f7fed6f None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:37.742270 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08cdf0-c85f-4e94-be2f-fbed8f7fed6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:37.747003 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 732/1460] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:10:37 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:10:37.747862 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6075e1ed-8836-469a-a5d1-e8730cac435b admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:37.798004 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6075e1ed-8836-469a-a5d1-e8730cac435b admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:37.811342 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf621f5-9508-4463-bb2b-35798616b02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:37.812460 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf621f5-9508-4463-bb2b-35798616b02c admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:37.812743 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf621f5-9508-4463-bb2b-35798616b02c admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:37.813023 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf621f5-9508-4463-bb2b-35798616b02c admin admin] PATH_INFO: `/v3/projects/da98a5483a4c4324893f4fe938de0af1/users/33875b4fb4964355a58016b246a9cf07/roles/ea564961b1db4eb4a1d4d880964611b2` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:37.832553 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-0d08cdf0-c85f-4e94-be2f-fbed8f7fed6f None None] MFA Rules not processed for user `be133261e57e40728cb4e594041e54d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:37.834646 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-0d08cdf0-c85f-4e94-be2f-fbed8f7fed6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:37.882474 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:37.887309 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf621f5-9508-4463-bb2b-35798616b02c admin admin] RBAC: Authorizing `identity:create_grant(project_id=da98a5483a4c4324893f4fe938de0af1, user_id=33875b4fb4964355a58016b246a9cf07, role_id=ea564961b1db4eb4a1d4d880964611b2)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:37.893297 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf621f5-9508-4463-bb2b-35798616b02c admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:37.939128 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 733/1461] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:10:37 2022] PUT /identity/v3/projects/da98a5483a4c4324893f4fe938de0af1/users/33875b4fb4964355a58016b246a9cf07/roles/ea564961b1db4eb4a1d4d880964611b2 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:10:37.940140 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf621f5-9508-4463-bb2b-35798616b02c admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:37.949765 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-ecf621f5-9508-4463-bb2b-35798616b02c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:38.058868 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 729/1462] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:37 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:38.063527 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d08cdf0-c85f-4e94-be2f-fbed8f7fed6f None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:38.099478 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d08cdf0-c85f-4e94-be2f-fbed8f7fed6f None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:38.196383 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf621f5-9508-4463-bb2b-35798616b02c admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:38.210785 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40578e60-b86c-4a00-9afd-875ef188a7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:38.211849 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40578e60-b86c-4a00-9afd-875ef188a7e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:38.214064 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40578e60-b86c-4a00-9afd-875ef188a7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:38.214897 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40578e60-b86c-4a00-9afd-875ef188a7e9 admin admin] PATH_INFO: `/v3/projects/2fe2a8c4380c4508b6a23a474b79e2d7` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:38.233695 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40578e60-b86c-4a00-9afd-875ef188a7e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fe2a8c4380c4508b6a23a474b79e2d7)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:38.237835 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40578e60-b86c-4a00-9afd-875ef188a7e9 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:38.252845 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baab454-0b40-4164-8bfc-279b4c653015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:38.253578 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baab454-0b40-4164-8bfc-279b4c653015 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:38.254048 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baab454-0b40-4164-8bfc-279b4c653015 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:38.254438 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baab454-0b40-4164-8bfc-279b4c653015 admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:38.255897 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baab454-0b40-4164-8bfc-279b4c653015 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:38.258001 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baab454-0b40-4164-8bfc-279b4c653015 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:38.292408 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 730/1463] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:10:38 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:10:38.297414 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baab454-0b40-4164-8bfc-279b4c653015 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:38.332470 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baab454-0b40-4164-8bfc-279b4c653015 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:38.349522 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a228155-4675-4ad2-bb5e-41f1d6e06a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:38.354499 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a228155-4675-4ad2-bb5e-41f1d6e06a55 admin admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:38.354860 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a228155-4675-4ad2-bb5e-41f1d6e06a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:38.355665 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a228155-4675-4ad2-bb5e-41f1d6e06a55 admin admin] PATH_INFO: `/v3/projects/da98a5483a4c4324893f4fe938de0af1/users/33875b4fb4964355a58016b246a9cf07/roles/ea564961b1db4eb4a1d4d880964611b2` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:38.363048 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a228155-4675-4ad2-bb5e-41f1d6e06a55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da98a5483a4c4324893f4fe938de0af1, user_id=33875b4fb4964355a58016b246a9cf07, role_id=ea564961b1db4eb4a1d4d880964611b2)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:38.372864 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a228155-4675-4ad2-bb5e-41f1d6e06a55 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:38.415772 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 731/1464] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:10:38 2022] PUT /identity/v3/projects/da98a5483a4c4324893f4fe938de0af1/users/33875b4fb4964355a58016b246a9cf07/roles/ea564961b1db4eb4a1d4d880964611b2 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:10:38.428082 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7d635-45f1-4cd2-b946-995c4f362bbd None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:38.428608 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7d635-45f1-4cd2-b946-995c4f362bbd None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:38.429380 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7d635-45f1-4cd2-b946-995c4f362bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:38.449139 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-40578e60-b86c-4a00-9afd-875ef188a7e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fe2a8c4380c4508b6a23a474b79e2d7', 'request_id': 'req-40578e60-b86c-4a00-9afd-875ef188a7e9'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:38.475065 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-40578e60-b86c-4a00-9afd-875ef188a7e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fe2a8c4380c4508b6a23a474b79e2d7', 'request_id': 'req-40578e60-b86c-4a00-9afd-875ef188a7e9'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:38.492460 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-40578e60-b86c-4a00-9afd-875ef188a7e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fe2a8c4380c4508b6a23a474b79e2d7', 'request_id': 'req-40578e60-b86c-4a00-9afd-875ef188a7e9'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:38.529844 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-40578e60-b86c-4a00-9afd-875ef188a7e9 admin admin] The token cache is being invalidate because project 2fe2a8c4380c4508b6a23a474b79e2d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:10:38.532365 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-40578e60-b86c-4a00-9afd-875ef188a7e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:38.535913 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-40578e60-b86c-4a00-9afd-875ef188a7e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:38.541160 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-8ba7d635-45f1-4cd2-b946-995c4f362bbd None None] MFA Rules not processed for user `33875b4fb4964355a58016b246a9cf07`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:38.544397 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 734/1465] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:10:37 2022] DELETE /identity/v3/projects/2fe2a8c4380c4508b6a23a474b79e2d7 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:10:38.553688 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-8ba7d635-45f1-4cd2-b946-995c4f362bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:38.554205 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff6872-f9af-4c5e-b045-e08b183771d9 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:38.554205 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff6872-f9af-4c5e-b045-e08b183771d9 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:38.554205 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff6872-f9af-4c5e-b045-e08b183771d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:38.656359 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-66ff6872-f9af-4c5e-b045-e08b183771d9 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:38.657615 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-66ff6872-f9af-4c5e-b045-e08b183771d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:38.858543 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 732/1466] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:38 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 432 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 11:10:38.917584 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 735/1467] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:38.919237 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba7d635-45f1-4cd2-b946-995c4f362bbd None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:38.921288 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-8ba7d635-45f1-4cd2-b946-995c4f362bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:38.936766 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc58a4ac-d9c2-4c2d-9bc8-4ff0539d8291 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:38.937093 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc58a4ac-d9c2-4c2d-9bc8-4ff0539d8291 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:38.937330 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc58a4ac-d9c2-4c2d-9bc8-4ff0539d8291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:38.953386 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:38.968637 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-dc58a4ac-d9c2-4c2d-9bc8-4ff0539d8291 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:38.970266 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-dc58a4ac-d9c2-4c2d-9bc8-4ff0539d8291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:38.981663 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 736/1468] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:38.994029 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc58a4ac-d9c2-4c2d-9bc8-4ff0539d8291 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:39.024538 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc58a4ac-d9c2-4c2d-9bc8-4ff0539d8291 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:39.043455 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f7a1ea-be91-4958-8d90-7bcb6d98db4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:39.044103 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f7a1ea-be91-4958-8d90-7bcb6d98db4c admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:39.044390 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f7a1ea-be91-4958-8d90-7bcb6d98db4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:39.044649 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f7a1ea-be91-4958-8d90-7bcb6d98db4c admin admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:39.045305 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f7a1ea-be91-4958-8d90-7bcb6d98db4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:10:39.045606 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f7a1ea-be91-4958-8d90-7bcb6d98db4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:39.046181 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:39.047686 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f7a1ea-be91-4958-8d90-7bcb6d98db4c admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:39.089152 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 737/1469] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 11:10:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:10:39.110510 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f7a1ea-be91-4958-8d90-7bcb6d98db4c admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:39.151127 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba7d635-45f1-4cd2-b946-995c4f362bbd None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:39.152863 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee46ec0-539f-457b-b0ca-f613e5fb97d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f4c2fc51f54f0e977648b13efaed1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:39.153384 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f7a1ea-be91-4958-8d90-7bcb6d98db4c admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:39.153541 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee46ec0-539f-457b-b0ca-f613e5fb97d7 service cinder] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:39.153823 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee46ec0-539f-457b-b0ca-f613e5fb97d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:39.154310 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee46ec0-539f-457b-b0ca-f613e5fb97d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:39.180217 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee46ec0-539f-457b-b0ca-f613e5fb97d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:39.186066 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee46ec0-539f-457b-b0ca-f613e5fb97d7 service cinder] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:39.190967 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e1ad90-c7bd-4c54-9335-d2d913894da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:39.191617 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1ad90-c7bd-4c54-9335-d2d913894da1 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:39.191931 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1ad90-c7bd-4c54-9335-d2d913894da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:39.192212 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1ad90-c7bd-4c54-9335-d2d913894da1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:39.192964 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e1ad90-c7bd-4c54-9335-d2d913894da1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:39.204175 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e1ad90-c7bd-4c54-9335-d2d913894da1 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:39.219159 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 733/1470] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:10:38 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 13 11:10:39.314561 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 738/1471] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:10:39 2022] POST /identity/v3/projects => generated 361 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:10:39.319177 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee46ec0-539f-457b-b0ca-f613e5fb97d7 service cinder] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:39.337055 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee46ec0-539f-457b-b0ca-f613e5fb97d7 service cinder] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:39.497664 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e1ad90-c7bd-4c54-9335-d2d913894da1 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:39.499721 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-c0e1ad90-c7bd-4c54-9335-d2d913894da1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:39.544986 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5912054-821d-403f-9004-2bdbebc1aa98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:39.545724 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5912054-821d-403f-9004-2bdbebc1aa98 admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:39.546822 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5912054-821d-403f-9004-2bdbebc1aa98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:39.547097 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5912054-821d-403f-9004-2bdbebc1aa98 admin admin] PATH_INFO: `/v3/users` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:39.548435 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5912054-821d-403f-9004-2bdbebc1aa98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:39.550493 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5912054-821d-403f-9004-2bdbebc1aa98 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:39.619961 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 734/1472] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:10:39 2022] POST /identity/v3/users => generated 281 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:10:39.624644 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5912054-821d-403f-9004-2bdbebc1aa98 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:39.676270 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5912054-821d-403f-9004-2bdbebc1aa98 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:39.691912 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e1ad90-c7bd-4c54-9335-d2d913894da1 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:39.706214 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b527220-8ca1-4c41-8917-9a713fb104ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:39.706972 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b527220-8ca1-4c41-8917-9a713fb104ef admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:39.707262 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b527220-8ca1-4c41-8917-9a713fb104ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:39.707585 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b527220-8ca1-4c41-8917-9a713fb104ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:39.709063 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b527220-8ca1-4c41-8917-9a713fb104ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:39.711042 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286d87df-2a3b-4ec1-9907-da91e99c5ebe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f4c2fc51f54f0e977648b13efaed1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:39.717152 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d87df-2a3b-4ec1-9907-da91e99c5ebe service cinder] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:39.718237 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b527220-8ca1-4c41-8917-9a713fb104ef admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:39.719253 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d87df-2a3b-4ec1-9907-da91e99c5ebe service cinder] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:39.720678 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d87df-2a3b-4ec1-9907-da91e99c5ebe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:39.726925 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-286d87df-2a3b-4ec1-9907-da91e99c5ebe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:39.796182 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 735/1473] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:10:39 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:10:39.799439 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b527220-8ca1-4c41-8917-9a713fb104ef admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:39.830412 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b527220-8ca1-4c41-8917-9a713fb104ef admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:39.871410 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11d7ca4-6dfd-4f3b-bc41-1c0105a1eca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:39.881974 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d7ca4-6dfd-4f3b-bc41-1c0105a1eca9 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:39.881974 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d7ca4-6dfd-4f3b-bc41-1c0105a1eca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:39.881974 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d7ca4-6dfd-4f3b-bc41-1c0105a1eca9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:39.884234 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11d7ca4-6dfd-4f3b-bc41-1c0105a1eca9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:39.891546 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11d7ca4-6dfd-4f3b-bc41-1c0105a1eca9 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:39.916995 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 736/1474] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:10:39 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:10:39.922045 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11d7ca4-6dfd-4f3b-bc41-1c0105a1eca9 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:39.944168 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11d7ca4-6dfd-4f3b-bc41-1c0105a1eca9 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:39.959907 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c0efa8-3490-4cd6-9af6-5b991eb069ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:39.964644 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c0efa8-3490-4cd6-9af6-5b991eb069ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:39.965161 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c0efa8-3490-4cd6-9af6-5b991eb069ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:39.971237 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c0efa8-3490-4cd6-9af6-5b991eb069ae admin admin] PATH_INFO: `/v3/projects/c49ac114b829453d88069045ef0e6ddf/users/37e19f5e60794eb59b9f13a3623bcc38/roles/7c3871c0ab68438b9014489d50b53a22` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:39.989008 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286d87df-2a3b-4ec1-9907-da91e99c5ebe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:39.994182 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286d87df-2a3b-4ec1-9907-da91e99c5ebe service cinder] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:40.017724 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c0efa8-3490-4cd6-9af6-5b991eb069ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=c49ac114b829453d88069045ef0e6ddf, user_id=37e19f5e60794eb59b9f13a3623bcc38, role_id=7c3871c0ab68438b9014489d50b53a22)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:40.020583 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c0efa8-3490-4cd6-9af6-5b991eb069ae admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:40.028698 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 739/1475] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:10:39 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:10:40.059637 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 737/1476] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:10:39 2022] PUT /identity/v3/projects/c49ac114b829453d88069045ef0e6ddf/users/37e19f5e60794eb59b9f13a3623bcc38/roles/7c3871c0ab68438b9014489d50b53a22 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:10:40.063688 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436bbe40-5278-4031-a1d7-9620257ea8ae None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:40.064349 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436bbe40-5278-4031-a1d7-9620257ea8ae None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:40.064837 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436bbe40-5278-4031-a1d7-9620257ea8ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:40.117635 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f0f50d-f589-4ff2-8eb0-cc939b6df321 None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:40.118036 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f0f50d-f589-4ff2-8eb0-cc939b6df321 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:40.118357 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f0f50d-f589-4ff2-8eb0-cc939b6df321 None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:40.122493 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 738/1477] 10.222.0.25 () {54 vars in 921 bytes} [Thu Oct 13 11:10:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:10:40.132498 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8c8b7-8a79-4289-a2d3-01bf792a862b None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:40.139866 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8c8b7-8a79-4289-a2d3-01bf792a862b None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:40.139866 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8c8b7-8a79-4289-a2d3-01bf792a862b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:40.151200 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-436bbe40-5278-4031-a1d7-9620257ea8ae None None] MFA Rules not processed for user `37e19f5e60794eb59b9f13a3623bcc38`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:40.169345 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-436bbe40-5278-4031-a1d7-9620257ea8ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:40.210364 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-98a8c8b7-8a79-4289-a2d3-01bf792a862b None None] MFA Rules not processed for user `ed4bb75e68a640fc92ddd47fad61a25a`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:40.211775 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-98a8c8b7-8a79-4289-a2d3-01bf792a862b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:40.346620 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 740/1478] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:40.403135 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436bbe40-5278-4031-a1d7-9620257ea8ae None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:40.418376 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 739/1479] 10.222.0.25 () {58 vars in 1018 bytes} [Thu Oct 13 11:10:40 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:40.418653 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:40.419717 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a8c8b7-8a79-4289-a2d3-01bf792a862b None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:40.421524 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-98a8c8b7-8a79-4289-a2d3-01bf792a862b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:40.440925 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:40.527735 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436bbe40-5278-4031-a1d7-9620257ea8ae None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:40.538649 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f3726-586e-4648-9a9e-54d171188430 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f4c2fc51f54f0e977648b13efaed1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:40.539272 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f3726-586e-4648-9a9e-54d171188430 service cinder] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:40.539702 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f3726-586e-4648-9a9e-54d171188430 service cinder] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:40.539975 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f3726-586e-4648-9a9e-54d171188430 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:40.574381 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907f3726-586e-4648-9a9e-54d171188430 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:40.583808 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907f3726-586e-4648-9a9e-54d171188430 service cinder] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:40.629468 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 741/1480] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:10:40 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:10:40.632342 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f3726-586e-4648-9a9e-54d171188430 service cinder] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:40.642052 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-907f3726-586e-4648-9a9e-54d171188430 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:40.648400 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a8c8b7-8a79-4289-a2d3-01bf792a862b None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:40.663545 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1a1c46-1057-4d36-826b-ec063297c207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:40.673887 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1a1c46-1057-4d36-826b-ec063297c207 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:40.675061 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1a1c46-1057-4d36-826b-ec063297c207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:40.678089 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1a1c46-1057-4d36-826b-ec063297c207 admin admin] PATH_INFO: `/v3/users/399a003fd08c424a99133c48344813ab` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:40.683309 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1a1c46-1057-4d36-826b-ec063297c207 admin admin] RBAC: Authorizing `identity:delete_user(user_id=399a003fd08c424a99133c48344813ab)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:40.689174 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1a1c46-1057-4d36-826b-ec063297c207 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:40.708217 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f3726-586e-4648-9a9e-54d171188430 service cinder] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:40.743808 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8560a923-822c-4b78-aeb3-0b9119e454f8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed4bb75e68a640fc92ddd47fad61a25a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:40.746360 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8560a923-822c-4b78-aeb3-0b9119e454f8 service placement] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:40.747069 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8560a923-822c-4b78-aeb3-0b9119e454f8 service placement] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:40.747438 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8560a923-822c-4b78-aeb3-0b9119e454f8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:40.791348 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8560a923-822c-4b78-aeb3-0b9119e454f8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:40.795909 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8560a923-822c-4b78-aeb3-0b9119e454f8 service placement] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:40.828327 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-ef1a1c46-1057-4d36-826b-ec063297c207 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '399a003fd08c424a99133c48344813ab'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:40.839989 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-ef1a1c46-1057-4d36-826b-ec063297c207 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '399a003fd08c424a99133c48344813ab'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:40.841364 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-ef1a1c46-1057-4d36-826b-ec063297c207 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '399a003fd08c424a99133c48344813ab'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:40.842048 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-ef1a1c46-1057-4d36-826b-ec063297c207 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '399a003fd08c424a99133c48344813ab'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:40.850374 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 742/1481] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:10:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:10:40.858895 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8560a923-822c-4b78-aeb3-0b9119e454f8 service placement] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:40.902900 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8560a923-822c-4b78-aeb3-0b9119e454f8 service placement] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:40.913319 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89b1273-2554-4467-bbac-9466726ad504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:40.914832 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89b1273-2554-4467-bbac-9466726ad504 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:40.915299 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89b1273-2554-4467-bbac-9466726ad504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:40.915719 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89b1273-2554-4467-bbac-9466726ad504 admin admin] PATH_INFO: `/v3/users/37e19f5e60794eb59b9f13a3623bcc38` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:40.917226 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89b1273-2554-4467-bbac-9466726ad504 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37e19f5e60794eb59b9f13a3623bcc38)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:40.919369 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89b1273-2554-4467-bbac-9466726ad504 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:40.922237 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-ef1a1c46-1057-4d36-826b-ec063297c207 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '399a003fd08c424a99133c48344813ab'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:41.038195 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 740/1482] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:10:40 2022] DELETE /identity/v3/users/399a003fd08c424a99133c48344813ab => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:10:41.039855 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd80e94-60ce-45e6-93da-c50032fe2e38 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:41.040758 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd80e94-60ce-45e6-93da-c50032fe2e38 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:41.041139 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd80e94-60ce-45e6-93da-c50032fe2e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:41.083175 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-2dd80e94-60ce-45e6-93da-c50032fe2e38 None None] MFA Rules not processed for user `1674289511b749d4b23c4441714e437d`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:41.085207 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-2dd80e94-60ce-45e6-93da-c50032fe2e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:41.087095 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-d89b1273-2554-4467-bbac-9466726ad504 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37e19f5e60794eb59b9f13a3623bcc38'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:41.088499 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-d89b1273-2554-4467-bbac-9466726ad504 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37e19f5e60794eb59b9f13a3623bcc38'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:41.089567 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-d89b1273-2554-4467-bbac-9466726ad504 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37e19f5e60794eb59b9f13a3623bcc38'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:41.110773 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-d89b1273-2554-4467-bbac-9466726ad504 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37e19f5e60794eb59b9f13a3623bcc38'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:41.133843 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-d89b1273-2554-4467-bbac-9466726ad504 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37e19f5e60794eb59b9f13a3623bcc38'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:41.170793 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 743/1483] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:10:40 2022] DELETE /identity/v3/users/37e19f5e60794eb59b9f13a3623bcc38 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:10:41.178729 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e88729-9453-41d2-84ea-47027493b588 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:41.181377 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e88729-9453-41d2-84ea-47027493b588 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:41.182812 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e88729-9453-41d2-84ea-47027493b588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:41.255360 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 741/1484] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:41 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:41.257834 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389cdfad-387e-4f5b-8fbc-a8b19a4d63f5 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:41.258969 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389cdfad-387e-4f5b-8fbc-a8b19a4d63f5 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:41.260892 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389cdfad-387e-4f5b-8fbc-a8b19a4d63f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:41.303199 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-09e88729-9453-41d2-84ea-47027493b588 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:41.325648 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-09e88729-9453-41d2-84ea-47027493b588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:41.339318 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-389cdfad-387e-4f5b-8fbc-a8b19a4d63f5 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:41.346344 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-389cdfad-387e-4f5b-8fbc-a8b19a4d63f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:41.428608 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:41.515411 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 742/1485] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:41.546306 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389cdfad-387e-4f5b-8fbc-a8b19a4d63f5 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:41.547901 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-389cdfad-387e-4f5b-8fbc-a8b19a4d63f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:41.676159 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 744/1486] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 504 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:41.677098 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389cdfad-387e-4f5b-8fbc-a8b19a4d63f5 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:41.684538 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96faa8ba-36de-4de5-9447-2c92112cf109 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:41.685543 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e88729-9453-41d2-84ea-47027493b588 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:41.688271 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96faa8ba-36de-4de5-9447-2c92112cf109 service neutron] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:41.688826 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96faa8ba-36de-4de5-9447-2c92112cf109 service neutron] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:41.689197 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96faa8ba-36de-4de5-9447-2c92112cf109 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:41.715157 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e88729-9453-41d2-84ea-47027493b588 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:41.716320 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96faa8ba-36de-4de5-9447-2c92112cf109 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:41.718180 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96faa8ba-36de-4de5-9447-2c92112cf109 service neutron] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:41.747292 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 743/1487] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:10:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 13 11:10:41.752471 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d88496-fe89-48e9-9814-f155b4385984 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:41.753189 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d88496-fe89-48e9-9814-f155b4385984 service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:41.753474 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d88496-fe89-48e9-9814-f155b4385984 service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:41.760591 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d88496-fe89-48e9-9814-f155b4385984 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:41.801255 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:41.808418 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d88496-fe89-48e9-9814-f155b4385984 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:41.818609 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d88496-fe89-48e9-9814-f155b4385984 service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:41.867505 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 745/1488] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:10:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:10:42.687232 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96faa8ba-36de-4de5-9447-2c92112cf109 service neutron] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:42.689440 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-96faa8ba-36de-4de5-9447-2c92112cf109 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:42.715109 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96faa8ba-36de-4de5-9447-2c92112cf109 service neutron] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:42.736191 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ac9859-c443-406e-83e8-38ec5bc51111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:42.736734 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac9859-c443-406e-83e8-38ec5bc51111 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:42.737139 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac9859-c443-406e-83e8-38ec5bc51111 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:42.742079 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac9859-c443-406e-83e8-38ec5bc51111 admin admin] PATH_INFO: `/v3/projects/c49ac114b829453d88069045ef0e6ddf` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:42.744919 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ac9859-c443-406e-83e8-38ec5bc51111 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c49ac114b829453d88069045ef0e6ddf)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:42.762240 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ac9859-c443-406e-83e8-38ec5bc51111 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:42.846645 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-76ac9859-c443-406e-83e8-38ec5bc51111 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c49ac114b829453d88069045ef0e6ddf', 'request_id': 'req-76ac9859-c443-406e-83e8-38ec5bc51111'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:42.877703 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-76ac9859-c443-406e-83e8-38ec5bc51111 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c49ac114b829453d88069045ef0e6ddf', 'request_id': 'req-76ac9859-c443-406e-83e8-38ec5bc51111'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:42.920101 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d88496-fe89-48e9-9814-f155b4385984 service neutron] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:42.921211 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-76ac9859-c443-406e-83e8-38ec5bc51111 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c49ac114b829453d88069045ef0e6ddf', 'request_id': 'req-76ac9859-c443-406e-83e8-38ec5bc51111'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:42.921572 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-a6d88496-fe89-48e9-9814-f155b4385984 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:42.969621 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-76ac9859-c443-406e-83e8-38ec5bc51111 admin admin] The token cache is being invalidate because project c49ac114b829453d88069045ef0e6ddf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:10:42.971376 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d88496-fe89-48e9-9814-f155b4385984 service neutron] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:42.973686 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-76ac9859-c443-406e-83e8-38ec5bc51111 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:42.979022 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-76ac9859-c443-406e-83e8-38ec5bc51111 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:42.990474 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 744/1489] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:10:42 2022] DELETE /identity/v3/projects/c49ac114b829453d88069045ef0e6ddf => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:10:43.004360 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a1bf9d-b4a2-4280-8924-312cd63e381d None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:43.004641 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a1bf9d-b4a2-4280-8924-312cd63e381d None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:43.006479 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a1bf9d-b4a2-4280-8924-312cd63e381d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:43.064592 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-a6a1bf9d-b4a2-4280-8924-312cd63e381d None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:43.066269 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-a6a1bf9d-b4a2-4280-8924-312cd63e381d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:43.136775 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:43.165573 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 745/1490] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:43.167535 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e3e054-abd1-4383-8503-88fe0a833b56 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:43.167795 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e3e054-abd1-4383-8503-88fe0a833b56 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:43.168076 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e3e054-abd1-4383-8503-88fe0a833b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:43.204636 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62739646-38c6-49d5-bda6-07e58453d6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:43.205389 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62739646-38c6-49d5-bda6-07e58453d6db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:43.205676 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62739646-38c6-49d5-bda6-07e58453d6db admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:43.206029 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62739646-38c6-49d5-bda6-07e58453d6db admin admin] PATH_INFO: `/v3/projects/278b8bd8b54845f8a3b0458e83adc161` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:43.210274 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62739646-38c6-49d5-bda6-07e58453d6db admin admin] RBAC: Authorizing `identity:delete_project(project_id=278b8bd8b54845f8a3b0458e83adc161)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:43.212265 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62739646-38c6-49d5-bda6-07e58453d6db admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:43.246740 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-59e3e054-abd1-4383-8503-88fe0a833b56 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:43.254504 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-59e3e054-abd1-4383-8503-88fe0a833b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:43.292077 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 746/1491] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 11:10:43.304879 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e3e054-abd1-4383-8503-88fe0a833b56 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:43.368211 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-62739646-38c6-49d5-bda6-07e58453d6db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '278b8bd8b54845f8a3b0458e83adc161', 'request_id': 'req-62739646-38c6-49d5-bda6-07e58453d6db'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:43.372802 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e3e054-abd1-4383-8503-88fe0a833b56 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:43.385861 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-62739646-38c6-49d5-bda6-07e58453d6db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '278b8bd8b54845f8a3b0458e83adc161', 'request_id': 'req-62739646-38c6-49d5-bda6-07e58453d6db'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:43.400798 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-62739646-38c6-49d5-bda6-07e58453d6db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '278b8bd8b54845f8a3b0458e83adc161', 'request_id': 'req-62739646-38c6-49d5-bda6-07e58453d6db'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:43.444104 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-62739646-38c6-49d5-bda6-07e58453d6db admin admin] The token cache is being invalidate because project 278b8bd8b54845f8a3b0458e83adc161 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:10:43.444400 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-62739646-38c6-49d5-bda6-07e58453d6db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:43.446516 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-62739646-38c6-49d5-bda6-07e58453d6db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:43.452807 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 746/1492] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:10:42 2022] DELETE /identity/v3/projects/278b8bd8b54845f8a3b0458e83adc161 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 11:10:43.453765 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62739646-38c6-49d5-bda6-07e58453d6db admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:43.465025 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-62739646-38c6-49d5-bda6-07e58453d6db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:43.575117 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de8cab3-157b-4bdb-9814-d8d6de197ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:43.579484 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de8cab3-157b-4bdb-9814-d8d6de197ed3 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:43.579866 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de8cab3-157b-4bdb-9814-d8d6de197ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:43.581018 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de8cab3-157b-4bdb-9814-d8d6de197ed3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:43.581993 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de8cab3-157b-4bdb-9814-d8d6de197ed3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:10:43.584383 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de8cab3-157b-4bdb-9814-d8d6de197ed3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:43.589679 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de8cab3-157b-4bdb-9814-d8d6de197ed3 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:43.625794 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 747/1493] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 11:10:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:10:43.630647 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de8cab3-157b-4bdb-9814-d8d6de197ed3 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:43.641989 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-9de8cab3-157b-4bdb-9814-d8d6de197ed3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:43.691215 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de8cab3-157b-4bdb-9814-d8d6de197ed3 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:43.710155 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d98d6d8-15e8-41ea-9597-c5dc5420fd98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:43.713666 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d98d6d8-15e8-41ea-9597-c5dc5420fd98 admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:43.716457 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d98d6d8-15e8-41ea-9597-c5dc5420fd98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:43.716457 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d98d6d8-15e8-41ea-9597-c5dc5420fd98 admin admin] PATH_INFO: `/v3/projects` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:43.717972 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d98d6d8-15e8-41ea-9597-c5dc5420fd98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:43.720159 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d98d6d8-15e8-41ea-9597-c5dc5420fd98 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:43.743714 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62739646-38c6-49d5-bda6-07e58453d6db admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:43.759401 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b556dc-057b-4516-89ae-cd7d21e9411e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:43.760083 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b556dc-057b-4516-89ae-cd7d21e9411e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:43.760417 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b556dc-057b-4516-89ae-cd7d21e9411e admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:43.760629 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b556dc-057b-4516-89ae-cd7d21e9411e admin admin] PATH_INFO: `/v3/users/fcb936e4f71e48bc9eac7a4f9c4f0569` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:43.762379 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b556dc-057b-4516-89ae-cd7d21e9411e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcb936e4f71e48bc9eac7a4f9c4f0569)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:43.764501 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b556dc-057b-4516-89ae-cd7d21e9411e admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:43.830399 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:43.835402 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 748/1494] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:10:43 2022] POST /identity/v3/projects => generated 377 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:10:43.853397 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d98d6d8-15e8-41ea-9597-c5dc5420fd98 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:43.881337 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-15b556dc-057b-4516-89ae-cd7d21e9411e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcb936e4f71e48bc9eac7a4f9c4f0569'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:43.882944 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-15b556dc-057b-4516-89ae-cd7d21e9411e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcb936e4f71e48bc9eac7a4f9c4f0569'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:43.884176 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-15b556dc-057b-4516-89ae-cd7d21e9411e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcb936e4f71e48bc9eac7a4f9c4f0569'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:43.930226 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-15b556dc-057b-4516-89ae-cd7d21e9411e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcb936e4f71e48bc9eac7a4f9c4f0569'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:43.962345 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-15b556dc-057b-4516-89ae-cd7d21e9411e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcb936e4f71e48bc9eac7a4f9c4f0569'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:44.019127 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 747/1495] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:10:43 2022] DELETE /identity/v3/users/fcb936e4f71e48bc9eac7a4f9c4f0569 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:10:44.024093 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cac44f-fe58-4b36-8436-9c10fff84650 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:44.025526 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cac44f-fe58-4b36-8436-9c10fff84650 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:44.026370 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cac44f-fe58-4b36-8436-9c10fff84650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:44.092556 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d98d6d8-15e8-41ea-9597-c5dc5420fd98 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:44.095395 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-26cac44f-fe58-4b36-8436-9c10fff84650 None None] MFA Rules not processed for user `3b8d890413d4480d96ce9c9be80076d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:44.098448 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-26cac44f-fe58-4b36-8436-9c10fff84650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:44.234059 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944e7721-7041-4265-bd36-d2a85b0685af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:44.236326 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e7721-7041-4265-bd36-d2a85b0685af admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:44.237028 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e7721-7041-4265-bd36-d2a85b0685af admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:44.240433 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e7721-7041-4265-bd36-d2a85b0685af admin admin] PATH_INFO: `/v3/users` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:44.242472 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944e7721-7041-4265-bd36-d2a85b0685af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:44.252928 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944e7721-7041-4265-bd36-d2a85b0685af admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:44.294075 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 748/1496] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:44 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:44.313615 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:44.335867 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 749/1497] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:10:43 2022] POST /identity/v3/users => generated 289 bytes in 492 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:10:44.337241 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cac44f-fe58-4b36-8436-9c10fff84650 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:44.339409 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-26cac44f-fe58-4b36-8436-9c10fff84650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:44.365637 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cac44f-fe58-4b36-8436-9c10fff84650 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:44.377539 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44c75c3-3bb7-474a-9220-f360fd0ff7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:44.378200 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c75c3-3bb7-474a-9220-f360fd0ff7dc admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:44.378670 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c75c3-3bb7-474a-9220-f360fd0ff7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:44.379218 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c75c3-3bb7-474a-9220-f360fd0ff7dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:44.380723 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44c75c3-3bb7-474a-9220-f360fd0ff7dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:44.384633 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44c75c3-3bb7-474a-9220-f360fd0ff7dc admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:44.413450 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 749/1498] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:10:44 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 13 11:10:44.417365 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944e7721-7041-4265-bd36-d2a85b0685af admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:44.434259 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944e7721-7041-4265-bd36-d2a85b0685af admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:44.477558 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e2cf14-30f1-4127-8580-17e30fcf29c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:44.483567 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e2cf14-30f1-4127-8580-17e30fcf29c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:44.484188 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e2cf14-30f1-4127-8580-17e30fcf29c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:44.485759 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e2cf14-30f1-4127-8580-17e30fcf29c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:44.486991 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e2cf14-30f1-4127-8580-17e30fcf29c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:44.490626 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e2cf14-30f1-4127-8580-17e30fcf29c9 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:44.536997 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44c75c3-3bb7-474a-9220-f360fd0ff7dc admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:44.537899 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 750/1499] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:10:44 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:10:44.556966 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44c75c3-3bb7-474a-9220-f360fd0ff7dc admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:44.570873 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16344f46-62ec-489c-8480-20d403427a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:44.571707 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16344f46-62ec-489c-8480-20d403427a28 admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:44.572088 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16344f46-62ec-489c-8480-20d403427a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:44.572469 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16344f46-62ec-489c-8480-20d403427a28 admin admin] PATH_INFO: `/v3/projects/846fcec43c5b41499fe586cb5e462a43/users/55973a81351441d7a5d4a9b75bccaab0/roles/7c3871c0ab68438b9014489d50b53a22` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:44.626404 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16344f46-62ec-489c-8480-20d403427a28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=846fcec43c5b41499fe586cb5e462a43, user_id=55973a81351441d7a5d4a9b75bccaab0, role_id=7c3871c0ab68438b9014489d50b53a22)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:44.629560 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16344f46-62ec-489c-8480-20d403427a28 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:44.665978 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 750/1500] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:10:44 2022] PUT /identity/v3/projects/846fcec43c5b41499fe586cb5e462a43/users/55973a81351441d7a5d4a9b75bccaab0/roles/7c3871c0ab68438b9014489d50b53a22 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:10:44.676848 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba67164-6fa2-48d9-a890-eb0849e3c516 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:44.678144 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba67164-6fa2-48d9-a890-eb0849e3c516 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:44.678144 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba67164-6fa2-48d9-a890-eb0849e3c516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:44.737558 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16344f46-62ec-489c-8480-20d403427a28 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:44.740355 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-16344f46-62ec-489c-8480-20d403427a28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:44.776675 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-cba67164-6fa2-48d9-a890-eb0849e3c516 None None] MFA Rules not processed for user `55973a81351441d7a5d4a9b75bccaab0`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:44.787291 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-cba67164-6fa2-48d9-a890-eb0849e3c516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:44.928889 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16344f46-62ec-489c-8480-20d403427a28 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:44.941810 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd34bea-461c-4b17-ac9b-40ad66fb6dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:44.943526 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd34bea-461c-4b17-ac9b-40ad66fb6dbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:44.949685 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd34bea-461c-4b17-ac9b-40ad66fb6dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:44.950226 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd34bea-461c-4b17-ac9b-40ad66fb6dbf admin admin] PATH_INFO: `/v3/projects/a805733b7a1049a488ec8df773bcc823` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:44.958522 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd34bea-461c-4b17-ac9b-40ad66fb6dbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=a805733b7a1049a488ec8df773bcc823)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:44.961031 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd34bea-461c-4b17-ac9b-40ad66fb6dbf admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:45.016648 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 751/1501] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 11:10:45.033882 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:45.049332 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba67164-6fa2-48d9-a890-eb0849e3c516 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:45.051110 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-cba67164-6fa2-48d9-a890-eb0849e3c516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:45.165333 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-abd34bea-461c-4b17-ac9b-40ad66fb6dbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a805733b7a1049a488ec8df773bcc823', 'request_id': 'req-abd34bea-461c-4b17-ac9b-40ad66fb6dbf'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:45.191458 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-abd34bea-461c-4b17-ac9b-40ad66fb6dbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a805733b7a1049a488ec8df773bcc823', 'request_id': 'req-abd34bea-461c-4b17-ac9b-40ad66fb6dbf'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:45.201033 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-abd34bea-461c-4b17-ac9b-40ad66fb6dbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a805733b7a1049a488ec8df773bcc823', 'request_id': 'req-abd34bea-461c-4b17-ac9b-40ad66fb6dbf'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:45.216060 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-abd34bea-461c-4b17-ac9b-40ad66fb6dbf admin admin] The token cache is being invalidate because project a805733b7a1049a488ec8df773bcc823 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:10:45.216573 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-abd34bea-461c-4b17-ac9b-40ad66fb6dbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:45.217484 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-abd34bea-461c-4b17-ac9b-40ad66fb6dbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:45.228493 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 751/1502] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:10:44 2022] DELETE /identity/v3/projects/a805733b7a1049a488ec8df773bcc823 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:10:45.231991 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad863269-8629-46d7-8c1d-e117710ec1f8 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:45.232706 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad863269-8629-46d7-8c1d-e117710ec1f8 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:45.232706 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad863269-8629-46d7-8c1d-e117710ec1f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:45.246738 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba67164-6fa2-48d9-a890-eb0849e3c516 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:45.308118 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-ad863269-8629-46d7-8c1d-e117710ec1f8 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:45.310153 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-ad863269-8629-46d7-8c1d-e117710ec1f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:45.426545 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cce599-ed39-4a8c-adbe-3aa51b46eed3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f4c2fc51f54f0e977648b13efaed1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:45.428522 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cce599-ed39-4a8c-adbe-3aa51b46eed3 service cinder] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:45.429747 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cce599-ed39-4a8c-adbe-3aa51b46eed3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:45.430879 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cce599-ed39-4a8c-adbe-3aa51b46eed3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:45.437252 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-a9cce599-ed39-4a8c-adbe-3aa51b46eed3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:45.502605 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 752/1503] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:45.504385 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c67bd8-5d06-4d29-bc37-09afec522fdf None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:45.504835 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c67bd8-5d06-4d29-bc37-09afec522fdf None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:45.505250 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c67bd8-5d06-4d29-bc37-09afec522fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:45.542824 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-12c67bd8-5d06-4d29-bc37-09afec522fdf None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:45.546556 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-12c67bd8-5d06-4d29-bc37-09afec522fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:45.557339 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:45.571189 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 753/1504] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:45.590914 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c67bd8-5d06-4d29-bc37-09afec522fdf None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:45.597990 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cce599-ed39-4a8c-adbe-3aa51b46eed3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:45.600494 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cce599-ed39-4a8c-adbe-3aa51b46eed3 service cinder] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:45.607043 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c67bd8-5d06-4d29-bc37-09afec522fdf None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:45.618343 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c0b191-92e7-4013-afe1-74f5802f0914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:45.619192 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c0b191-92e7-4013-afe1-74f5802f0914 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:45.619572 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c0b191-92e7-4013-afe1-74f5802f0914 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:45.619943 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c0b191-92e7-4013-afe1-74f5802f0914 admin admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:45.620706 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c0b191-92e7-4013-afe1-74f5802f0914 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:10:45.621125 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c0b191-92e7-4013-afe1-74f5802f0914 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:45.624342 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c0b191-92e7-4013-afe1-74f5802f0914 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:45.644391 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 752/1505] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:10:45 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 594 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 13 11:10:45.670408 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 754/1506] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 11:10:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 11:10:45.674830 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cce599-ed39-4a8c-adbe-3aa51b46eed3 service cinder] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:45.701313 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cce599-ed39-4a8c-adbe-3aa51b46eed3 service cinder] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:45.721404 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1185fc90-aa07-4ea1-ae7e-1900fed04eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:45.722107 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185fc90-aa07-4ea1-ae7e-1900fed04eeb admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:45.722390 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185fc90-aa07-4ea1-ae7e-1900fed04eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:45.722668 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185fc90-aa07-4ea1-ae7e-1900fed04eeb admin admin] PATH_INFO: `/v3/projects` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:45.723324 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1185fc90-aa07-4ea1-ae7e-1900fed04eeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:45.729025 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1185fc90-aa07-4ea1-ae7e-1900fed04eeb admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:45.854564 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 753/1507] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:10:45 2022] POST /identity/v3/projects => generated 389 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:10:45.860096 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c0b191-92e7-4013-afe1-74f5802f0914 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:45.893606 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c0b191-92e7-4013-afe1-74f5802f0914 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:46.121329 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3934c956-9b2d-4ca1-ac79-22809a7a5e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:46.121329 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934c956-9b2d-4ca1-ac79-22809a7a5e8c admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:46.121329 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934c956-9b2d-4ca1-ac79-22809a7a5e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:46.121329 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934c956-9b2d-4ca1-ac79-22809a7a5e8c admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:46.122474 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3934c956-9b2d-4ca1-ac79-22809a7a5e8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:46.124480 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3934c956-9b2d-4ca1-ac79-22809a7a5e8c admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:46.139301 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7805cc75-c710-47d5-8bc9-a64de070dae7 None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:46.140311 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7805cc75-c710-47d5-8bc9-a64de070dae7 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:46.140311 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7805cc75-c710-47d5-8bc9-a64de070dae7 None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:46.141576 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 754/1508] 10.222.0.25 () {54 vars in 921 bytes} [Thu Oct 13 11:10:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:10:46.197466 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 755/1509] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:10:45 2022] POST /identity/v3/users => generated 295 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:10:46.201760 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7805cc75-c710-47d5-8bc9-a64de070dae7 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:46.227128 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50facf7-b3c8-4235-9578-9706ece52bf5 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:46.227716 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50facf7-b3c8-4235-9578-9706ece52bf5 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:46.228219 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50facf7-b3c8-4235-9578-9706ece52bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:46.231177 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7805cc75-c710-47d5-8bc9-a64de070dae7 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:46.245985 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a687d809-d0ac-4d75-970e-bf18b7d0f87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:46.250501 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a687d809-d0ac-4d75-970e-bf18b7d0f87e admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:46.252109 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a687d809-d0ac-4d75-970e-bf18b7d0f87e admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:46.252644 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a687d809-d0ac-4d75-970e-bf18b7d0f87e admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:46.255729 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a687d809-d0ac-4d75-970e-bf18b7d0f87e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:46.277410 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a687d809-d0ac-4d75-970e-bf18b7d0f87e admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:46.307716 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-f50facf7-b3c8-4235-9578-9706ece52bf5 None None] MFA Rules not processed for user `78384fbffdd346578855e7214b335d8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:46.310493 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-f50facf7-b3c8-4235-9578-9706ece52bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:46.343190 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 755/1510] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:10:46 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:10:46.346801 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e3995-6f07-41de-9c67-263b9e9d5eb5 None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:46.347246 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e3995-6f07-41de-9c67-263b9e9d5eb5 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:46.347632 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e3995-6f07-41de-9c67-263b9e9d5eb5 None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:46.349482 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 756/1511] 10.222.0.25 () {54 vars in 921 bytes} [Thu Oct 13 11:10:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:10:46.350321 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e3995-6f07-41de-9c67-263b9e9d5eb5 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:46.359996 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:46.374379 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e3995-6f07-41de-9c67-263b9e9d5eb5 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:46.383065 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c753956-299f-400e-b3fe-12abb11158fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:46.383771 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c753956-299f-400e-b3fe-12abb11158fe admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:46.384074 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c753956-299f-400e-b3fe-12abb11158fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:46.384391 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c753956-299f-400e-b3fe-12abb11158fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:46.385024 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c753956-299f-400e-b3fe-12abb11158fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:46.388067 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c753956-299f-400e-b3fe-12abb11158fe admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:46.491385 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 757/1512] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:10:46 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:10:46.494655 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c753956-299f-400e-b3fe-12abb11158fe admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:46.547997 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c753956-299f-400e-b3fe-12abb11158fe admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:46.560338 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 756/1513] 10.222.0.25 () {58 vars in 1018 bytes} [Thu Oct 13 11:10:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 11:10:46.561877 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af626f1c-00f5-4ce6-af28-c724189d748d None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:46.566084 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af626f1c-00f5-4ce6-af28-c724189d748d None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:46.566512 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af626f1c-00f5-4ce6-af28-c724189d748d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:46.601850 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eea169-ccf0-417e-bfac-40ef546e1ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:46.604770 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eea169-ccf0-417e-bfac-40ef546e1ae1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:46.608129 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eea169-ccf0-417e-bfac-40ef546e1ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:46.608597 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eea169-ccf0-417e-bfac-40ef546e1ae1 admin admin] PATH_INFO: `/v3/projects/dc04c41a256c40b4b9202eccede75c52/users/84c3badc5b384e50bfd0c3c5d7259c4d/roles/7c3871c0ab68438b9014489d50b53a22` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:46.638971 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-af626f1c-00f5-4ce6-af28-c724189d748d None None] MFA Rules not processed for user `ed4bb75e68a640fc92ddd47fad61a25a`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:46.640297 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-af626f1c-00f5-4ce6-af28-c724189d748d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:46.658507 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eea169-ccf0-417e-bfac-40ef546e1ae1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc04c41a256c40b4b9202eccede75c52, user_id=84c3badc5b384e50bfd0c3c5d7259c4d, role_id=7c3871c0ab68438b9014489d50b53a22)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:46.679948 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eea169-ccf0-417e-bfac-40ef546e1ae1 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:46.707757 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 758/1514] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:10:46 2022] PUT /identity/v3/projects/dc04c41a256c40b4b9202eccede75c52/users/84c3badc5b384e50bfd0c3c5d7259c4d/roles/7c3871c0ab68438b9014489d50b53a22 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:10:46.719475 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d99ed-99db-4381-bebe-a0bad2cdb1c5 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:46.720040 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d99ed-99db-4381-bebe-a0bad2cdb1c5 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:46.720858 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d99ed-99db-4381-bebe-a0bad2cdb1c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:46.853042 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-7b3d99ed-99db-4381-bebe-a0bad2cdb1c5 None None] MFA Rules not processed for user `84c3badc5b384e50bfd0c3c5d7259c4d`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:46.854412 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-7b3d99ed-99db-4381-bebe-a0bad2cdb1c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:46.865907 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 757/1515] 10.222.0.25 () {58 vars in 1018 bytes} [Thu Oct 13 11:10:46 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:46.937087 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a397ac-b659-4111-9709-e4d61960ee64 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:46.937785 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a397ac-b659-4111-9709-e4d61960ee64 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:46.938252 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a397ac-b659-4111-9709-e4d61960ee64 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:46.942200 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 758/1516] 10.222.0.25 () {54 vars in 961 bytes} [Thu Oct 13 11:10:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 11:10:46.954088 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4083c352-c8e3-45ad-a3f7-44465d929c80 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:46.954765 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4083c352-c8e3-45ad-a3f7-44465d929c80 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:46.955378 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4083c352-c8e3-45ad-a3f7-44465d929c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:46.982512 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-4083c352-c8e3-45ad-a3f7-44465d929c80 None None] MFA Rules not processed for user `ed4bb75e68a640fc92ddd47fad61a25a`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:46.983818 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-4083c352-c8e3-45ad-a3f7-44465d929c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:47.113421 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 759/1517] 10.222.0.25 () {58 vars in 1058 bytes} [Thu Oct 13 11:10:46 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 11:10:47.117559 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4083c352-c8e3-45ad-a3f7-44465d929c80 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:47.123312 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-4083c352-c8e3-45ad-a3f7-44465d929c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:47.162307 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 759/1518] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:46 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 444 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 11:10:47.164672 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d99ed-99db-4381-bebe-a0bad2cdb1c5 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:47.205068 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d99ed-99db-4381-bebe-a0bad2cdb1c5 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:47.217453 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c976f6a7-56ec-4ed8-8ecb-f7e3cb17f19f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed4bb75e68a640fc92ddd47fad61a25a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:47.219001 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c976f6a7-56ec-4ed8-8ecb-f7e3cb17f19f service placement] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:47.222422 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c976f6a7-56ec-4ed8-8ecb-f7e3cb17f19f service placement] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:47.223017 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c976f6a7-56ec-4ed8-8ecb-f7e3cb17f19f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:47.247862 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c976f6a7-56ec-4ed8-8ecb-f7e3cb17f19f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:47.252044 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:47.254524 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c976f6a7-56ec-4ed8-8ecb-f7e3cb17f19f service placement] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:47.288573 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 760/1519] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:10:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:10:47.289353 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c976f6a7-56ec-4ed8-8ecb-f7e3cb17f19f service placement] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:47.368273 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4083c352-c8e3-45ad-a3f7-44465d929c80 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:47.396734 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ca9644-d4dd-426d-930c-49d6c4d6ad37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78384fbffdd346578855e7214b335d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:47.397361 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca9644-d4dd-426d-930c-49d6c4d6ad37 service nova] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:47.397636 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca9644-d4dd-426d-930c-49d6c4d6ad37 service nova] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:47.398608 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca9644-d4dd-426d-930c-49d6c4d6ad37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:47.429357 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ca9644-d4dd-426d-930c-49d6c4d6ad37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:47.431034 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ca9644-d4dd-426d-930c-49d6c4d6ad37 service nova] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:47.454933 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:47.471627 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 760/1520] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:10:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:10:47.472584 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ca9644-d4dd-426d-930c-49d6c4d6ad37 service nova] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:47.475806 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c976f6a7-56ec-4ed8-8ecb-f7e3cb17f19f service placement] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:47.477516 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-c7ca9644-d4dd-426d-930c-49d6c4d6ad37 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:47.493880 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d6d880-113d-4759-b643-4646799d9875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:47.494533 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d6d880-113d-4759-b643-4646799d9875 admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:47.494810 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d6d880-113d-4759-b643-4646799d9875 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:47.495084 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d6d880-113d-4759-b643-4646799d9875 admin admin] PATH_INFO: `/v3/projects` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:47.495722 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d6d880-113d-4759-b643-4646799d9875 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:47.501764 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d6d880-113d-4759-b643-4646799d9875 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:47.534471 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ca9644-d4dd-426d-930c-49d6c4d6ad37 service nova] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:47.539052 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bece7a2b-ca2d-42cc-9974-96d04b98e9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:47.539733 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece7a2b-ca2d-42cc-9974-96d04b98e9e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:47.540007 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece7a2b-ca2d-42cc-9974-96d04b98e9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:47.540277 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece7a2b-ca2d-42cc-9974-96d04b98e9e2 admin admin] PATH_INFO: `/v3/users/a9f5926b1dad45b1bb81745b772d3920` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:47.546429 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bece7a2b-ca2d-42cc-9974-96d04b98e9e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9f5926b1dad45b1bb81745b772d3920)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:47.548403 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bece7a2b-ca2d-42cc-9974-96d04b98e9e2 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:47.586613 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 761/1521] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:10:47 2022] POST /identity/v3/projects => generated 387 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:10:47.591543 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d6d880-113d-4759-b643-4646799d9875 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:47.690269 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-bece7a2b-ca2d-42cc-9974-96d04b98e9e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9f5926b1dad45b1bb81745b772d3920'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:47.692020 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-bece7a2b-ca2d-42cc-9974-96d04b98e9e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9f5926b1dad45b1bb81745b772d3920'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:47.693317 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-bece7a2b-ca2d-42cc-9974-96d04b98e9e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9f5926b1dad45b1bb81745b772d3920'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:47.739884 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-bece7a2b-ca2d-42cc-9974-96d04b98e9e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9f5926b1dad45b1bb81745b772d3920'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:47.761459 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-bece7a2b-ca2d-42cc-9974-96d04b98e9e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9f5926b1dad45b1bb81745b772d3920'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:47.793801 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 761/1522] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:10:47 2022] DELETE /identity/v3/users/a9f5926b1dad45b1bb81745b772d3920 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:10:47.810531 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d6d880-113d-4759-b643-4646799d9875 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:47.905829 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042730b3-64b6-40db-9d8b-1560b20ab578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:47.906874 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042730b3-64b6-40db-9d8b-1560b20ab578 admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:47.907251 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042730b3-64b6-40db-9d8b-1560b20ab578 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:47.907799 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042730b3-64b6-40db-9d8b-1560b20ab578 admin admin] PATH_INFO: `/v3/users` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:47.908368 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042730b3-64b6-40db-9d8b-1560b20ab578 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:47.910655 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042730b3-64b6-40db-9d8b-1560b20ab578 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:47.972615 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bece7a2b-ca2d-42cc-9974-96d04b98e9e2 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:47.973209 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 762/1523] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:10:47 2022] POST /identity/v3/users => generated 300 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 11:10:47.975650 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-bece7a2b-ca2d-42cc-9974-96d04b98e9e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:48.021423 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bece7a2b-ca2d-42cc-9974-96d04b98e9e2 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:48.052188 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d2f1b1-a3b0-4ca9-969f-d0d2b7e0dc56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:48.054434 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d2f1b1-a3b0-4ca9-969f-d0d2b7e0dc56 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:48.054895 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d2f1b1-a3b0-4ca9-969f-d0d2b7e0dc56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:48.055602 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d2f1b1-a3b0-4ca9-969f-d0d2b7e0dc56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:48.056774 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d2f1b1-a3b0-4ca9-969f-d0d2b7e0dc56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:48.061681 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d2f1b1-a3b0-4ca9-969f-d0d2b7e0dc56 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:48.093377 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042730b3-64b6-40db-9d8b-1560b20ab578 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:48.104111 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 762/1524] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:10:47 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 13 11:10:48.106941 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042730b3-64b6-40db-9d8b-1560b20ab578 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:48.113351 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15701f24-d037-4845-83f0-58b1c8cca339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:48.114132 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15701f24-d037-4845-83f0-58b1c8cca339 admin admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:48.114489 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15701f24-d037-4845-83f0-58b1c8cca339 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:48.114957 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15701f24-d037-4845-83f0-58b1c8cca339 admin admin] PATH_INFO: `/v3/projects/f29bdf678c454137bc4ab3e7da5cc788/users/1068dbb3efd14d20897504f42afe236f/roles/ea564961b1db4eb4a1d4d880964611b2` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:48.158000 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15701f24-d037-4845-83f0-58b1c8cca339 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f29bdf678c454137bc4ab3e7da5cc788, user_id=1068dbb3efd14d20897504f42afe236f, role_id=ea564961b1db4eb4a1d4d880964611b2)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:48.160882 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15701f24-d037-4845-83f0-58b1c8cca339 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:48.190503 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 763/1525] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:10:48 2022] PUT /identity/v3/projects/f29bdf678c454137bc4ab3e7da5cc788/users/1068dbb3efd14d20897504f42afe236f/roles/ea564961b1db4eb4a1d4d880964611b2 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:10:48.195122 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d2f1b1-a3b0-4ca9-969f-d0d2b7e0dc56 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:48.214016 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d2f1b1-a3b0-4ca9-969f-d0d2b7e0dc56 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:48.429335 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364c452e-96bf-4ff4-b8d6-2f5d55bddfa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:48.429980 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c452e-96bf-4ff4-b8d6-2f5d55bddfa3 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:48.430262 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c452e-96bf-4ff4-b8d6-2f5d55bddfa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:48.430533 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c452e-96bf-4ff4-b8d6-2f5d55bddfa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:48.431252 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364c452e-96bf-4ff4-b8d6-2f5d55bddfa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:48.436565 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364c452e-96bf-4ff4-b8d6-2f5d55bddfa3 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:48.493875 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 763/1526] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:10:48 2022] GET /identity/v3/roles => generated 1420 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:10:48.498612 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15701f24-d037-4845-83f0-58b1c8cca339 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:48.511885 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15701f24-d037-4845-83f0-58b1c8cca339 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:48.526414 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d329ed98-7f7b-4211-9bf8-3356858dcb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:48.527161 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d329ed98-7f7b-4211-9bf8-3356858dcb92 admin admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:48.527448 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d329ed98-7f7b-4211-9bf8-3356858dcb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:48.527778 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d329ed98-7f7b-4211-9bf8-3356858dcb92 admin admin] PATH_INFO: `/v3/projects/f29bdf678c454137bc4ab3e7da5cc788/users/1068dbb3efd14d20897504f42afe236f/roles/ea564961b1db4eb4a1d4d880964611b2` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:48.535510 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d329ed98-7f7b-4211-9bf8-3356858dcb92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f29bdf678c454137bc4ab3e7da5cc788, user_id=1068dbb3efd14d20897504f42afe236f, role_id=ea564961b1db4eb4a1d4d880964611b2)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:48.545894 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d329ed98-7f7b-4211-9bf8-3356858dcb92 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:48.587052 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 764/1527] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:10:48 2022] PUT /identity/v3/projects/f29bdf678c454137bc4ab3e7da5cc788/users/1068dbb3efd14d20897504f42afe236f/roles/ea564961b1db4eb4a1d4d880964611b2 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 11:10:48.598673 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e060cd0-96d3-4101-9d62-491a9135464a None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:48.599769 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e060cd0-96d3-4101-9d62-491a9135464a None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:48.599916 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e060cd0-96d3-4101-9d62-491a9135464a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:48.703954 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-4e060cd0-96d3-4101-9d62-491a9135464a None None] MFA Rules not processed for user `1068dbb3efd14d20897504f42afe236f`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:48.711124 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-4e060cd0-96d3-4101-9d62-491a9135464a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:48.739864 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:48.774333 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d329ed98-7f7b-4211-9bf8-3356858dcb92 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:48.776169 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-d329ed98-7f7b-4211-9bf8-3356858dcb92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:48.921337 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:48.943563 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 764/1528] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:48 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:48.954750 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e060cd0-96d3-4101-9d62-491a9135464a None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:48.956911 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-4e060cd0-96d3-4101-9d62-491a9135464a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:48.988955 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d329ed98-7f7b-4211-9bf8-3356858dcb92 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:49.021461 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070a8569-5321-4749-a2a2-a3f6cd317816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:49.028262 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a8569-5321-4749-a2a2-a3f6cd317816 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:49.028661 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a8569-5321-4749-a2a2-a3f6cd317816 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:49.029819 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a8569-5321-4749-a2a2-a3f6cd317816 admin admin] PATH_INFO: `/v3/projects/9ef6f26ea95e4c6c86221aa205dbbe1f` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:49.032999 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070a8569-5321-4749-a2a2-a3f6cd317816 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ef6f26ea95e4c6c86221aa205dbbe1f)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:49.036217 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070a8569-5321-4749-a2a2-a3f6cd317816 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:49.127844 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-070a8569-5321-4749-a2a2-a3f6cd317816 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ef6f26ea95e4c6c86221aa205dbbe1f', 'request_id': 'req-070a8569-5321-4749-a2a2-a3f6cd317816'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:49.142091 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-070a8569-5321-4749-a2a2-a3f6cd317816 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ef6f26ea95e4c6c86221aa205dbbe1f', 'request_id': 'req-070a8569-5321-4749-a2a2-a3f6cd317816'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:49.146907 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e060cd0-96d3-4101-9d62-491a9135464a None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:49.153120 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-070a8569-5321-4749-a2a2-a3f6cd317816 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ef6f26ea95e4c6c86221aa205dbbe1f', 'request_id': 'req-070a8569-5321-4749-a2a2-a3f6cd317816'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:49.207671 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-070a8569-5321-4749-a2a2-a3f6cd317816 admin admin] The token cache is being invalidate because project 9ef6f26ea95e4c6c86221aa205dbbe1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:10:49.208477 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-070a8569-5321-4749-a2a2-a3f6cd317816 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:49.217024 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-070a8569-5321-4749-a2a2-a3f6cd317816 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:49.221517 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 765/1529] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:10:48 2022] DELETE /identity/v3/projects/9ef6f26ea95e4c6c86221aa205dbbe1f => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:10:49.228336 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070a8569-5321-4749-a2a2-a3f6cd317816 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:49.230411 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-070a8569-5321-4749-a2a2-a3f6cd317816 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:49.257347 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96864080-1a27-411b-9f23-fa4130468c77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f4c2fc51f54f0e977648b13efaed1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:49.258822 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96864080-1a27-411b-9f23-fa4130468c77 service cinder] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:49.259287 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96864080-1a27-411b-9f23-fa4130468c77 service cinder] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:49.259741 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96864080-1a27-411b-9f23-fa4130468c77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:49.263292 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-96864080-1a27-411b-9f23-fa4130468c77 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:49.463417 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96864080-1a27-411b-9f23-fa4130468c77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:49.466324 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070a8569-5321-4749-a2a2-a3f6cd317816 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:49.469116 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96864080-1a27-411b-9f23-fa4130468c77 service cinder] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:49.477728 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9987aad5-b1ad-44c5-b89f-e8191bbfad7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:49.478500 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9987aad5-b1ad-44c5-b89f-e8191bbfad7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:49.478869 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9987aad5-b1ad-44c5-b89f-e8191bbfad7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:49.484067 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9987aad5-b1ad-44c5-b89f-e8191bbfad7a admin admin] PATH_INFO: `/v3/users/be133261e57e40728cb4e594041e54d8` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:49.490965 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9987aad5-b1ad-44c5-b89f-e8191bbfad7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=be133261e57e40728cb4e594041e54d8)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:49.495442 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9987aad5-b1ad-44c5-b89f-e8191bbfad7a admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:49.496028 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 765/1530] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:10:48 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:10:49.722529 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-9987aad5-b1ad-44c5-b89f-e8191bbfad7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be133261e57e40728cb4e594041e54d8'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:49.761043 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-9987aad5-b1ad-44c5-b89f-e8191bbfad7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be133261e57e40728cb4e594041e54d8'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:49.762032 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-9987aad5-b1ad-44c5-b89f-e8191bbfad7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be133261e57e40728cb4e594041e54d8'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:49.764901 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-9987aad5-b1ad-44c5-b89f-e8191bbfad7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be133261e57e40728cb4e594041e54d8'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:49.798614 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-9987aad5-b1ad-44c5-b89f-e8191bbfad7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be133261e57e40728cb4e594041e54d8'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:49.821100 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:49.862785 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 766/1531] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:10:49 2022] DELETE /identity/v3/users/be133261e57e40728cb4e594041e54d8 => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:10:50.082399 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96864080-1a27-411b-9f23-fa4130468c77 service cinder] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:50.084546 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-96864080-1a27-411b-9f23-fa4130468c77 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:50.109010 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96864080-1a27-411b-9f23-fa4130468c77 service cinder] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:50.128579 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:50.265658 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d7adba-a4ce-469a-8301-17c5b73a3ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:50.267546 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7adba-a4ce-469a-8301-17c5b73a3ea0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:50.268270 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7adba-a4ce-469a-8301-17c5b73a3ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:50.268787 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7adba-a4ce-469a-8301-17c5b73a3ea0 admin admin] PATH_INFO: `/v3/users/84c3badc5b384e50bfd0c3c5d7259c4d` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:50.271367 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d7adba-a4ce-469a-8301-17c5b73a3ea0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84c3badc5b384e50bfd0c3c5d7259c4d)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:50.273933 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d7adba-a4ce-469a-8301-17c5b73a3ea0 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:50.425029 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-13d7adba-a4ce-469a-8301-17c5b73a3ea0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84c3badc5b384e50bfd0c3c5d7259c4d'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:50.425820 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-13d7adba-a4ce-469a-8301-17c5b73a3ea0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84c3badc5b384e50bfd0c3c5d7259c4d'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:50.427734 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-13d7adba-a4ce-469a-8301-17c5b73a3ea0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84c3badc5b384e50bfd0c3c5d7259c4d'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:50.457725 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-13d7adba-a4ce-469a-8301-17c5b73a3ea0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84c3badc5b384e50bfd0c3c5d7259c4d'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:50.484438 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-13d7adba-a4ce-469a-8301-17c5b73a3ea0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84c3badc5b384e50bfd0c3c5d7259c4d'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:50.522457 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 766/1532] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:10:50 2022] DELETE /identity/v3/users/84c3badc5b384e50bfd0c3c5d7259c4d => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:10:50.527853 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ed9e9-2907-48df-9095-470715b0675f None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:50.528387 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ed9e9-2907-48df-9095-470715b0675f None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:50.528689 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ed9e9-2907-48df-9095-470715b0675f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:50.557339 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d7adba-a4ce-469a-8301-17c5b73a3ea0 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:50.559683 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-13d7adba-a4ce-469a-8301-17c5b73a3ea0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:50.573123 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-975ed9e9-2907-48df-9095-470715b0675f None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:50.573123 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-975ed9e9-2907-48df-9095-470715b0675f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:50.652208 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d7adba-a4ce-469a-8301-17c5b73a3ea0 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:50.663383 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09717f88-8c27-4cd8-996f-04ba7f3b5b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:50.664711 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09717f88-8c27-4cd8-996f-04ba7f3b5b0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:50.666342 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09717f88-8c27-4cd8-996f-04ba7f3b5b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:50.666917 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09717f88-8c27-4cd8-996f-04ba7f3b5b0e admin admin] PATH_INFO: `/v3/projects/2a303078645a485f91263b3374fafaa6` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:50.669636 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09717f88-8c27-4cd8-996f-04ba7f3b5b0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a303078645a485f91263b3374fafaa6)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:50.672500 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09717f88-8c27-4cd8-996f-04ba7f3b5b0e admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:50.674815 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 767/1533] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:50.677397 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da41ed75-8c4b-4f48-ab3d-cd5d03dbb0b1 None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:50.677905 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da41ed75-8c4b-4f48-ab3d-cd5d03dbb0b1 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:50.678391 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da41ed75-8c4b-4f48-ab3d-cd5d03dbb0b1 None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:50.680275 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 768/1534] 10.222.0.25 () {54 vars in 921 bytes} [Thu Oct 13 11:10:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:10:50.686648 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da41ed75-8c4b-4f48-ab3d-cd5d03dbb0b1 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:50.690740 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-da41ed75-8c4b-4f48-ab3d-cd5d03dbb0b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:50.720348 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:50.733829 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-09717f88-8c27-4cd8-996f-04ba7f3b5b0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a303078645a485f91263b3374fafaa6', 'request_id': 'req-09717f88-8c27-4cd8-996f-04ba7f3b5b0e'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:50.745653 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-09717f88-8c27-4cd8-996f-04ba7f3b5b0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a303078645a485f91263b3374fafaa6', 'request_id': 'req-09717f88-8c27-4cd8-996f-04ba7f3b5b0e'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:50.754159 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-09717f88-8c27-4cd8-996f-04ba7f3b5b0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a303078645a485f91263b3374fafaa6', 'request_id': 'req-09717f88-8c27-4cd8-996f-04ba7f3b5b0e'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:50.772539 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-09717f88-8c27-4cd8-996f-04ba7f3b5b0e admin admin] The token cache is being invalidate because project 2a303078645a485f91263b3374fafaa6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:10:50.773925 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-09717f88-8c27-4cd8-996f-04ba7f3b5b0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:50.774989 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-09717f88-8c27-4cd8-996f-04ba7f3b5b0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:50.778225 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 767/1535] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:10:50 2022] DELETE /identity/v3/projects/2a303078645a485f91263b3374fafaa6 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:10:50.779625 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865058d5-f5da-436d-9a54-732600da0abc None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:50.779904 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865058d5-f5da-436d-9a54-732600da0abc None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:50.780175 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865058d5-f5da-436d-9a54-732600da0abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:50.787128 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da41ed75-8c4b-4f48-ab3d-cd5d03dbb0b1 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:50.805236 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-865058d5-f5da-436d-9a54-732600da0abc None None] MFA Rules not processed for user `78384fbffdd346578855e7214b335d8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:50.806894 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-865058d5-f5da-436d-9a54-732600da0abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:50.844600 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e49f454-3e32-4116-a3d7-6bfac7621088 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:50.845216 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49f454-3e32-4116-a3d7-6bfac7621088 service neutron] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:50.845537 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49f454-3e32-4116-a3d7-6bfac7621088 service neutron] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:50.845810 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49f454-3e32-4116-a3d7-6bfac7621088 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:50.847618 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-5e49f454-3e32-4116-a3d7-6bfac7621088 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:50.921292 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 768/1536] 10.222.0.25 () {58 vars in 1018 bytes} [Thu Oct 13 11:10:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:50.922726 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9caa70-75d4-4eec-a67e-c5ea980d7476 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:50.923026 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9caa70-75d4-4eec-a67e-c5ea980d7476 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:50.923309 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9caa70-75d4-4eec-a67e-c5ea980d7476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:50.938929 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:50.942068 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e49f454-3e32-4116-a3d7-6bfac7621088 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:50.945070 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e49f454-3e32-4116-a3d7-6bfac7621088 service neutron] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:50.947774 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-ba9caa70-75d4-4eec-a67e-c5ea980d7476 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:50.949137 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-ba9caa70-75d4-4eec-a67e-c5ea980d7476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:50.959607 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 769/1537] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:10:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:10:50.962990 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e49f454-3e32-4116-a3d7-6bfac7621088 service neutron] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:50.962990 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-5e49f454-3e32-4116-a3d7-6bfac7621088 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:50.966198 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 769/1538] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:50.975972 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc08ac37-35fb-44a1-b1c4-c4815b018e3e None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:50.976264 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc08ac37-35fb-44a1-b1c4-c4815b018e3e None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:50.976541 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc08ac37-35fb-44a1-b1c4-c4815b018e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:50.979632 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e49f454-3e32-4116-a3d7-6bfac7621088 service neutron] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:50.986446 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e600c07-cdc6-4dac-9128-eab88d92bb74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78384fbffdd346578855e7214b335d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:50.987129 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e600c07-cdc6-4dac-9128-eab88d92bb74 service nova] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:50.987482 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e600c07-cdc6-4dac-9128-eab88d92bb74 service nova] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:50.987821 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e600c07-cdc6-4dac-9128-eab88d92bb74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:51.001065 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e600c07-cdc6-4dac-9128-eab88d92bb74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:51.002986 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-dc08ac37-35fb-44a1-b1c4-c4815b018e3e None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:51.003474 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e600c07-cdc6-4dac-9128-eab88d92bb74 service nova] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:51.004683 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-dc08ac37-35fb-44a1-b1c4-c4815b018e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:51.016700 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 770/1539] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 11:10:51.017892 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 770/1540] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:10:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:10:51.022753 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc08ac37-35fb-44a1-b1c4-c4815b018e3e None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:51.037636 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc08ac37-35fb-44a1-b1c4-c4815b018e3e None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:51.044166 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c26dfe-b003-436f-b645-2c279b9cbe55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:51.044914 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c26dfe-b003-436f-b645-2c279b9cbe55 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:51.045536 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c26dfe-b003-436f-b645-2c279b9cbe55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:51.045979 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c26dfe-b003-436f-b645-2c279b9cbe55 admin admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:51.047239 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c26dfe-b003-436f-b645-2c279b9cbe55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:10:51.048055 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c26dfe-b003-436f-b645-2c279b9cbe55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:51.050582 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c26dfe-b003-436f-b645-2c279b9cbe55 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:51.082429 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 771/1541] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 11:10:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:10:51.084691 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e600c07-cdc6-4dac-9128-eab88d92bb74 service nova] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:51.096911 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e600c07-cdc6-4dac-9128-eab88d92bb74 service nova] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:51.103681 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e36929-72ae-483a-b0f9-e8481b5913d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:51.104525 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e36929-72ae-483a-b0f9-e8481b5913d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:51.104809 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e36929-72ae-483a-b0f9-e8481b5913d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:51.105682 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e36929-72ae-483a-b0f9-e8481b5913d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:51.106408 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e36929-72ae-483a-b0f9-e8481b5913d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:51.108660 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e36929-72ae-483a-b0f9-e8481b5913d8 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:51.140137 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 771/1542] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:10:51 2022] POST /identity/v3/projects => generated 407 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:10:51.144090 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c26dfe-b003-436f-b645-2c279b9cbe55 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:51.154521 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c26dfe-b003-436f-b645-2c279b9cbe55 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:51.222329 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e55572-f4e9-44b2-9742-10eb7cc55338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:51.223013 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e55572-f4e9-44b2-9742-10eb7cc55338 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:51.223298 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e55572-f4e9-44b2-9742-10eb7cc55338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:51.223799 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e55572-f4e9-44b2-9742-10eb7cc55338 admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:51.224603 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e55572-f4e9-44b2-9742-10eb7cc55338 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:51.226799 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e55572-f4e9-44b2-9742-10eb7cc55338 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:51.259094 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 772/1543] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:10:51 2022] POST /identity/v3/users => generated 304 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:10:51.260290 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e36929-72ae-483a-b0f9-e8481b5913d8 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:51.271895 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e36929-72ae-483a-b0f9-e8481b5913d8 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:51.277266 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf88bec9-eda1-40d2-bb38-ee9a0fe139b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:51.277914 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88bec9-eda1-40d2-bb38-ee9a0fe139b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:51.278237 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88bec9-eda1-40d2-bb38-ee9a0fe139b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:51.278501 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88bec9-eda1-40d2-bb38-ee9a0fe139b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:51.279185 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf88bec9-eda1-40d2-bb38-ee9a0fe139b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:51.280922 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf88bec9-eda1-40d2-bb38-ee9a0fe139b8 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:51.294346 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 772/1544] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:10:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:10:51.297773 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e55572-f4e9-44b2-9742-10eb7cc55338 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:51.312707 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e55572-f4e9-44b2-9742-10eb7cc55338 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:51.318736 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b60d933-8fd3-4885-8ac8-c0c2288adf21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:51.319371 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60d933-8fd3-4885-8ac8-c0c2288adf21 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:51.319654 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60d933-8fd3-4885-8ac8-c0c2288adf21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:51.319927 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60d933-8fd3-4885-8ac8-c0c2288adf21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:51.320586 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b60d933-8fd3-4885-8ac8-c0c2288adf21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:51.322231 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b60d933-8fd3-4885-8ac8-c0c2288adf21 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:51.334829 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 773/1545] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:10:51 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:10:51.338993 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf88bec9-eda1-40d2-bb38-ee9a0fe139b8 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:51.349375 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf88bec9-eda1-40d2-bb38-ee9a0fe139b8 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:51.355626 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407d17a3-8b8c-4bb8-9413-dff2b6eb1a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:51.356347 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407d17a3-8b8c-4bb8-9413-dff2b6eb1a01 admin admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:51.356614 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407d17a3-8b8c-4bb8-9413-dff2b6eb1a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:51.356923 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407d17a3-8b8c-4bb8-9413-dff2b6eb1a01 admin admin] PATH_INFO: `/v3/projects/678e32df7d234eb7b05fbf75ccf95204/users/fd2a591ea79146c2afa70f8e7acdd02a/roles/7c3871c0ab68438b9014489d50b53a22` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:51.374247 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407d17a3-8b8c-4bb8-9413-dff2b6eb1a01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=678e32df7d234eb7b05fbf75ccf95204, user_id=fd2a591ea79146c2afa70f8e7acdd02a, role_id=7c3871c0ab68438b9014489d50b53a22)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:51.376872 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407d17a3-8b8c-4bb8-9413-dff2b6eb1a01 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:51.392572 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 773/1546] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:10:51 2022] PUT /identity/v3/projects/678e32df7d234eb7b05fbf75ccf95204/users/fd2a591ea79146c2afa70f8e7acdd02a/roles/7c3871c0ab68438b9014489d50b53a22 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:10:51.403794 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc91718-0ace-4477-8d80-fdf4f813fc73 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:51.404076 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc91718-0ace-4477-8d80-fdf4f813fc73 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:51.404386 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc91718-0ace-4477-8d80-fdf4f813fc73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:51.418115 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:51.441331 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-5fc91718-0ace-4477-8d80-fdf4f813fc73 None None] MFA Rules not processed for user `fd2a591ea79146c2afa70f8e7acdd02a`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:51.444338 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-5fc91718-0ace-4477-8d80-fdf4f813fc73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:51.469290 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407d17a3-8b8c-4bb8-9413-dff2b6eb1a01 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:51.471467 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-407d17a3-8b8c-4bb8-9413-dff2b6eb1a01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:51.553932 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 774/1547] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:51 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:51.557876 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407d17a3-8b8c-4bb8-9413-dff2b6eb1a01 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:51.558775 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc91718-0ace-4477-8d80-fdf4f813fc73 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:51.564121 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4fbca6-988b-4b28-bf15-7eadc0f22255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:51.564791 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4fbca6-988b-4b28-bf15-7eadc0f22255 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:51.565068 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4fbca6-988b-4b28-bf15-7eadc0f22255 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:51.565340 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4fbca6-988b-4b28-bf15-7eadc0f22255 admin admin] PATH_INFO: `/v3/projects/dc04c41a256c40b4b9202eccede75c52` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:51.566496 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4fbca6-988b-4b28-bf15-7eadc0f22255 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc04c41a256c40b4b9202eccede75c52)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:51.568493 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4fbca6-988b-4b28-bf15-7eadc0f22255 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:51.570692 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc91718-0ace-4477-8d80-fdf4f813fc73 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:51.610945 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc2dc22-581d-4a4a-b37e-1ea5b12c75e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:51.613589 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc2dc22-581d-4a4a-b37e-1ea5b12c75e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:51.614142 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc2dc22-581d-4a4a-b37e-1ea5b12c75e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:51.616220 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc2dc22-581d-4a4a-b37e-1ea5b12c75e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:51.617095 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc2dc22-581d-4a4a-b37e-1ea5b12c75e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:51.621472 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc2dc22-581d-4a4a-b37e-1ea5b12c75e4 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:51.679594 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-7c4fbca6-988b-4b28-bf15-7eadc0f22255 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc04c41a256c40b4b9202eccede75c52', 'request_id': 'req-7c4fbca6-988b-4b28-bf15-7eadc0f22255'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:51.687555 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-7c4fbca6-988b-4b28-bf15-7eadc0f22255 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc04c41a256c40b4b9202eccede75c52', 'request_id': 'req-7c4fbca6-988b-4b28-bf15-7eadc0f22255'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:51.700456 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 775/1548] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:10:51 2022] POST /identity/v3/projects => generated 409 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:10:51.701329 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-7c4fbca6-988b-4b28-bf15-7eadc0f22255 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc04c41a256c40b4b9202eccede75c52', 'request_id': 'req-7c4fbca6-988b-4b28-bf15-7eadc0f22255'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:51.701838 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc2dc22-581d-4a4a-b37e-1ea5b12c75e4 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:51.722585 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-7c4fbca6-988b-4b28-bf15-7eadc0f22255 admin admin] The token cache is being invalidate because project dc04c41a256c40b4b9202eccede75c52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:10:51.723003 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-7c4fbca6-988b-4b28-bf15-7eadc0f22255 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:51.724578 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-7c4fbca6-988b-4b28-bf15-7eadc0f22255 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:51.726725 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 774/1549] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:10:51 2022] DELETE /identity/v3/projects/dc04c41a256c40b4b9202eccede75c52 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 11:10:51.730930 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4fbca6-988b-4b28-bf15-7eadc0f22255 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:51.737196 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-7c4fbca6-988b-4b28-bf15-7eadc0f22255 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:51.776673 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:51.872269 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc2dc22-581d-4a4a-b37e-1ea5b12c75e4 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:51.882213 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3ffda9-08a0-4219-977a-35fc972ce12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:51.882904 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ffda9-08a0-4219-977a-35fc972ce12d admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:51.883182 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ffda9-08a0-4219-977a-35fc972ce12d admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:51.883452 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ffda9-08a0-4219-977a-35fc972ce12d admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:51.884090 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3ffda9-08a0-4219-977a-35fc972ce12d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:51.886035 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3ffda9-08a0-4219-977a-35fc972ce12d admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:51.893544 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4fbca6-988b-4b28-bf15-7eadc0f22255 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:51.907540 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ca5c6-fc9b-4123-8052-bd94701dd6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:51.908217 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ca5c6-fc9b-4123-8052-bd94701dd6f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:51.908548 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ca5c6-fc9b-4123-8052-bd94701dd6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:51.908830 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ca5c6-fc9b-4123-8052-bd94701dd6f9 admin admin] PATH_INFO: `/v3/users/1068dbb3efd14d20897504f42afe236f` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:51.923561 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874ca5c6-fc9b-4123-8052-bd94701dd6f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1068dbb3efd14d20897504f42afe236f)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:51.926098 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874ca5c6-fc9b-4123-8052-bd94701dd6f9 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:51.960274 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 776/1550] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:10:51 2022] POST /identity/v3/users => generated 311 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:10:51.962740 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3ffda9-08a0-4219-977a-35fc972ce12d admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:51.967017 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-8c3ffda9-08a0-4219-977a-35fc972ce12d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:52.007860 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3ffda9-08a0-4219-977a-35fc972ce12d admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:52.033491 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1b6342-f220-4f02-aa31-59860cb44429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:52.034336 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b6342-f220-4f02-aa31-59860cb44429 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:52.036620 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b6342-f220-4f02-aa31-59860cb44429 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:52.036620 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b6342-f220-4f02-aa31-59860cb44429 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:52.037830 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1b6342-f220-4f02-aa31-59860cb44429 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:52.042154 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1b6342-f220-4f02-aa31-59860cb44429 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:52.078157 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 777/1551] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:10:51 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:10:52.082570 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1b6342-f220-4f02-aa31-59860cb44429 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:52.085156 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-874ca5c6-fc9b-4123-8052-bd94701dd6f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1068dbb3efd14d20897504f42afe236f'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:52.102258 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-874ca5c6-fc9b-4123-8052-bd94701dd6f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1068dbb3efd14d20897504f42afe236f'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:52.103253 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-874ca5c6-fc9b-4123-8052-bd94701dd6f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1068dbb3efd14d20897504f42afe236f'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:52.104959 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-874ca5c6-fc9b-4123-8052-bd94701dd6f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1068dbb3efd14d20897504f42afe236f'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:52.110252 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1b6342-f220-4f02-aa31-59860cb44429 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:52.124436 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-874ca5c6-fc9b-4123-8052-bd94701dd6f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1068dbb3efd14d20897504f42afe236f'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:52.127428 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c4947e-52e8-45c6-9fac-1c1101c4ce56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:52.145516 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4947e-52e8-45c6-9fac-1c1101c4ce56 admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:52.146314 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4947e-52e8-45c6-9fac-1c1101c4ce56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:52.149121 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4947e-52e8-45c6-9fac-1c1101c4ce56 admin admin] PATH_INFO: `/v3/projects/aee6e71ea1d146689205bc13a6075623/users/9244ca9dd2284250b8f2fdb90a64901d/roles/ea564961b1db4eb4a1d4d880964611b2` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:52.163395 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 775/1552] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:10:51 2022] DELETE /identity/v3/users/1068dbb3efd14d20897504f42afe236f => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:10:52.205672 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c4947e-52e8-45c6-9fac-1c1101c4ce56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aee6e71ea1d146689205bc13a6075623, user_id=9244ca9dd2284250b8f2fdb90a64901d, role_id=ea564961b1db4eb4a1d4d880964611b2)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:52.216190 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c4947e-52e8-45c6-9fac-1c1101c4ce56 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:52.272146 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 778/1553] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:10:52 2022] PUT /identity/v3/projects/aee6e71ea1d146689205bc13a6075623/users/9244ca9dd2284250b8f2fdb90a64901d/roles/ea564961b1db4eb4a1d4d880964611b2 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:10:52.276442 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ca5c6-fc9b-4123-8052-bd94701dd6f9 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:52.278331 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-874ca5c6-fc9b-4123-8052-bd94701dd6f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:52.508346 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ca5c6-fc9b-4123-8052-bd94701dd6f9 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:52.617174 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:52.657302 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc531fd9-c7b8-41d0-a695-9f0a4b6ad64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:52.658046 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc531fd9-c7b8-41d0-a695-9f0a4b6ad64e admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:52.658046 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc531fd9-c7b8-41d0-a695-9f0a4b6ad64e admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:52.658705 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc531fd9-c7b8-41d0-a695-9f0a4b6ad64e admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:52.659693 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc531fd9-c7b8-41d0-a695-9f0a4b6ad64e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:52.662123 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc531fd9-c7b8-41d0-a695-9f0a4b6ad64e admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:52.684314 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 776/1554] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:10:52.689157 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c4947e-52e8-45c6-9fac-1c1101c4ce56 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:52.710626 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c4947e-52e8-45c6-9fac-1c1101c4ce56 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:52.720034 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356c6249-d446-4c27-b428-4d3f068c8e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:52.721159 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c6249-d446-4c27-b428-4d3f068c8e81 admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:52.721597 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c6249-d446-4c27-b428-4d3f068c8e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:52.723427 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c6249-d446-4c27-b428-4d3f068c8e81 admin admin] PATH_INFO: `/v3/projects/aee6e71ea1d146689205bc13a6075623/users/9244ca9dd2284250b8f2fdb90a64901d/roles/ea564961b1db4eb4a1d4d880964611b2` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:52.732129 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356c6249-d446-4c27-b428-4d3f068c8e81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aee6e71ea1d146689205bc13a6075623, user_id=9244ca9dd2284250b8f2fdb90a64901d, role_id=ea564961b1db4eb4a1d4d880964611b2)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:52.737028 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356c6249-d446-4c27-b428-4d3f068c8e81 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:52.768439 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 779/1555] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:10:52 2022] PUT /identity/v3/projects/aee6e71ea1d146689205bc13a6075623/users/9244ca9dd2284250b8f2fdb90a64901d/roles/ea564961b1db4eb4a1d4d880964611b2 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:10:52.768651 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6ec63-c93f-4320-84c4-9c926b166124 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:52.778463 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6ec63-c93f-4320-84c4-9c926b166124 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:52.778862 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6ec63-c93f-4320-84c4-9c926b166124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:52.859788 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-5eb6ec63-c93f-4320-84c4-9c926b166124 None None] MFA Rules not processed for user `9244ca9dd2284250b8f2fdb90a64901d`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:52.861145 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-5eb6ec63-c93f-4320-84c4-9c926b166124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:53.074048 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 777/1556] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:52 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:53.075524 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356c6249-d446-4c27-b428-4d3f068c8e81 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:53.079032 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-356c6249-d446-4c27-b428-4d3f068c8e81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:53.130922 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:53.172748 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356c6249-d446-4c27-b428-4d3f068c8e81 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:53.177315 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd23873d-07b7-4ed4-8783-57a33b6cb4cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f4c2fc51f54f0e977648b13efaed1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:53.178142 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23873d-07b7-4ed4-8783-57a33b6cb4cc service cinder] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:53.178425 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23873d-07b7-4ed4-8783-57a33b6cb4cc service cinder] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:53.178699 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23873d-07b7-4ed4-8783-57a33b6cb4cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:53.190213 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd23873d-07b7-4ed4-8783-57a33b6cb4cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:53.191916 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd23873d-07b7-4ed4-8783-57a33b6cb4cc service cinder] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:53.203141 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 780/1557] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:10:53 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:10:53.469405 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb6ec63-c93f-4320-84c4-9c926b166124 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:53.485505 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd23873d-07b7-4ed4-8783-57a33b6cb4cc service cinder] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:53.491260 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-bd23873d-07b7-4ed4-8783-57a33b6cb4cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:53.516573 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb6ec63-c93f-4320-84c4-9c926b166124 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:53.532839 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a74986e-0830-486a-9ff4-34166fd619e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f4c2fc51f54f0e977648b13efaed1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:53.534220 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a74986e-0830-486a-9ff4-34166fd619e0 service cinder] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:53.534873 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a74986e-0830-486a-9ff4-34166fd619e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:53.535509 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a74986e-0830-486a-9ff4-34166fd619e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:53.540145 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-8a74986e-0830-486a-9ff4-34166fd619e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:53.665635 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd23873d-07b7-4ed4-8783-57a33b6cb4cc service cinder] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:53.668073 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a74986e-0830-486a-9ff4-34166fd619e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:53.670337 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a74986e-0830-486a-9ff4-34166fd619e0 service cinder] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:53.670541 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd759e5-a8f6-4062-b67f-a6d575bf0db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:53.671183 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd759e5-a8f6-4062-b67f-a6d575bf0db2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:53.671644 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd759e5-a8f6-4062-b67f-a6d575bf0db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:53.671927 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd759e5-a8f6-4062-b67f-a6d575bf0db2 admin admin] PATH_INFO: `/v3/projects/f29bdf678c454137bc4ab3e7da5cc788` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:53.673701 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd759e5-a8f6-4062-b67f-a6d575bf0db2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f29bdf678c454137bc4ab3e7da5cc788)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:53.682995 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd759e5-a8f6-4062-b67f-a6d575bf0db2 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:53.684155 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 778/1558] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:10:53 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:10:53.783112 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-4bd759e5-a8f6-4062-b67f-a6d575bf0db2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f29bdf678c454137bc4ab3e7da5cc788', 'request_id': 'req-4bd759e5-a8f6-4062-b67f-a6d575bf0db2'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:53.797394 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-4bd759e5-a8f6-4062-b67f-a6d575bf0db2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f29bdf678c454137bc4ab3e7da5cc788', 'request_id': 'req-4bd759e5-a8f6-4062-b67f-a6d575bf0db2'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:53.805580 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-4bd759e5-a8f6-4062-b67f-a6d575bf0db2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f29bdf678c454137bc4ab3e7da5cc788', 'request_id': 'req-4bd759e5-a8f6-4062-b67f-a6d575bf0db2'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:53.831183 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-4bd759e5-a8f6-4062-b67f-a6d575bf0db2 admin admin] The token cache is being invalidate because project f29bdf678c454137bc4ab3e7da5cc788 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:10:53.831377 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-4bd759e5-a8f6-4062-b67f-a6d575bf0db2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:53.835799 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-4bd759e5-a8f6-4062-b67f-a6d575bf0db2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:53.838940 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 781/1559] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:10:53 2022] DELETE /identity/v3/projects/f29bdf678c454137bc4ab3e7da5cc788 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:10:53.844319 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db54249-6995-43c9-8197-b59c0c7d2175 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:53.844603 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db54249-6995-43c9-8197-b59c0c7d2175 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:53.845199 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db54249-6995-43c9-8197-b59c0c7d2175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:53.885530 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-2db54249-6995-43c9-8197-b59c0c7d2175 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:53.887225 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-2db54249-6995-43c9-8197-b59c0c7d2175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:53.987884 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 779/1560] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:53.996562 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f35f01-1c0f-4337-9844-73a8d1561e11 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:53.996936 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f35f01-1c0f-4337-9844-73a8d1561e11 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:53.997436 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f35f01-1c0f-4337-9844-73a8d1561e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:54.025359 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-00f35f01-1c0f-4337-9844-73a8d1561e11 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:54.026664 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-00f35f01-1c0f-4337-9844-73a8d1561e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:54.064501 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 782/1561] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:54.066453 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db54249-6995-43c9-8197-b59c0c7d2175 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:54.072188 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:54.097421 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db54249-6995-43c9-8197-b59c0c7d2175 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:54.103100 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b25ee3-df4d-484e-a30c-6c2e3d278e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:54.103714 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b25ee3-df4d-484e-a30c-6c2e3d278e3c admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:54.103992 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b25ee3-df4d-484e-a30c-6c2e3d278e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:54.104310 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b25ee3-df4d-484e-a30c-6c2e3d278e3c admin admin] PATH_INFO: `/v3/domains` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:54.105082 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b25ee3-df4d-484e-a30c-6c2e3d278e3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:10:54.105386 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b25ee3-df4d-484e-a30c-6c2e3d278e3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:54.107124 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b25ee3-df4d-484e-a30c-6c2e3d278e3c admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:54.130462 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 780/1562] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 11:10:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:10:54.137412 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f35f01-1c0f-4337-9844-73a8d1561e11 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:54.152113 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f35f01-1c0f-4337-9844-73a8d1561e11 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:54.162401 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c6c0b7-0726-4be5-8fda-317d68b3dc52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:54.163122 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c6c0b7-0726-4be5-8fda-317d68b3dc52 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:54.164699 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c6c0b7-0726-4be5-8fda-317d68b3dc52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:54.164699 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c6c0b7-0726-4be5-8fda-317d68b3dc52 admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:54.164699 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c6c0b7-0726-4be5-8fda-317d68b3dc52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:54.167580 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c6c0b7-0726-4be5-8fda-317d68b3dc52 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:54.257602 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 783/1563] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:10:54 2022] POST /identity/v3/projects => generated 373 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:10:54.263109 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b25ee3-df4d-484e-a30c-6c2e3d278e3c admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:54.281419 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b25ee3-df4d-484e-a30c-6c2e3d278e3c admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:54.415130 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780b09bf-c21c-44b2-913c-4a1b93290fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:54.415580 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b09bf-c21c-44b2-913c-4a1b93290fcc admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:54.415860 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b09bf-c21c-44b2-913c-4a1b93290fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:54.416133 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b09bf-c21c-44b2-913c-4a1b93290fcc admin admin] PATH_INFO: `/v3/users` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:54.416920 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780b09bf-c21c-44b2-913c-4a1b93290fcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:54.427671 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780b09bf-c21c-44b2-913c-4a1b93290fcc admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:54.483379 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 781/1564] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:10:54 2022] POST /identity/v3/users => generated 287 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:10:54.486627 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c6c0b7-0726-4be5-8fda-317d68b3dc52 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:54.503522 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c6c0b7-0726-4be5-8fda-317d68b3dc52 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:54.517800 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d8f05d-e352-4fa2-90c3-db06272ca934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:54.518467 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8f05d-e352-4fa2-90c3-db06272ca934 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:54.518752 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8f05d-e352-4fa2-90c3-db06272ca934 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:54.519028 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8f05d-e352-4fa2-90c3-db06272ca934 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:54.519685 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d8f05d-e352-4fa2-90c3-db06272ca934 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:54.521801 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d8f05d-e352-4fa2-90c3-db06272ca934 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:54.571406 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 784/1565] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:10:54 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:10:54.575749 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780b09bf-c21c-44b2-913c-4a1b93290fcc admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:54.589813 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780b09bf-c21c-44b2-913c-4a1b93290fcc admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:54.597561 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41446b1c-b859-4401-8b2e-29d5f13bccd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:54.599799 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41446b1c-b859-4401-8b2e-29d5f13bccd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:54.600246 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41446b1c-b859-4401-8b2e-29d5f13bccd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:54.600625 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41446b1c-b859-4401-8b2e-29d5f13bccd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:54.601300 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41446b1c-b859-4401-8b2e-29d5f13bccd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:54.605599 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41446b1c-b859-4401-8b2e-29d5f13bccd8 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:54.622297 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 782/1566] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:10:54 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:10:54.625823 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d8f05d-e352-4fa2-90c3-db06272ca934 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:54.644481 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d8f05d-e352-4fa2-90c3-db06272ca934 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:54.658786 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d6f491-1059-4dbf-ab3f-d81efd2215ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:54.659618 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6f491-1059-4dbf-ab3f-d81efd2215ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:54.659991 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6f491-1059-4dbf-ab3f-d81efd2215ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:54.660366 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6f491-1059-4dbf-ab3f-d81efd2215ad admin admin] PATH_INFO: `/v3/projects/28f2bb2fd4984643a28a296bb1f64802/users/97771d261ccd473abc191a1853a255a0/roles/7c3871c0ab68438b9014489d50b53a22` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:54.664933 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:54.689009 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d6f491-1059-4dbf-ab3f-d81efd2215ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=28f2bb2fd4984643a28a296bb1f64802, user_id=97771d261ccd473abc191a1853a255a0, role_id=7c3871c0ab68438b9014489d50b53a22)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:54.693907 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d6f491-1059-4dbf-ab3f-d81efd2215ad admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:54.729369 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 785/1567] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:10:54 2022] PUT /identity/v3/projects/28f2bb2fd4984643a28a296bb1f64802/users/97771d261ccd473abc191a1853a255a0/roles/7c3871c0ab68438b9014489d50b53a22 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:10:54.748601 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9208dd1-0668-434d-a923-6626d4a8f458 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:54.749167 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9208dd1-0668-434d-a923-6626d4a8f458 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:54.749167 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9208dd1-0668-434d-a923-6626d4a8f458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:54.820804 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-a9208dd1-0668-434d-a923-6626d4a8f458 None None] MFA Rules not processed for user `97771d261ccd473abc191a1853a255a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:54.822330 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-a9208dd1-0668-434d-a923-6626d4a8f458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:54.945002 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d6f491-1059-4dbf-ab3f-d81efd2215ad admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:54.947576 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-b4d6f491-1059-4dbf-ab3f-d81efd2215ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:55.087452 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 783/1568] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:55.096887 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d6f491-1059-4dbf-ab3f-d81efd2215ad admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:55.101049 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9208dd1-0668-434d-a923-6626d4a8f458 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:55.103464 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-a9208dd1-0668-434d-a923-6626d4a8f458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:55.118365 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a91380-2d96-48f2-a7c8-39386a4363a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:55.119023 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a91380-2d96-48f2-a7c8-39386a4363a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:55.119304 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a91380-2d96-48f2-a7c8-39386a4363a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:55.119575 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a91380-2d96-48f2-a7c8-39386a4363a0 admin admin] PATH_INFO: `/v3/users/e13f9d5aba0a4a179106517b1337b7f1` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:55.121047 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a91380-2d96-48f2-a7c8-39386a4363a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e13f9d5aba0a4a179106517b1337b7f1)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:55.127787 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a91380-2d96-48f2-a7c8-39386a4363a0 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:55.203738 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-e5a91380-2d96-48f2-a7c8-39386a4363a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e13f9d5aba0a4a179106517b1337b7f1'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:55.205238 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-e5a91380-2d96-48f2-a7c8-39386a4363a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e13f9d5aba0a4a179106517b1337b7f1'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:55.207635 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-e5a91380-2d96-48f2-a7c8-39386a4363a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e13f9d5aba0a4a179106517b1337b7f1'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:55.225421 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-e5a91380-2d96-48f2-a7c8-39386a4363a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e13f9d5aba0a4a179106517b1337b7f1'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:55.236916 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-e5a91380-2d96-48f2-a7c8-39386a4363a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e13f9d5aba0a4a179106517b1337b7f1'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:55.237047 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9208dd1-0668-434d-a923-6626d4a8f458 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:55.250028 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a9dd6d-5101-4deb-a402-6d75826f07e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f4c2fc51f54f0e977648b13efaed1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:55.250660 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9dd6d-5101-4deb-a402-6d75826f07e9 service cinder] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:55.250937 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9dd6d-5101-4deb-a402-6d75826f07e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:55.251205 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9dd6d-5101-4deb-a402-6d75826f07e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:55.255957 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 786/1569] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:10:54 2022] DELETE /identity/v3/users/e13f9d5aba0a4a179106517b1337b7f1 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:10:55.257787 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-f0a9dd6d-5101-4deb-a402-6d75826f07e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:55.261852 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd76890-09b0-490f-8802-80d151411858 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:55.262168 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd76890-09b0-490f-8802-80d151411858 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:55.262445 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd76890-09b0-490f-8802-80d151411858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:55.284188 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a9dd6d-5101-4deb-a402-6d75826f07e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:55.286733 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-6fd76890-09b0-490f-8802-80d151411858 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:55.287783 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a9dd6d-5101-4deb-a402-6d75826f07e9 service cinder] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:55.288019 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-6fd76890-09b0-490f-8802-80d151411858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:55.295340 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:55.302494 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 784/1570] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:10:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:10:55.335452 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a9dd6d-5101-4deb-a402-6d75826f07e9 service cinder] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:55.337527 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-f0a9dd6d-5101-4deb-a402-6d75826f07e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:55.375053 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a9dd6d-5101-4deb-a402-6d75826f07e9 service cinder] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:55.423744 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 787/1571] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:55.438289 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd76890-09b0-490f-8802-80d151411858 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:55.441574 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-6fd76890-09b0-490f-8802-80d151411858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:55.451937 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:55.580200 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d53528e-c789-47ab-82ce-3015436ba8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:55.582214 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53528e-c789-47ab-82ce-3015436ba8b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:55.582681 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53528e-c789-47ab-82ce-3015436ba8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:55.583315 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53528e-c789-47ab-82ce-3015436ba8b2 admin admin] PATH_INFO: `/v3/users/97771d261ccd473abc191a1853a255a0` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:55.594087 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d53528e-c789-47ab-82ce-3015436ba8b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97771d261ccd473abc191a1853a255a0)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:55.597482 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd76890-09b0-490f-8802-80d151411858 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:55.606254 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d53528e-c789-47ab-82ce-3015436ba8b2 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:55.608145 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4acb47-2af0-48bf-879f-29ac71ce1f40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:55.608930 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4acb47-2af0-48bf-879f-29ac71ce1f40 service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:55.609111 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4acb47-2af0-48bf-879f-29ac71ce1f40 service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:55.609432 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4acb47-2af0-48bf-879f-29ac71ce1f40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:55.620977 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4acb47-2af0-48bf-879f-29ac71ce1f40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:55.623515 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4acb47-2af0-48bf-879f-29ac71ce1f40 service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:55.645157 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 788/1572] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:10:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:10:55.722107 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-9d53528e-c789-47ab-82ce-3015436ba8b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97771d261ccd473abc191a1853a255a0'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:55.755456 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-9d53528e-c789-47ab-82ce-3015436ba8b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97771d261ccd473abc191a1853a255a0'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:55.761293 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-9d53528e-c789-47ab-82ce-3015436ba8b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97771d261ccd473abc191a1853a255a0'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:55.764324 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-9d53528e-c789-47ab-82ce-3015436ba8b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97771d261ccd473abc191a1853a255a0'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:55.787136 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-9d53528e-c789-47ab-82ce-3015436ba8b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97771d261ccd473abc191a1853a255a0'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:55.855318 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 785/1573] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:10:55 2022] DELETE /identity/v3/users/97771d261ccd473abc191a1853a255a0 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 11:10:55.857639 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a09b4-3987-4958-b85c-a30132ca411b None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:55.858028 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a09b4-3987-4958-b85c-a30132ca411b None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:55.858308 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a09b4-3987-4958-b85c-a30132ca411b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:55.869384 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd4b6b4-b23c-46f4-9321-17ffb7439007 None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:55.869557 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd4b6b4-b23c-46f4-9321-17ffb7439007 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:55.870347 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd4b6b4-b23c-46f4-9321-17ffb7439007 None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:55.871407 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 786/1574] 10.222.0.25 () {54 vars in 921 bytes} [Thu Oct 13 11:10:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:10:55.895010 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0587fb-8a3c-49f1-a085-c07b7dbce65e None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:55.895536 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0587fb-8a3c-49f1-a085-c07b7dbce65e None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:55.895881 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0587fb-8a3c-49f1-a085-c07b7dbce65e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:55.906458 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-660a09b4-3987-4958-b85c-a30132ca411b None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:55.908005 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-660a09b4-3987-4958-b85c-a30132ca411b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:55.937647 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-2f0587fb-8a3c-49f1-a085-c07b7dbce65e None None] MFA Rules not processed for user `78384fbffdd346578855e7214b335d8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:55.939039 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-2f0587fb-8a3c-49f1-a085-c07b7dbce65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:56.009145 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 789/1575] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:56.029632 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 787/1576] 10.222.0.25 () {58 vars in 1018 bytes} [Thu Oct 13 11:10:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:56.038864 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660a09b4-3987-4958-b85c-a30132ca411b None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:56.040296 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-660a09b4-3987-4958-b85c-a30132ca411b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:56.140559 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660a09b4-3987-4958-b85c-a30132ca411b None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:56.144256 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0587fb-8a3c-49f1-a085-c07b7dbce65e None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:56.146904 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-2f0587fb-8a3c-49f1-a085-c07b7dbce65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:56.166667 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357a37bf-c847-40c8-9842-0b7dbc53e0bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:56.167300 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a37bf-c847-40c8-9842-0b7dbc53e0bd service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:56.167578 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a37bf-c847-40c8-9842-0b7dbc53e0bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:56.167849 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a37bf-c847-40c8-9842-0b7dbc53e0bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:56.180987 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0587fb-8a3c-49f1-a085-c07b7dbce65e None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:56.186876 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357a37bf-c847-40c8-9842-0b7dbc53e0bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:56.189401 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357a37bf-c847-40c8-9842-0b7dbc53e0bd service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:56.192061 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addc34ec-d7a3-478c-903a-8b775ef472fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78384fbffdd346578855e7214b335d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:56.193143 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc34ec-d7a3-478c-903a-8b775ef472fa service nova] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:56.193143 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc34ec-d7a3-478c-903a-8b775ef472fa service nova] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:56.193534 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc34ec-d7a3-478c-903a-8b775ef472fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:56.216798 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addc34ec-d7a3-478c-903a-8b775ef472fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:56.218373 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 790/1577] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:10:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:10:56.219490 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addc34ec-d7a3-478c-903a-8b775ef472fa service nova] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:56.225806 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:56.233160 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 788/1578] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:10:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 13 11:10:56.673178 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357a37bf-c847-40c8-9842-0b7dbc53e0bd service neutron] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:56.674651 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-357a37bf-c847-40c8-9842-0b7dbc53e0bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:56.695600 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357a37bf-c847-40c8-9842-0b7dbc53e0bd service neutron] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:56.715677 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4897ddd-001d-436b-bcae-b1774850f176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:56.716337 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4897ddd-001d-436b-bcae-b1774850f176 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:56.716616 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4897ddd-001d-436b-bcae-b1774850f176 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:56.716891 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4897ddd-001d-436b-bcae-b1774850f176 admin admin] PATH_INFO: `/v3/projects/7a9870610ab042aeb2a2247af02c92b0` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:56.718324 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4897ddd-001d-436b-bcae-b1774850f176 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a9870610ab042aeb2a2247af02c92b0)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:56.720622 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4897ddd-001d-436b-bcae-b1774850f176 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:56.822228 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:56.827744 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-c4897ddd-001d-436b-bcae-b1774850f176 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a9870610ab042aeb2a2247af02c92b0', 'request_id': 'req-c4897ddd-001d-436b-bcae-b1774850f176'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:56.850204 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-c4897ddd-001d-436b-bcae-b1774850f176 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a9870610ab042aeb2a2247af02c92b0', 'request_id': 'req-c4897ddd-001d-436b-bcae-b1774850f176'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:56.870124 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-c4897ddd-001d-436b-bcae-b1774850f176 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a9870610ab042aeb2a2247af02c92b0', 'request_id': 'req-c4897ddd-001d-436b-bcae-b1774850f176'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:56.886424 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-c4897ddd-001d-436b-bcae-b1774850f176 admin admin] The token cache is being invalidate because project 7a9870610ab042aeb2a2247af02c92b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:10:56.892333 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-c4897ddd-001d-436b-bcae-b1774850f176 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:56.892333 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-c4897ddd-001d-436b-bcae-b1774850f176 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:56.892333 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 791/1579] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:10:56 2022] DELETE /identity/v3/projects/7a9870610ab042aeb2a2247af02c92b0 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:10:56.894149 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addc34ec-d7a3-478c-903a-8b775ef472fa service nova] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:56.904938 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4897ddd-001d-436b-bcae-b1774850f176 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:56.909792 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-c4897ddd-001d-436b-bcae-b1774850f176 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:56.913027 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addc34ec-d7a3-478c-903a-8b775ef472fa service nova] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:57.026753 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4897ddd-001d-436b-bcae-b1774850f176 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:57.034774 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f7d6d8-0e69-41f0-8bb2-5f4a29c47a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:57.036758 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f7d6d8-0e69-41f0-8bb2-5f4a29c47a2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:57.036758 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f7d6d8-0e69-41f0-8bb2-5f4a29c47a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:57.036758 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f7d6d8-0e69-41f0-8bb2-5f4a29c47a2a admin admin] PATH_INFO: `/v3/projects/28f2bb2fd4984643a28a296bb1f64802` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:57.037919 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f7d6d8-0e69-41f0-8bb2-5f4a29c47a2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=28f2bb2fd4984643a28a296bb1f64802)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:57.040568 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f7d6d8-0e69-41f0-8bb2-5f4a29c47a2a admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:57.044660 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc524284-a047-44f9-a7dd-b43efaf90685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:57.045402 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc524284-a047-44f9-a7dd-b43efaf90685 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:57.047015 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc524284-a047-44f9-a7dd-b43efaf90685 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:57.048590 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc524284-a047-44f9-a7dd-b43efaf90685 admin admin] PATH_INFO: `/v3/users/cf9f99ace5d249c0ad75c6b6da0b610d` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:57.050478 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc524284-a047-44f9-a7dd-b43efaf90685 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf9f99ace5d249c0ad75c6b6da0b610d)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:57.054555 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc524284-a047-44f9-a7dd-b43efaf90685 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:57.122520 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-d8f7d6d8-0e69-41f0-8bb2-5f4a29c47a2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28f2bb2fd4984643a28a296bb1f64802', 'request_id': 'req-d8f7d6d8-0e69-41f0-8bb2-5f4a29c47a2a'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:57.141721 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-d8f7d6d8-0e69-41f0-8bb2-5f4a29c47a2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28f2bb2fd4984643a28a296bb1f64802', 'request_id': 'req-d8f7d6d8-0e69-41f0-8bb2-5f4a29c47a2a'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:57.156857 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-cc524284-a047-44f9-a7dd-b43efaf90685 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf9f99ace5d249c0ad75c6b6da0b610d'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:57.165979 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-cc524284-a047-44f9-a7dd-b43efaf90685 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf9f99ace5d249c0ad75c6b6da0b610d'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:57.168838 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-d8f7d6d8-0e69-41f0-8bb2-5f4a29c47a2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28f2bb2fd4984643a28a296bb1f64802', 'request_id': 'req-d8f7d6d8-0e69-41f0-8bb2-5f4a29c47a2a'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:57.174605 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-cc524284-a047-44f9-a7dd-b43efaf90685 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf9f99ace5d249c0ad75c6b6da0b610d'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:57.175768 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-cc524284-a047-44f9-a7dd-b43efaf90685 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf9f99ace5d249c0ad75c6b6da0b610d'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:57.187258 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-d8f7d6d8-0e69-41f0-8bb2-5f4a29c47a2a admin admin] The token cache is being invalidate because project 28f2bb2fd4984643a28a296bb1f64802 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:10:57.187636 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-d8f7d6d8-0e69-41f0-8bb2-5f4a29c47a2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:57.189321 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-d8f7d6d8-0e69-41f0-8bb2-5f4a29c47a2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:57.191636 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-cc524284-a047-44f9-a7dd-b43efaf90685 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf9f99ace5d249c0ad75c6b6da0b610d'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:57.193977 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 792/1580] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:10:56 2022] DELETE /identity/v3/projects/28f2bb2fd4984643a28a296bb1f64802 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:10:57.244024 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 789/1581] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:10:56 2022] DELETE /identity/v3/users/cf9f99ace5d249c0ad75c6b6da0b610d => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:10:58.016167 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f7d6d8-0e69-41f0-8bb2-5f4a29c47a2a admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:58.017999 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-d8f7d6d8-0e69-41f0-8bb2-5f4a29c47a2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:58.095766 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f7d6d8-0e69-41f0-8bb2-5f4a29c47a2a admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:58.105374 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:58.175637 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce5acd4-3283-4c98-b809-58e7f98902df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:58.176285 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5acd4-3283-4c98-b809-58e7f98902df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:58.177122 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5acd4-3283-4c98-b809-58e7f98902df admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:58.177562 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5acd4-3283-4c98-b809-58e7f98902df admin admin] PATH_INFO: `/v3/projects/920d426f482c485693dab3696faa7394` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:58.180709 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce5acd4-3283-4c98-b809-58e7f98902df admin admin] RBAC: Authorizing `identity:delete_project(project_id=920d426f482c485693dab3696faa7394)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:58.183735 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce5acd4-3283-4c98-b809-58e7f98902df admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:58.255675 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-3ce5acd4-3283-4c98-b809-58e7f98902df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '920d426f482c485693dab3696faa7394', 'request_id': 'req-3ce5acd4-3283-4c98-b809-58e7f98902df'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:58.266650 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-3ce5acd4-3283-4c98-b809-58e7f98902df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '920d426f482c485693dab3696faa7394', 'request_id': 'req-3ce5acd4-3283-4c98-b809-58e7f98902df'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:58.277978 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-3ce5acd4-3283-4c98-b809-58e7f98902df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '920d426f482c485693dab3696faa7394', 'request_id': 'req-3ce5acd4-3283-4c98-b809-58e7f98902df'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:58.299560 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-3ce5acd4-3283-4c98-b809-58e7f98902df admin admin] The token cache is being invalidate because project 920d426f482c485693dab3696faa7394 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:10:58.301389 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-3ce5acd4-3283-4c98-b809-58e7f98902df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:58.302223 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-3ce5acd4-3283-4c98-b809-58e7f98902df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:10:58.304043 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 793/1582] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:10:58 2022] DELETE /identity/v3/projects/920d426f482c485693dab3696faa7394 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:10:58.308517 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63adbc-a396-4b40-83f5-bca9cb2493c4 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:58.308990 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63adbc-a396-4b40-83f5-bca9cb2493c4 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:58.309069 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63adbc-a396-4b40-83f5-bca9cb2493c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:58.330793 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-9a63adbc-a396-4b40-83f5-bca9cb2493c4 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:58.332003 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-9a63adbc-a396-4b40-83f5-bca9cb2493c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:58.406376 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 790/1583] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:58.414266 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c976e925-4d55-4cb9-912a-69acf78ce6f4 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:58.414548 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c976e925-4d55-4cb9-912a-69acf78ce6f4 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:58.414820 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c976e925-4d55-4cb9-912a-69acf78ce6f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:58.438353 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-c976e925-4d55-4cb9-912a-69acf78ce6f4 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:58.439888 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-c976e925-4d55-4cb9-912a-69acf78ce6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:58.452364 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 794/1584] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:58.454843 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a63adbc-a396-4b40-83f5-bca9cb2493c4 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:58.466400 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a63adbc-a396-4b40-83f5-bca9cb2493c4 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:58.474382 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993026b1-6625-46e3-8773-13a431005cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:58.475186 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993026b1-6625-46e3-8773-13a431005cac admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:58.475576 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993026b1-6625-46e3-8773-13a431005cac admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:58.476080 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993026b1-6625-46e3-8773-13a431005cac admin admin] PATH_INFO: `/v3/domains` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:58.476750 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993026b1-6625-46e3-8773-13a431005cac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:10:58.477054 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993026b1-6625-46e3-8773-13a431005cac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:58.478683 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993026b1-6625-46e3-8773-13a431005cac admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:58.495086 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 791/1585] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 11:10:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:10:58.499784 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c976e925-4d55-4cb9-912a-69acf78ce6f4 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:58.510099 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c976e925-4d55-4cb9-912a-69acf78ce6f4 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:58.515196 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf76a6d3-b8d8-40b1-8d37-2145544a6336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:58.515810 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf76a6d3-b8d8-40b1-8d37-2145544a6336 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:58.516091 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf76a6d3-b8d8-40b1-8d37-2145544a6336 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:58.516362 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf76a6d3-b8d8-40b1-8d37-2145544a6336 admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:58.517013 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf76a6d3-b8d8-40b1-8d37-2145544a6336 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:58.518998 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf76a6d3-b8d8-40b1-8d37-2145544a6336 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:58.555880 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 795/1586] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:10:58 2022] POST /identity/v3/projects => generated 359 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:10:58.558990 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993026b1-6625-46e3-8773-13a431005cac admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:58.568316 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:58.577408 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993026b1-6625-46e3-8773-13a431005cac admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:58.679894 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4dd86f-4761-4d97-a6f4-cd685630646d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:58.680518 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4dd86f-4761-4d97-a6f4-cd685630646d admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:58.680797 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4dd86f-4761-4d97-a6f4-cd685630646d admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:58.681203 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4dd86f-4761-4d97-a6f4-cd685630646d admin admin] PATH_INFO: `/v3/users` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:58.682584 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4dd86f-4761-4d97-a6f4-cd685630646d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:58.685301 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4dd86f-4761-4d97-a6f4-cd685630646d admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:58.735096 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf76a6d3-b8d8-40b1-8d37-2145544a6336 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:58.744220 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 792/1587] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:10:58 2022] POST /identity/v3/users => generated 280 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:10:58.746832 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf76a6d3-b8d8-40b1-8d37-2145544a6336 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:58.757582 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e45215-5ff4-401f-bff0-f9bc171aee9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:58.758700 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e45215-5ff4-401f-bff0-f9bc171aee9c admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:58.759251 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e45215-5ff4-401f-bff0-f9bc171aee9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:58.759698 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e45215-5ff4-401f-bff0-f9bc171aee9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:58.760471 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e45215-5ff4-401f-bff0-f9bc171aee9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:58.762480 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e45215-5ff4-401f-bff0-f9bc171aee9c admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:58.778873 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 796/1588] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:10:58 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:10:58.782518 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4dd86f-4761-4d97-a6f4-cd685630646d admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:58.796083 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4dd86f-4761-4d97-a6f4-cd685630646d admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:58.800907 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac23f81-ee81-4c5b-aebb-773519fc1e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:58.801537 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac23f81-ee81-4c5b-aebb-773519fc1e72 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:58.802411 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac23f81-ee81-4c5b-aebb-773519fc1e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:58.802681 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac23f81-ee81-4c5b-aebb-773519fc1e72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:58.803348 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac23f81-ee81-4c5b-aebb-773519fc1e72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:58.804964 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac23f81-ee81-4c5b-aebb-773519fc1e72 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:58.821272 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 793/1589] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:10:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:10:58.824348 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e45215-5ff4-401f-bff0-f9bc171aee9c admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:58.838308 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e45215-5ff4-401f-bff0-f9bc171aee9c admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:58.846771 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74ca43b-7a4c-42a9-917e-5f7e4734372a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:58.847616 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ca43b-7a4c-42a9-917e-5f7e4734372a admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:58.847908 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ca43b-7a4c-42a9-917e-5f7e4734372a admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:58.848249 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ca43b-7a4c-42a9-917e-5f7e4734372a admin admin] PATH_INFO: `/v3/projects/eb78fa05bc5e40f1af5259659364d7d1/users/cb6bf725ff084e61ab38a301e575a32b/roles/7c3871c0ab68438b9014489d50b53a22` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:58.869138 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74ca43b-7a4c-42a9-917e-5f7e4734372a admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb78fa05bc5e40f1af5259659364d7d1, user_id=cb6bf725ff084e61ab38a301e575a32b, role_id=7c3871c0ab68438b9014489d50b53a22)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:58.872551 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74ca43b-7a4c-42a9-917e-5f7e4734372a admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:58.902803 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 797/1590] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:10:58 2022] PUT /identity/v3/projects/eb78fa05bc5e40f1af5259659364d7d1/users/cb6bf725ff084e61ab38a301e575a32b/roles/7c3871c0ab68438b9014489d50b53a22 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:10:58.915683 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc57e6-f40c-41f0-8e9b-d641e8c6fa95 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:58.915990 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc57e6-f40c-41f0-8e9b-d641e8c6fa95 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:58.916279 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc57e6-f40c-41f0-8e9b-d641e8c6fa95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:58.962254 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-e3fc57e6-f40c-41f0-8e9b-d641e8c6fa95 None None] MFA Rules not processed for user `cb6bf725ff084e61ab38a301e575a32b`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:58.963048 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-e3fc57e6-f40c-41f0-8e9b-d641e8c6fa95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:59.060704 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 794/1591] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:58 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:59.061296 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74ca43b-7a4c-42a9-917e-5f7e4734372a admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:59.116937 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:59.147303 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74ca43b-7a4c-42a9-917e-5f7e4734372a admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:59.153021 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cbe874-2f6d-4a36-8506-b303d33e33bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:59.153309 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cbe874-2f6d-4a36-8506-b303d33e33bb admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:59.153751 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cbe874-2f6d-4a36-8506-b303d33e33bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:59.154198 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cbe874-2f6d-4a36-8506-b303d33e33bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:59.154528 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cbe874-2f6d-4a36-8506-b303d33e33bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:59.156479 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cbe874-2f6d-4a36-8506-b303d33e33bb admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:59.191441 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 798/1592] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:10:59 2022] POST /identity/v3/projects => generated 365 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:10:59.191583 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc57e6-f40c-41f0-8e9b-d641e8c6fa95 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:59.203507 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc57e6-f40c-41f0-8e9b-d641e8c6fa95 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:59.269429 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fcb6bb-9d06-4de3-be59-3b309062f0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:59.269825 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fcb6bb-9d06-4de3-be59-3b309062f0ba admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:59.270135 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fcb6bb-9d06-4de3-be59-3b309062f0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:59.270971 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fcb6bb-9d06-4de3-be59-3b309062f0ba admin admin] PATH_INFO: `/v3/users` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:59.271581 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fcb6bb-9d06-4de3-be59-3b309062f0ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:59.273500 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fcb6bb-9d06-4de3-be59-3b309062f0ba admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:59.295291 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 795/1593] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:10:59 2022] POST /identity/v3/users => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 11:10:59.300987 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cbe874-2f6d-4a36-8506-b303d33e33bb admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:59.315497 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cbe874-2f6d-4a36-8506-b303d33e33bb admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:59.323853 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea24b8fb-818e-4c92-8cf3-f0e2cc7c6f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:59.324969 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea24b8fb-818e-4c92-8cf3-f0e2cc7c6f4c admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:59.325465 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea24b8fb-818e-4c92-8cf3-f0e2cc7c6f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:59.325976 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea24b8fb-818e-4c92-8cf3-f0e2cc7c6f4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:59.327167 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea24b8fb-818e-4c92-8cf3-f0e2cc7c6f4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:59.330251 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea24b8fb-818e-4c92-8cf3-f0e2cc7c6f4c admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:59.356639 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 799/1594] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:10:59 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:10:59.357889 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fcb6bb-9d06-4de3-be59-3b309062f0ba admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:59.363262 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:59.372320 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fcb6bb-9d06-4de3-be59-3b309062f0ba admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:59.382038 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625c2240-1710-446c-9ed7-bcdc38824242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:59.382789 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c2240-1710-446c-9ed7-bcdc38824242 admin admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:59.383071 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c2240-1710-446c-9ed7-bcdc38824242 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:59.383398 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c2240-1710-446c-9ed7-bcdc38824242 admin admin] PATH_INFO: `/v3/projects/c3113f4154f546d0ad3f222cab9bfbf0/users/ba801bd230db478a94ca8d513d991986/roles/ea564961b1db4eb4a1d4d880964611b2` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:59.408034 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625c2240-1710-446c-9ed7-bcdc38824242 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3113f4154f546d0ad3f222cab9bfbf0, user_id=ba801bd230db478a94ca8d513d991986, role_id=ea564961b1db4eb4a1d4d880964611b2)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:59.411413 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625c2240-1710-446c-9ed7-bcdc38824242 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:59.429636 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 796/1595] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:10:59 2022] PUT /identity/v3/projects/c3113f4154f546d0ad3f222cab9bfbf0/users/ba801bd230db478a94ca8d513d991986/roles/ea564961b1db4eb4a1d4d880964611b2 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:10:59.433619 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea24b8fb-818e-4c92-8cf3-f0e2cc7c6f4c admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:59.445530 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea24b8fb-818e-4c92-8cf3-f0e2cc7c6f4c admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:59.507458 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6cbfe7-89e7-4c2e-84ea-4df83d0556ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:59.508216 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6cbfe7-89e7-4c2e-84ea-4df83d0556ee admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:59.508589 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6cbfe7-89e7-4c2e-84ea-4df83d0556ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:59.508804 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6cbfe7-89e7-4c2e-84ea-4df83d0556ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:59.509521 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6cbfe7-89e7-4c2e-84ea-4df83d0556ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:59.511183 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6cbfe7-89e7-4c2e-84ea-4df83d0556ee admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:59.521584 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 800/1596] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:10:59 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 13 11:10:59.527725 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625c2240-1710-446c-9ed7-bcdc38824242 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:59.542227 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625c2240-1710-446c-9ed7-bcdc38824242 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:59.547414 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac14ded-431c-47ba-a952-43389a8294ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:59.548088 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac14ded-431c-47ba-a952-43389a8294ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:59.548423 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac14ded-431c-47ba-a952-43389a8294ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:59.548712 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac14ded-431c-47ba-a952-43389a8294ea admin admin] PATH_INFO: `/v3/projects/c3113f4154f546d0ad3f222cab9bfbf0/users/ba801bd230db478a94ca8d513d991986/roles/ea564961b1db4eb4a1d4d880964611b2` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:59.551118 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac14ded-431c-47ba-a952-43389a8294ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3113f4154f546d0ad3f222cab9bfbf0, user_id=ba801bd230db478a94ca8d513d991986, role_id=ea564961b1db4eb4a1d4d880964611b2)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:59.554983 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac14ded-431c-47ba-a952-43389a8294ea admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:59.568028 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 797/1597] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:10:59 2022] PUT /identity/v3/projects/c3113f4154f546d0ad3f222cab9bfbf0/users/ba801bd230db478a94ca8d513d991986/roles/ea564961b1db4eb4a1d4d880964611b2 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:10:59.577975 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d1a22-fa2b-4738-bedc-4d8b54008e92 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:59.578282 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d1a22-fa2b-4738-bedc-4d8b54008e92 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:59.578563 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d1a22-fa2b-4738-bedc-4d8b54008e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:59.608563 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-946d1a22-fa2b-4738-bedc-4d8b54008e92 None None] MFA Rules not processed for user `ba801bd230db478a94ca8d513d991986`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:10:59.609874 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-946d1a22-fa2b-4738-bedc-4d8b54008e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:59.688050 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 801/1598] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:10:59 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:10:59.699362 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac14ded-431c-47ba-a952-43389a8294ea admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:59.701022 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-eac14ded-431c-47ba-a952-43389a8294ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:59.759777 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac14ded-431c-47ba-a952-43389a8294ea admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:59.763444 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20664d1d-3969-4806-8728-c8c70ad68be0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f4c2fc51f54f0e977648b13efaed1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:59.764322 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20664d1d-3969-4806-8728-c8c70ad68be0 service cinder] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:59.764606 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20664d1d-3969-4806-8728-c8c70ad68be0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:59.764882 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20664d1d-3969-4806-8728-c8c70ad68be0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:59.774840 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20664d1d-3969-4806-8728-c8c70ad68be0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:59.776207 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20664d1d-3969-4806-8728-c8c70ad68be0 service cinder] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:59.785783 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 798/1599] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:10:59 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:10:59.891924 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946d1a22-fa2b-4738-bedc-4d8b54008e92 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:59.902725 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946d1a22-fa2b-4738-bedc-4d8b54008e92 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:10:59.906778 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49415c2c-a619-41db-861c-8b439b14bb49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f4c2fc51f54f0e977648b13efaed1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:10:59.907729 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49415c2c-a619-41db-861c-8b439b14bb49 service cinder] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:10:59.907729 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49415c2c-a619-41db-861c-8b439b14bb49 service cinder] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:10:59.907966 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49415c2c-a619-41db-861c-8b439b14bb49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:10:59.934465 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20664d1d-3969-4806-8728-c8c70ad68be0 service cinder] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:10:59.935873 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-20664d1d-3969-4806-8728-c8c70ad68be0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:10:59.942536 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:10:59.974411 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49415c2c-a619-41db-861c-8b439b14bb49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:10:59.978823 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49415c2c-a619-41db-861c-8b439b14bb49 service cinder] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:10:59.986878 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 802/1600] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:10:59 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 13 11:11:00.028115 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20664d1d-3969-4806-8728-c8c70ad68be0 service cinder] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:00.034442 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543cba5-31ba-441d-a6e5-253fcdc7078b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:00.035439 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543cba5-31ba-441d-a6e5-253fcdc7078b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:00.035740 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543cba5-31ba-441d-a6e5-253fcdc7078b admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:00.036559 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543cba5-31ba-441d-a6e5-253fcdc7078b admin admin] PATH_INFO: `/v3/users/fd2a591ea79146c2afa70f8e7acdd02a` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:00.037856 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9543cba5-31ba-441d-a6e5-253fcdc7078b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd2a591ea79146c2afa70f8e7acdd02a)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:00.040012 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9543cba5-31ba-441d-a6e5-253fcdc7078b admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:00.094730 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-9543cba5-31ba-441d-a6e5-253fcdc7078b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd2a591ea79146c2afa70f8e7acdd02a'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:00.103027 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-9543cba5-31ba-441d-a6e5-253fcdc7078b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd2a591ea79146c2afa70f8e7acdd02a'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:00.103476 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-9543cba5-31ba-441d-a6e5-253fcdc7078b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd2a591ea79146c2afa70f8e7acdd02a'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:00.104082 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-9543cba5-31ba-441d-a6e5-253fcdc7078b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd2a591ea79146c2afa70f8e7acdd02a'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:00.119025 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-9543cba5-31ba-441d-a6e5-253fcdc7078b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd2a591ea79146c2afa70f8e7acdd02a'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:00.128736 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:00.147474 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 799/1601] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:10:59 2022] DELETE /identity/v3/users/fd2a591ea79146c2afa70f8e7acdd02a => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 11:11:00.152061 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3981342d-5db7-4787-8e70-120fdbad957d None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:00.152524 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3981342d-5db7-4787-8e70-120fdbad957d None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:00.152626 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3981342d-5db7-4787-8e70-120fdbad957d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:00.181244 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-3981342d-5db7-4787-8e70-120fdbad957d None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:00.181244 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-3981342d-5db7-4787-8e70-120fdbad957d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:00.212562 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543cba5-31ba-441d-a6e5-253fcdc7078b admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:00.214587 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-9543cba5-31ba-441d-a6e5-253fcdc7078b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:00.287626 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 803/1602] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:11:00.297162 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3981342d-5db7-4787-8e70-120fdbad957d None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:00.299573 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-3981342d-5db7-4787-8e70-120fdbad957d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:00.320003 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543cba5-31ba-441d-a6e5-253fcdc7078b admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:00.324986 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6776ae0-72eb-47d4-8749-b0e0ebd2cc6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:00.325631 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6776ae0-72eb-47d4-8749-b0e0ebd2cc6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:00.325913 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6776ae0-72eb-47d4-8749-b0e0ebd2cc6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:00.326214 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6776ae0-72eb-47d4-8749-b0e0ebd2cc6f admin admin] PATH_INFO: `/v3/users/91b26536b3014ee3b9feaefe8caea8b5` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:00.327369 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6776ae0-72eb-47d4-8749-b0e0ebd2cc6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=91b26536b3014ee3b9feaefe8caea8b5)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:00.329291 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6776ae0-72eb-47d4-8749-b0e0ebd2cc6f admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:00.373507 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3981342d-5db7-4787-8e70-120fdbad957d None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:00.377192 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b73f3d-7718-4e02-8629-fdc2d82c52a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:00.377802 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b73f3d-7718-4e02-8629-fdc2d82c52a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:00.378114 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b73f3d-7718-4e02-8629-fdc2d82c52a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:00.378398 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b73f3d-7718-4e02-8629-fdc2d82c52a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:00.388589 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b73f3d-7718-4e02-8629-fdc2d82c52a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:00.389724 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-d6776ae0-72eb-47d4-8749-b0e0ebd2cc6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91b26536b3014ee3b9feaefe8caea8b5'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:00.390254 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b73f3d-7718-4e02-8629-fdc2d82c52a6 service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:00.399655 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-d6776ae0-72eb-47d4-8749-b0e0ebd2cc6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91b26536b3014ee3b9feaefe8caea8b5'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:00.400354 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-d6776ae0-72eb-47d4-8749-b0e0ebd2cc6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91b26536b3014ee3b9feaefe8caea8b5'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:00.400977 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-d6776ae0-72eb-47d4-8749-b0e0ebd2cc6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91b26536b3014ee3b9feaefe8caea8b5'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:00.408659 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 804/1603] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:11:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 13 11:11:00.409620 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b73f3d-7718-4e02-8629-fdc2d82c52a6 service neutron] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:00.410191 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-d6776ae0-72eb-47d4-8749-b0e0ebd2cc6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91b26536b3014ee3b9feaefe8caea8b5'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:00.419923 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-c7b73f3d-7718-4e02-8629-fdc2d82c52a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:00.435056 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 800/1604] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:11:00 2022] DELETE /identity/v3/users/91b26536b3014ee3b9feaefe8caea8b5 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:00.447966 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b73f3d-7718-4e02-8629-fdc2d82c52a6 service neutron] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:00.450636 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a58e2-50e4-4cd3-b826-ec430fc23395 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:00.451226 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a58e2-50e4-4cd3-b826-ec430fc23395 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:00.452685 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a58e2-50e4-4cd3-b826-ec430fc23395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:00.507254 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-a76a58e2-50e4-4cd3-b826-ec430fc23395 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:00.508489 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-a76a58e2-50e4-4cd3-b826-ec430fc23395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:00.592956 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0f3481-4f05-4fa6-aa36-f76e44048c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:00.594326 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f3481-4f05-4fa6-aa36-f76e44048c1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:00.594819 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f3481-4f05-4fa6-aa36-f76e44048c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:00.595591 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f3481-4f05-4fa6-aa36-f76e44048c1f admin admin] PATH_INFO: `/v3/users/55973a81351441d7a5d4a9b75bccaab0` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:00.597530 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0f3481-4f05-4fa6-aa36-f76e44048c1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=55973a81351441d7a5d4a9b75bccaab0)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:00.600888 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0f3481-4f05-4fa6-aa36-f76e44048c1f admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:00.626757 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:00.667178 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 801/1605] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:11:00.680272 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-8a0f3481-4f05-4fa6-aa36-f76e44048c1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55973a81351441d7a5d4a9b75bccaab0'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:00.682284 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-8a0f3481-4f05-4fa6-aa36-f76e44048c1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55973a81351441d7a5d4a9b75bccaab0'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:00.683169 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-8a0f3481-4f05-4fa6-aa36-f76e44048c1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55973a81351441d7a5d4a9b75bccaab0'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:00.685351 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a58e2-50e4-4cd3-b826-ec430fc23395 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:00.688525 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-a76a58e2-50e4-4cd3-b826-ec430fc23395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:00.700790 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:00.706559 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-8a0f3481-4f05-4fa6-aa36-f76e44048c1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55973a81351441d7a5d4a9b75bccaab0'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:00.719928 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-8a0f3481-4f05-4fa6-aa36-f76e44048c1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55973a81351441d7a5d4a9b75bccaab0'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:00.737781 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 805/1606] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:11:00 2022] DELETE /identity/v3/users/55973a81351441d7a5d4a9b75bccaab0 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:00.743936 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb79ec-5aa0-4f1c-9f90-74ca92f24305 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:00.744290 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb79ec-5aa0-4f1c-9f90-74ca92f24305 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:00.745004 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb79ec-5aa0-4f1c-9f90-74ca92f24305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:00.769879 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-6bfb79ec-5aa0-4f1c-9f90-74ca92f24305 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:00.771945 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-6bfb79ec-5aa0-4f1c-9f90-74ca92f24305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:00.773978 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a58e2-50e4-4cd3-b826-ec430fc23395 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:00.837084 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21fabe8-7616-4d4a-9071-fb85dc6a1709 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:00.837802 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21fabe8-7616-4d4a-9071-fb85dc6a1709 service neutron] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:00.838331 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21fabe8-7616-4d4a-9071-fb85dc6a1709 service neutron] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:00.838683 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21fabe8-7616-4d4a-9071-fb85dc6a1709 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:00.840658 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-f21fabe8-7616-4d4a-9071-fb85dc6a1709 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:00.860648 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 806/1607] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:11:00.870540 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfb79ec-5aa0-4f1c-9f90-74ca92f24305 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:00.871789 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-6bfb79ec-5aa0-4f1c-9f90-74ca92f24305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:00.885287 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfb79ec-5aa0-4f1c-9f90-74ca92f24305 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:00.893664 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c902d5-d095-43d4-9629-c31a32dd2b47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:00.894525 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c902d5-d095-43d4-9629-c31a32dd2b47 service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:00.894895 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c902d5-d095-43d4-9629-c31a32dd2b47 service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:00.895219 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c902d5-d095-43d4-9629-c31a32dd2b47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:00.909303 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c902d5-d095-43d4-9629-c31a32dd2b47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:00.910750 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c902d5-d095-43d4-9629-c31a32dd2b47 service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:00.921231 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 807/1608] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:11:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 13 11:11:00.950105 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21fabe8-7616-4d4a-9071-fb85dc6a1709 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:00.951809 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21fabe8-7616-4d4a-9071-fb85dc6a1709 service neutron] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:00.964710 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 802/1609] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:11:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:11:01.352502 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c902d5-d095-43d4-9629-c31a32dd2b47 service neutron] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:01.353727 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-92c902d5-d095-43d4-9629-c31a32dd2b47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:01.385528 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c902d5-d095-43d4-9629-c31a32dd2b47 service neutron] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:01.390828 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9027923f-fe84-459f-a623-ad6d3e7aa38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:01.391470 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9027923f-fe84-459f-a623-ad6d3e7aa38b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:01.392233 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9027923f-fe84-459f-a623-ad6d3e7aa38b admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:01.392233 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9027923f-fe84-459f-a623-ad6d3e7aa38b admin admin] PATH_INFO: `/v3/projects/846fcec43c5b41499fe586cb5e462a43` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:01.393269 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9027923f-fe84-459f-a623-ad6d3e7aa38b admin admin] RBAC: Authorizing `identity:delete_project(project_id=846fcec43c5b41499fe586cb5e462a43)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:01.395467 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9027923f-fe84-459f-a623-ad6d3e7aa38b admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:01.415615 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21fabe8-7616-4d4a-9071-fb85dc6a1709 service neutron] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:01.417398 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-f21fabe8-7616-4d4a-9071-fb85dc6a1709 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:01.439856 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21fabe8-7616-4d4a-9071-fb85dc6a1709 service neutron] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:01.451859 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcf2467-e7bb-4307-af13-a68bd4283bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:01.452963 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcf2467-e7bb-4307-af13-a68bd4283bb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:01.454333 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcf2467-e7bb-4307-af13-a68bd4283bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:01.455760 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcf2467-e7bb-4307-af13-a68bd4283bb8 admin admin] PATH_INFO: `/v3/projects/678e32df7d234eb7b05fbf75ccf95204` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:01.458031 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcf2467-e7bb-4307-af13-a68bd4283bb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=678e32df7d234eb7b05fbf75ccf95204)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:01.462583 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcf2467-e7bb-4307-af13-a68bd4283bb8 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:01.513107 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-9027923f-fe84-459f-a623-ad6d3e7aa38b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '846fcec43c5b41499fe586cb5e462a43', 'request_id': 'req-9027923f-fe84-459f-a623-ad6d3e7aa38b'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:01.547037 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-9027923f-fe84-459f-a623-ad6d3e7aa38b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '846fcec43c5b41499fe586cb5e462a43', 'request_id': 'req-9027923f-fe84-459f-a623-ad6d3e7aa38b'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:01.567580 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-9027923f-fe84-459f-a623-ad6d3e7aa38b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '846fcec43c5b41499fe586cb5e462a43', 'request_id': 'req-9027923f-fe84-459f-a623-ad6d3e7aa38b'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:01.607422 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-9027923f-fe84-459f-a623-ad6d3e7aa38b admin admin] The token cache is being invalidate because project 846fcec43c5b41499fe586cb5e462a43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:11:01.607717 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-9027923f-fe84-459f-a623-ad6d3e7aa38b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:01.608992 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-9027923f-fe84-459f-a623-ad6d3e7aa38b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:01.610385 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-afcf2467-e7bb-4307-af13-a68bd4283bb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '678e32df7d234eb7b05fbf75ccf95204', 'request_id': 'req-afcf2467-e7bb-4307-af13-a68bd4283bb8'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:01.610839 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 808/1610] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:11:01 2022] DELETE /identity/v3/projects/846fcec43c5b41499fe586cb5e462a43 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:01.611621 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9027923f-fe84-459f-a623-ad6d3e7aa38b admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:01.612983 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-9027923f-fe84-459f-a623-ad6d3e7aa38b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:01.624665 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-afcf2467-e7bb-4307-af13-a68bd4283bb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '678e32df7d234eb7b05fbf75ccf95204', 'request_id': 'req-afcf2467-e7bb-4307-af13-a68bd4283bb8'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:01.628039 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:01.652973 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-afcf2467-e7bb-4307-af13-a68bd4283bb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '678e32df7d234eb7b05fbf75ccf95204', 'request_id': 'req-afcf2467-e7bb-4307-af13-a68bd4283bb8'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:01.660333 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:01.681566 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-afcf2467-e7bb-4307-af13-a68bd4283bb8 admin admin] The token cache is being invalidate because project 678e32df7d234eb7b05fbf75ccf95204 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:11:01.682300 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-afcf2467-e7bb-4307-af13-a68bd4283bb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:01.683286 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-afcf2467-e7bb-4307-af13-a68bd4283bb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:01.689502 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 803/1611] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:11:01 2022] DELETE /identity/v3/projects/678e32df7d234eb7b05fbf75ccf95204 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:01.691549 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27148af4-33d3-4311-ab3b-66b40016b3b5 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:01.692042 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27148af4-33d3-4311-ab3b-66b40016b3b5 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:01.692568 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27148af4-33d3-4311-ab3b-66b40016b3b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:01.729375 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-27148af4-33d3-4311-ab3b-66b40016b3b5 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:01.730540 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-27148af4-33d3-4311-ab3b-66b40016b3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:01.742175 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9027923f-fe84-459f-a623-ad6d3e7aa38b admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:01.882194 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d4871-0f6e-47b6-b97e-9795b1079538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:01.882194 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d4871-0f6e-47b6-b97e-9795b1079538 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:01.882194 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d4871-0f6e-47b6-b97e-9795b1079538 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:01.882194 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d4871-0f6e-47b6-b97e-9795b1079538 admin admin] PATH_INFO: `/v3/projects/332e1c30020d4290baa9e5d15cc67b04` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:01.883184 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14d4871-0f6e-47b6-b97e-9795b1079538 admin admin] RBAC: Authorizing `identity:delete_project(project_id=332e1c30020d4290baa9e5d15cc67b04)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:01.885295 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14d4871-0f6e-47b6-b97e-9795b1079538 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:01.933153 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 804/1612] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:11:01.940764 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27148af4-33d3-4311-ab3b-66b40016b3b5 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:01.942584 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-27148af4-33d3-4311-ab3b-66b40016b3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:01.956515 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27148af4-33d3-4311-ab3b-66b40016b3b5 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:01.964603 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-d14d4871-0f6e-47b6-b97e-9795b1079538 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '332e1c30020d4290baa9e5d15cc67b04', 'request_id': 'req-d14d4871-0f6e-47b6-b97e-9795b1079538'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:01.974612 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-d14d4871-0f6e-47b6-b97e-9795b1079538 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '332e1c30020d4290baa9e5d15cc67b04', 'request_id': 'req-d14d4871-0f6e-47b6-b97e-9795b1079538'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:01.982843 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-d14d4871-0f6e-47b6-b97e-9795b1079538 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '332e1c30020d4290baa9e5d15cc67b04', 'request_id': 'req-d14d4871-0f6e-47b6-b97e-9795b1079538'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:01.996247 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-d14d4871-0f6e-47b6-b97e-9795b1079538 admin admin] The token cache is being invalidate because project 332e1c30020d4290baa9e5d15cc67b04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:11:01.996541 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-d14d4871-0f6e-47b6-b97e-9795b1079538 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:01.997474 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-d14d4871-0f6e-47b6-b97e-9795b1079538 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:01.999352 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 809/1613] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:11:01 2022] DELETE /identity/v3/projects/332e1c30020d4290baa9e5d15cc67b04 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:02.000522 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b770e6-0953-486e-b25f-4226108b9693 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:02.000802 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b770e6-0953-486e-b25f-4226108b9693 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:02.001075 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b770e6-0953-486e-b25f-4226108b9693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:02.021527 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-b4b770e6-0953-486e-b25f-4226108b9693 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:02.022774 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-b4b770e6-0953-486e-b25f-4226108b9693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:02.023664 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc01c59-fe54-405c-95dc-aa353bdf930e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:02.024518 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc01c59-fe54-405c-95dc-aa353bdf930e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:02.024724 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc01c59-fe54-405c-95dc-aa353bdf930e admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:02.024996 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc01c59-fe54-405c-95dc-aa353bdf930e admin admin] PATH_INFO: `/v3/users/9244ca9dd2284250b8f2fdb90a64901d` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:02.026160 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc01c59-fe54-405c-95dc-aa353bdf930e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9244ca9dd2284250b8f2fdb90a64901d)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:02.028268 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc01c59-fe54-405c-95dc-aa353bdf930e admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:02.031430 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 810/1614] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:11:02.032128 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b770e6-0953-486e-b25f-4226108b9693 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:02.033383 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-b4b770e6-0953-486e-b25f-4226108b9693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:02.047658 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b770e6-0953-486e-b25f-4226108b9693 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:02.052684 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f31b23-ce81-4d83-b170-3d98898d9477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:02.053309 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f31b23-ce81-4d83-b170-3d98898d9477 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:02.053597 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f31b23-ce81-4d83-b170-3d98898d9477 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:02.054170 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f31b23-ce81-4d83-b170-3d98898d9477 admin admin] PATH_INFO: `/v3/users/33875b4fb4964355a58016b246a9cf07` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:02.055064 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f31b23-ce81-4d83-b170-3d98898d9477 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33875b4fb4964355a58016b246a9cf07)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:02.056980 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f31b23-ce81-4d83-b170-3d98898d9477 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:02.094492 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-2cc01c59-fe54-405c-95dc-aa353bdf930e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9244ca9dd2284250b8f2fdb90a64901d'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:02.102415 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-2cc01c59-fe54-405c-95dc-aa353bdf930e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9244ca9dd2284250b8f2fdb90a64901d'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:02.103124 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-2cc01c59-fe54-405c-95dc-aa353bdf930e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9244ca9dd2284250b8f2fdb90a64901d'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:02.103847 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-2cc01c59-fe54-405c-95dc-aa353bdf930e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9244ca9dd2284250b8f2fdb90a64901d'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:02.112617 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:02.113283 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-2cc01c59-fe54-405c-95dc-aa353bdf930e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9244ca9dd2284250b8f2fdb90a64901d'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:02.129191 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-69f31b23-ce81-4d83-b170-3d98898d9477 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33875b4fb4964355a58016b246a9cf07'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:02.130051 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-69f31b23-ce81-4d83-b170-3d98898d9477 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33875b4fb4964355a58016b246a9cf07'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:02.130664 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-69f31b23-ce81-4d83-b170-3d98898d9477 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33875b4fb4964355a58016b246a9cf07'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:02.135533 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 805/1615] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:11:01 2022] DELETE /identity/v3/users/9244ca9dd2284250b8f2fdb90a64901d => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:02.140324 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc01c59-fe54-405c-95dc-aa353bdf930e admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:02.141729 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-2cc01c59-fe54-405c-95dc-aa353bdf930e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:02.149203 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-69f31b23-ce81-4d83-b170-3d98898d9477 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33875b4fb4964355a58016b246a9cf07'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:02.163000 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-69f31b23-ce81-4d83-b170-3d98898d9477 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33875b4fb4964355a58016b246a9cf07'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:02.164842 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:02.180134 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 811/1616] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:11:02 2022] DELETE /identity/v3/users/33875b4fb4964355a58016b246a9cf07 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:02.245217 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc01c59-fe54-405c-95dc-aa353bdf930e admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:02.326840 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d5e8b4-0604-4b13-9ac4-e5ed12e31889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:02.327454 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d5e8b4-0604-4b13-9ac4-e5ed12e31889 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:02.328106 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d5e8b4-0604-4b13-9ac4-e5ed12e31889 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:02.328106 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d5e8b4-0604-4b13-9ac4-e5ed12e31889 admin admin] PATH_INFO: `/v3/domains` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:02.328649 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d5e8b4-0604-4b13-9ac4-e5ed12e31889 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:11:02.328952 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d5e8b4-0604-4b13-9ac4-e5ed12e31889 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:02.330591 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d5e8b4-0604-4b13-9ac4-e5ed12e31889 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:02.345278 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 806/1617] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 11:11:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:11:02.349738 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f31b23-ce81-4d83-b170-3d98898d9477 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:02.351785 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-69f31b23-ce81-4d83-b170-3d98898d9477 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:02.366221 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f31b23-ce81-4d83-b170-3d98898d9477 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:02.370964 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2a67f7-e24f-4951-ab31-f5c9d98092a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:02.371586 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a67f7-e24f-4951-ab31-f5c9d98092a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:02.371878 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a67f7-e24f-4951-ab31-f5c9d98092a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:02.372396 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a67f7-e24f-4951-ab31-f5c9d98092a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:02.373024 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2a67f7-e24f-4951-ab31-f5c9d98092a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:02.374969 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2a67f7-e24f-4951-ab31-f5c9d98092a1 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:02.407484 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 812/1618] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:11:02 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:11:02.411440 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d5e8b4-0604-4b13-9ac4-e5ed12e31889 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:02.424330 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d5e8b4-0604-4b13-9ac4-e5ed12e31889 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:02.498952 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2a67f7-e24f-4951-ab31-f5c9d98092a1 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:02.503757 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-aa2a67f7-e24f-4951-ab31-f5c9d98092a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:02.504030 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5883d74-7074-4179-a386-dd4dc95a3f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:02.505320 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5883d74-7074-4179-a386-dd4dc95a3f0f admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:02.505732 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5883d74-7074-4179-a386-dd4dc95a3f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:02.506136 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5883d74-7074-4179-a386-dd4dc95a3f0f admin admin] PATH_INFO: `/v3/users` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:02.507033 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5883d74-7074-4179-a386-dd4dc95a3f0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:02.510202 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5883d74-7074-4179-a386-dd4dc95a3f0f admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:02.523193 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2a67f7-e24f-4951-ab31-f5c9d98092a1 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:02.528767 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a5574-1e15-4b8e-95d8-961817ccb401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:02.529413 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a5574-1e15-4b8e-95d8-961817ccb401 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:02.529764 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a5574-1e15-4b8e-95d8-961817ccb401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:02.530109 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a5574-1e15-4b8e-95d8-961817ccb401 admin admin] PATH_INFO: `/v3/projects/aee6e71ea1d146689205bc13a6075623` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:02.531322 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802a5574-1e15-4b8e-95d8-961817ccb401 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aee6e71ea1d146689205bc13a6075623)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:02.533217 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802a5574-1e15-4b8e-95d8-961817ccb401 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:02.544784 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 807/1619] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:11:02 2022] POST /identity/v3/users => generated 293 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:11:02.545695 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5883d74-7074-4179-a386-dd4dc95a3f0f admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:02.549189 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-d5883d74-7074-4179-a386-dd4dc95a3f0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:02.562032 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5883d74-7074-4179-a386-dd4dc95a3f0f admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:02.566824 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a628f-8727-4d26-aac3-74f18a509f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:02.568027 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a628f-8727-4d26-aac3-74f18a509f2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:02.568306 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a628f-8727-4d26-aac3-74f18a509f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:02.568575 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a628f-8727-4d26-aac3-74f18a509f2a admin admin] PATH_INFO: `/v3/projects/da98a5483a4c4324893f4fe938de0af1` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:02.569743 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834a628f-8727-4d26-aac3-74f18a509f2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=da98a5483a4c4324893f4fe938de0af1)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:02.571700 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834a628f-8727-4d26-aac3-74f18a509f2a admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:02.620693 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:02.628778 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-834a628f-8727-4d26-aac3-74f18a509f2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da98a5483a4c4324893f4fe938de0af1', 'request_id': 'req-834a628f-8727-4d26-aac3-74f18a509f2a'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:02.637811 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-834a628f-8727-4d26-aac3-74f18a509f2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da98a5483a4c4324893f4fe938de0af1', 'request_id': 'req-834a628f-8727-4d26-aac3-74f18a509f2a'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:02.644055 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-834a628f-8727-4d26-aac3-74f18a509f2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da98a5483a4c4324893f4fe938de0af1', 'request_id': 'req-834a628f-8727-4d26-aac3-74f18a509f2a'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:02.658770 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-834a628f-8727-4d26-aac3-74f18a509f2a admin admin] The token cache is being invalidate because project da98a5483a4c4324893f4fe938de0af1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:11:02.659056 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-834a628f-8727-4d26-aac3-74f18a509f2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:02.659727 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-834a628f-8727-4d26-aac3-74f18a509f2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:02.661259 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 808/1620] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:11:02 2022] DELETE /identity/v3/projects/da98a5483a4c4324893f4fe938de0af1 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:02.662748 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a628f-8727-4d26-aac3-74f18a509f2a admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:02.664321 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-834a628f-8727-4d26-aac3-74f18a509f2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:02.705848 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-802a5574-1e15-4b8e-95d8-961817ccb401 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aee6e71ea1d146689205bc13a6075623', 'request_id': 'req-802a5574-1e15-4b8e-95d8-961817ccb401'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:02.713815 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-802a5574-1e15-4b8e-95d8-961817ccb401 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aee6e71ea1d146689205bc13a6075623', 'request_id': 'req-802a5574-1e15-4b8e-95d8-961817ccb401'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:02.721322 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-802a5574-1e15-4b8e-95d8-961817ccb401 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aee6e71ea1d146689205bc13a6075623', 'request_id': 'req-802a5574-1e15-4b8e-95d8-961817ccb401'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:02.733067 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a628f-8727-4d26-aac3-74f18a509f2a admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:02.735584 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-802a5574-1e15-4b8e-95d8-961817ccb401 admin admin] The token cache is being invalidate because project aee6e71ea1d146689205bc13a6075623 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:11:02.736041 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-802a5574-1e15-4b8e-95d8-961817ccb401 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:02.737062 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-802a5574-1e15-4b8e-95d8-961817ccb401 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:02.740108 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 813/1621] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:11:02 2022] DELETE /identity/v3/projects/aee6e71ea1d146689205bc13a6075623 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:02.743412 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853b7a1-3f8b-43a7-9dd5-f9e49a43d067 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:02.743412 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853b7a1-3f8b-43a7-9dd5-f9e49a43d067 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:02.743412 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853b7a1-3f8b-43a7-9dd5-f9e49a43d067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:02.771546 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-2853b7a1-3f8b-43a7-9dd5-f9e49a43d067 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:02.773352 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-2853b7a1-3f8b-43a7-9dd5-f9e49a43d067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:02.815430 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ae8b4-8fa1-4646-a76c-7e10926d1041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:02.816138 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ae8b4-8fa1-4646-a76c-7e10926d1041 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:02.816740 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ae8b4-8fa1-4646-a76c-7e10926d1041 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:02.817974 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ae8b4-8fa1-4646-a76c-7e10926d1041 admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:02.818790 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582ae8b4-8fa1-4646-a76c-7e10926d1041 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:02.820430 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582ae8b4-8fa1-4646-a76c-7e10926d1041 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:02.831228 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 809/1622] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:11:02 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:11:02.832422 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94fdb3d-85fc-4209-a87c-a2055e14bc2c None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:02.832706 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94fdb3d-85fc-4209-a87c-a2055e14bc2c None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:02.833102 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94fdb3d-85fc-4209-a87c-a2055e14bc2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:02.852162 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-d94fdb3d-85fc-4209-a87c-a2055e14bc2c None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:02.853364 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-d94fdb3d-85fc-4209-a87c-a2055e14bc2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:02.861299 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 810/1623] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:11:02.869814 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94fdb3d-85fc-4209-a87c-a2055e14bc2c None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:02.871399 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-d94fdb3d-85fc-4209-a87c-a2055e14bc2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:02.881444 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 814/1624] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:11:02.883263 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc42bdba-5d2a-4abf-89d8-31217c314d4e None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:02.884035 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc42bdba-5d2a-4abf-89d8-31217c314d4e None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:02.884496 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc42bdba-5d2a-4abf-89d8-31217c314d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:02.891001 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94fdb3d-85fc-4209-a87c-a2055e14bc2c None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:02.895913 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386beb5d-b3d1-4bf9-bf60-4fea86f81288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:02.896530 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386beb5d-b3d1-4bf9-bf60-4fea86f81288 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:02.896920 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386beb5d-b3d1-4bf9-bf60-4fea86f81288 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:02.897200 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386beb5d-b3d1-4bf9-bf60-4fea86f81288 admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:02.897852 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386beb5d-b3d1-4bf9-bf60-4fea86f81288 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:02.899487 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386beb5d-b3d1-4bf9-bf60-4fea86f81288 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:02.912689 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 811/1625] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:11:02 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:11:02.914574 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82722335-e857-4d09-83bc-de98c79b4961 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:02.915274 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82722335-e857-4d09-83bc-de98c79b4961 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:02.915740 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82722335-e857-4d09-83bc-de98c79b4961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:02.939573 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-82722335-e857-4d09-83bc-de98c79b4961 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:02.941917 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-82722335-e857-4d09-83bc-de98c79b4961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:02.944448 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-cc42bdba-5d2a-4abf-89d8-31217c314d4e None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:02.946806 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-cc42bdba-5d2a-4abf-89d8-31217c314d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:02.957257 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 812/1626] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:11:02.958348 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82722335-e857-4d09-83bc-de98c79b4961 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:02.965670 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 815/1627] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:11:02.965670 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc42bdba-5d2a-4abf-89d8-31217c314d4e None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:02.971997 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:02.972869 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82722335-e857-4d09-83bc-de98c79b4961 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:02.978720 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf50a0f-b71c-4555-bb8f-a7009fa33042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:02.979806 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf50a0f-b71c-4555-bb8f-a7009fa33042 admin admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:02.980230 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf50a0f-b71c-4555-bb8f-a7009fa33042 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:02.980643 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf50a0f-b71c-4555-bb8f-a7009fa33042 admin admin] PATH_INFO: `/v3/projects/68c57a439db940d28aa3d17c8977f42f/users/4b52958b164d4d108460518c5367e199/roles/7c3871c0ab68438b9014489d50b53a22` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:02.980964 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc42bdba-5d2a-4abf-89d8-31217c314d4e None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:02.993886 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0568faa6-9f10-46a5-9ea4-e2b864444688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:02.994710 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0568faa6-9f10-46a5-9ea4-e2b864444688 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:02.994993 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0568faa6-9f10-46a5-9ea4-e2b864444688 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:02.995271 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0568faa6-9f10-46a5-9ea4-e2b864444688 admin admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:02.997013 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0568faa6-9f10-46a5-9ea4-e2b864444688 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:11:02.997688 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0568faa6-9f10-46a5-9ea4-e2b864444688 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:02.999505 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0568faa6-9f10-46a5-9ea4-e2b864444688 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:03.014074 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf50a0f-b71c-4555-bb8f-a7009fa33042 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68c57a439db940d28aa3d17c8977f42f, user_id=4b52958b164d4d108460518c5367e199, role_id=7c3871c0ab68438b9014489d50b53a22)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:03.015668 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 816/1628] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 11:11:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:11:03.016770 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0568faa6-9f10-46a5-9ea4-e2b864444688 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:03.017576 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf50a0f-b71c-4555-bb8f-a7009fa33042 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:03.040999 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0568faa6-9f10-46a5-9ea4-e2b864444688 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:03.049404 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 813/1629] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:11:02 2022] PUT /identity/v3/projects/68c57a439db940d28aa3d17c8977f42f/users/4b52958b164d4d108460518c5367e199/roles/7c3871c0ab68438b9014489d50b53a22 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:03.050346 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf50a0f-b71c-4555-bb8f-a7009fa33042 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:03.092740 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:03.129236 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d76dd37-ae0d-4996-bf22-f027b30cbb3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:03.129788 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d76dd37-ae0d-4996-bf22-f027b30cbb3c admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:03.130115 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d76dd37-ae0d-4996-bf22-f027b30cbb3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:03.130374 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d76dd37-ae0d-4996-bf22-f027b30cbb3c admin admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:03.131161 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d76dd37-ae0d-4996-bf22-f027b30cbb3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:11:03.131446 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d76dd37-ae0d-4996-bf22-f027b30cbb3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:03.133286 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d76dd37-ae0d-4996-bf22-f027b30cbb3c admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:03.150319 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf50a0f-b71c-4555-bb8f-a7009fa33042 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:03.159233 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597ff7d0-f44a-4e97-9b0b-dceb5cdd387f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:03.162513 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ff7d0-f44a-4e97-9b0b-dceb5cdd387f admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:03.162877 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ff7d0-f44a-4e97-9b0b-dceb5cdd387f admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:03.163320 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ff7d0-f44a-4e97-9b0b-dceb5cdd387f admin admin] PATH_INFO: `/v3/projects` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:03.164238 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597ff7d0-f44a-4e97-9b0b-dceb5cdd387f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:03.164402 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 817/1630] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 11:11:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:11:03.165418 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5738308-bbf5-45eb-adf9-08cb0ec62404 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:03.165723 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5738308-bbf5-45eb-adf9-08cb0ec62404 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:03.166063 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5738308-bbf5-45eb-adf9-08cb0ec62404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:03.170787 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597ff7d0-f44a-4e97-9b0b-dceb5cdd387f admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:03.202170 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-a5738308-bbf5-45eb-adf9-08cb0ec62404 None None] MFA Rules not processed for user `4b52958b164d4d108460518c5367e199`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:03.203765 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-a5738308-bbf5-45eb-adf9-08cb0ec62404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:03.227843 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 814/1631] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:11:03 2022] POST /identity/v3/projects => generated 379 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:11:03.228695 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597ff7d0-f44a-4e97-9b0b-dceb5cdd387f admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:03.294020 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 818/1632] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:03 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:11:03.294866 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5738308-bbf5-45eb-adf9-08cb0ec62404 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:03.308799 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5738308-bbf5-45eb-adf9-08cb0ec62404 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:03.315099 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d9e57-9dca-4469-82eb-b731196905e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:03.316144 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d9e57-9dca-4469-82eb-b731196905e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:03.316828 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597ff7d0-f44a-4e97-9b0b-dceb5cdd387f admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:03.317213 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d9e57-9dca-4469-82eb-b731196905e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:03.317589 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d9e57-9dca-4469-82eb-b731196905e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:03.318956 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4d9e57-9dca-4469-82eb-b731196905e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:03.321773 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db330cdf-f694-4509-9921-97fd8e1eb8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:03.322219 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4d9e57-9dca-4469-82eb-b731196905e8 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:03.322866 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db330cdf-f694-4509-9921-97fd8e1eb8a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:03.322866 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db330cdf-f694-4509-9921-97fd8e1eb8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:03.323063 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db330cdf-f694-4509-9921-97fd8e1eb8a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:03.323573 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db330cdf-f694-4509-9921-97fd8e1eb8a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:03.325531 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db330cdf-f694-4509-9921-97fd8e1eb8a7 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:03.359092 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 819/1633] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:11:03 2022] POST /identity/v3/users => generated 290 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:11:03.359929 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d9e57-9dca-4469-82eb-b731196905e8 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:03.364444 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 815/1634] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:11:03 2022] POST /identity/v3/projects => generated 383 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:11:03.366176 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db330cdf-f694-4509-9921-97fd8e1eb8a7 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:03.371699 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d9e57-9dca-4469-82eb-b731196905e8 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:03.507515 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:03.515842 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db330cdf-f694-4509-9921-97fd8e1eb8a7 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:03.521528 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959cf0ee-c636-4330-b026-9ca3533dbe28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:03.522367 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959cf0ee-c636-4330-b026-9ca3533dbe28 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:03.522781 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959cf0ee-c636-4330-b026-9ca3533dbe28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:03.523064 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959cf0ee-c636-4330-b026-9ca3533dbe28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:03.523725 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959cf0ee-c636-4330-b026-9ca3533dbe28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:03.527225 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959cf0ee-c636-4330-b026-9ca3533dbe28 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:03.530583 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b266b8-67a3-4aa0-ab7d-15d60f973b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:03.531214 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b266b8-67a3-4aa0-ab7d-15d60f973b72 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:03.531489 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b266b8-67a3-4aa0-ab7d-15d60f973b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:03.531764 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b266b8-67a3-4aa0-ab7d-15d60f973b72 admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:03.533862 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b266b8-67a3-4aa0-ab7d-15d60f973b72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:03.537773 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b266b8-67a3-4aa0-ab7d-15d60f973b72 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:03.543265 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 816/1635] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:11:03 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:11:03.544403 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959cf0ee-c636-4330-b026-9ca3533dbe28 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:03.559449 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959cf0ee-c636-4330-b026-9ca3533dbe28 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:03.566890 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07123ac0-a52a-44a4-960f-efed7585b401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:03.568816 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07123ac0-a52a-44a4-960f-efed7585b401 admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:03.569408 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07123ac0-a52a-44a4-960f-efed7585b401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:03.569964 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07123ac0-a52a-44a4-960f-efed7585b401 admin admin] PATH_INFO: `/v3/users` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:03.571369 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07123ac0-a52a-44a4-960f-efed7585b401 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:03.573753 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07123ac0-a52a-44a4-960f-efed7585b401 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:03.590011 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 820/1636] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:11:03 2022] POST /identity/v3/projects => generated 385 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:11:03.591431 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b266b8-67a3-4aa0-ab7d-15d60f973b72 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:03.622552 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 817/1637] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:11:03 2022] POST /identity/v3/users => generated 292 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:11:03.623944 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07123ac0-a52a-44a4-960f-efed7585b401 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:03.644238 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07123ac0-a52a-44a4-960f-efed7585b401 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:03.679808 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:03.704827 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b266b8-67a3-4aa0-ab7d-15d60f973b72 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:03.711061 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4ac3fe-812a-42ab-a9af-e9dd48c98e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:03.712115 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ac3fe-812a-42ab-a9af-e9dd48c98e74 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:03.712115 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ac3fe-812a-42ab-a9af-e9dd48c98e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:03.712374 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ac3fe-812a-42ab-a9af-e9dd48c98e74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:03.713043 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4ac3fe-812a-42ab-a9af-e9dd48c98e74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:03.715725 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4ac3fe-812a-42ab-a9af-e9dd48c98e74 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:03.729406 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 821/1638] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:11:03 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:11:03.730526 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4ac3fe-812a-42ab-a9af-e9dd48c98e74 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:03.744357 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4ac3fe-812a-42ab-a9af-e9dd48c98e74 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:03.750220 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abee26e-15fd-493b-a8a1-6191be8eec80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:03.750849 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abee26e-15fd-493b-a8a1-6191be8eec80 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:03.757988 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abee26e-15fd-493b-a8a1-6191be8eec80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:03.759736 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abee26e-15fd-493b-a8a1-6191be8eec80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:03.760507 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abee26e-15fd-493b-a8a1-6191be8eec80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:03.765279 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abee26e-15fd-493b-a8a1-6191be8eec80 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:03.787992 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 822/1639] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:11:03 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:11:03.787992 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abee26e-15fd-493b-a8a1-6191be8eec80 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:03.799711 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abee26e-15fd-493b-a8a1-6191be8eec80 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:03.809403 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147afa8d-5cf6-4391-81f2-f07b78d5cb31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:03.810261 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3bb8cf-49c5-4b1c-95f4-fb72f1fb819c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:03.810741 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147afa8d-5cf6-4391-81f2-f07b78d5cb31 admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:03.811094 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3bb8cf-49c5-4b1c-95f4-fb72f1fb819c admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:03.811392 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147afa8d-5cf6-4391-81f2-f07b78d5cb31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:03.811512 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3bb8cf-49c5-4b1c-95f4-fb72f1fb819c admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:03.811792 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3bb8cf-49c5-4b1c-95f4-fb72f1fb819c admin admin] PATH_INFO: `/v3/projects/a15c4bba19e84537aea4e50d73af97cc/users/59e8f9a157df42beaf2ff0977e187910/roles/7c3871c0ab68438b9014489d50b53a22` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:03.812720 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147afa8d-5cf6-4391-81f2-f07b78d5cb31 admin admin] PATH_INFO: `/v3/users` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:03.813686 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147afa8d-5cf6-4391-81f2-f07b78d5cb31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:03.815769 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147afa8d-5cf6-4391-81f2-f07b78d5cb31 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:03.832737 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3bb8cf-49c5-4b1c-95f4-fb72f1fb819c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a15c4bba19e84537aea4e50d73af97cc, user_id=59e8f9a157df42beaf2ff0977e187910, role_id=7c3871c0ab68438b9014489d50b53a22)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:03.836186 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3bb8cf-49c5-4b1c-95f4-fb72f1fb819c admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:03.851512 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 818/1640] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:11:03 2022] POST /identity/v3/users => generated 293 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:11:03.852398 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147afa8d-5cf6-4391-81f2-f07b78d5cb31 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:03.858054 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 823/1641] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:11:03 2022] PUT /identity/v3/projects/a15c4bba19e84537aea4e50d73af97cc/users/59e8f9a157df42beaf2ff0977e187910/roles/7c3871c0ab68438b9014489d50b53a22 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:03.865037 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147afa8d-5cf6-4391-81f2-f07b78d5cb31 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:03.867522 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3bb8cf-49c5-4b1c-95f4-fb72f1fb819c admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:03.952394 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3bb8cf-49c5-4b1c-95f4-fb72f1fb819c admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:03.957521 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228f7c23-e2ba-44d2-8344-7ef4f0c86591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:03.958203 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f7c23-e2ba-44d2-8344-7ef4f0c86591 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:03.958481 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f7c23-e2ba-44d2-8344-7ef4f0c86591 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:03.958749 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f7c23-e2ba-44d2-8344-7ef4f0c86591 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:03.959394 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228f7c23-e2ba-44d2-8344-7ef4f0c86591 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:03.961070 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228f7c23-e2ba-44d2-8344-7ef4f0c86591 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:03.962835 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f9db40-ddd0-40ba-85fd-c8083e634874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:03.963881 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f9db40-ddd0-40ba-85fd-c8083e634874 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:03.964229 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f9db40-ddd0-40ba-85fd-c8083e634874 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:03.964509 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f9db40-ddd0-40ba-85fd-c8083e634874 admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:03.965163 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f9db40-ddd0-40ba-85fd-c8083e634874 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:03.967218 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f9db40-ddd0-40ba-85fd-c8083e634874 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:03.975007 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 824/1642] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:11:03 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:11:03.975007 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6415dd-1690-41fa-ac96-42bc5aa95b7f None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:03.975007 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6415dd-1690-41fa-ac96-42bc5aa95b7f None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:03.975007 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6415dd-1690-41fa-ac96-42bc5aa95b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:03.985798 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 819/1643] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:11:03 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:11:03.986859 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f9db40-ddd0-40ba-85fd-c8083e634874 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:03.998224 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f9db40-ddd0-40ba-85fd-c8083e634874 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:04.003837 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c761c-7189-4762-b945-7cf4bdb1f852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:04.004446 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c761c-7189-4762-b945-7cf4bdb1f852 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:04.004772 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c761c-7189-4762-b945-7cf4bdb1f852 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:04.005033 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c761c-7189-4762-b945-7cf4bdb1f852 admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:04.005688 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32c761c-7189-4762-b945-7cf4bdb1f852 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:04.007309 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32c761c-7189-4762-b945-7cf4bdb1f852 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:04.010634 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-2e6415dd-1690-41fa-ac96-42bc5aa95b7f None None] MFA Rules not processed for user `59e8f9a157df42beaf2ff0977e187910`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:04.012337 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-2e6415dd-1690-41fa-ac96-42bc5aa95b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:04.018691 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 820/1644] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:11:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:11:04.019824 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c761c-7189-4762-b945-7cf4bdb1f852 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:04.046916 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c761c-7189-4762-b945-7cf4bdb1f852 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:04.055807 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:04.057144 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cb523b-841a-457b-81d2-46720f888a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:04.058199 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb523b-841a-457b-81d2-46720f888a44 admin admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:04.058758 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb523b-841a-457b-81d2-46720f888a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:04.060670 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb523b-841a-457b-81d2-46720f888a44 admin admin] PATH_INFO: `/v3/projects/0f45c5e76bb149249a505aa5c5a7b2eb/users/9a035510aba748af8984ac8c4f391bcf/roles/7c3871c0ab68438b9014489d50b53a22` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:04.081106 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cb523b-841a-457b-81d2-46720f888a44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f45c5e76bb149249a505aa5c5a7b2eb, user_id=9a035510aba748af8984ac8c4f391bcf, role_id=7c3871c0ab68438b9014489d50b53a22)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:04.088169 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cb523b-841a-457b-81d2-46720f888a44 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:04.117917 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 821/1645] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:11:04 2022] PUT /identity/v3/projects/0f45c5e76bb149249a505aa5c5a7b2eb/users/9a035510aba748af8984ac8c4f391bcf/roles/7c3871c0ab68438b9014489d50b53a22 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:04.118916 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cb523b-841a-457b-81d2-46720f888a44 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:04.128938 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 825/1646] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:03 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:11:04.134700 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9aa1df-dffa-48e8-90a7-f4a2fc5209c6 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:04.135084 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9aa1df-dffa-48e8-90a7-f4a2fc5209c6 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:04.135456 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9aa1df-dffa-48e8-90a7-f4a2fc5209c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:04.171771 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-af9aa1df-dffa-48e8-90a7-f4a2fc5209c6 None None] MFA Rules not processed for user `9a035510aba748af8984ac8c4f391bcf`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:04.173335 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-af9aa1df-dffa-48e8-90a7-f4a2fc5209c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:04.211481 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cb523b-841a-457b-81d2-46720f888a44 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:04.216469 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb6d528-e147-4a4d-b227-b6054804e5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:04.217142 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6d528-e147-4a4d-b227-b6054804e5f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:04.217421 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6d528-e147-4a4d-b227-b6054804e5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:04.217699 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6d528-e147-4a4d-b227-b6054804e5f6 admin admin] PATH_INFO: `/v3/projects/493839e1607244b586d8a61dd90e966e/users/e22a49486c13418e97ad1358850f8568/roles/7c3871c0ab68438b9014489d50b53a22` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:04.228970 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:04.237385 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb6d528-e147-4a4d-b227-b6054804e5f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=493839e1607244b586d8a61dd90e966e, user_id=e22a49486c13418e97ad1358850f8568, role_id=7c3871c0ab68438b9014489d50b53a22)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:04.242077 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb6d528-e147-4a4d-b227-b6054804e5f6 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:04.253986 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 826/1647] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:11:04.254935 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9aa1df-dffa-48e8-90a7-f4a2fc5209c6 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:04.264584 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 822/1648] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:11:04 2022] PUT /identity/v3/projects/493839e1607244b586d8a61dd90e966e/users/e22a49486c13418e97ad1358850f8568/roles/7c3871c0ab68438b9014489d50b53a22 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:04.266205 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb6d528-e147-4a4d-b227-b6054804e5f6 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:04.281059 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9aa1df-dffa-48e8-90a7-f4a2fc5209c6 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:04.377424 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb6d528-e147-4a4d-b227-b6054804e5f6 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:04.385438 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058c9d85-7c7b-4dbf-bc87-7201d387f490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:04.402323 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c9d85-7c7b-4dbf-bc87-7201d387f490 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:04.402323 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c9d85-7c7b-4dbf-bc87-7201d387f490 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:04.402323 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c9d85-7c7b-4dbf-bc87-7201d387f490 admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:04.402323 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058c9d85-7c7b-4dbf-bc87-7201d387f490 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:04.402323 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058c9d85-7c7b-4dbf-bc87-7201d387f490 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:04.410536 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e665ea0-b72a-443e-887c-caf7599d5571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:04.414505 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e665ea0-b72a-443e-887c-caf7599d5571 admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:04.416604 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e665ea0-b72a-443e-887c-caf7599d5571 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:04.416986 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e665ea0-b72a-443e-887c-caf7599d5571 admin admin] PATH_INFO: `/v3/projects` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:04.418185 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e665ea0-b72a-443e-887c-caf7599d5571 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:04.420996 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e665ea0-b72a-443e-887c-caf7599d5571 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:04.440709 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 827/1649] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:11:04 2022] POST /identity/v3/projects => generated 375 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:11:04.442795 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b781f-f857-4658-8231-e0bdc83ebe97 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:04.443508 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b781f-f857-4658-8231-e0bdc83ebe97 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:04.443941 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b781f-f857-4658-8231-e0bdc83ebe97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:04.465295 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 823/1650] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:11:04 2022] POST /identity/v3/projects => generated 383 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:11:04.466407 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e665ea0-b72a-443e-887c-caf7599d5571 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:04.482820 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-e13b781f-f857-4658-8231-e0bdc83ebe97 None None] MFA Rules not processed for user `e22a49486c13418e97ad1358850f8568`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:04.484172 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-e13b781f-f857-4658-8231-e0bdc83ebe97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:04.521536 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:04.553855 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e665ea0-b72a-443e-887c-caf7599d5571 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:04.561273 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c3bc85-9b4c-4d39-a0fa-b6f9a4e277e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:04.562568 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3bc85-9b4c-4d39-a0fa-b6f9a4e277e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:04.563275 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3bc85-9b4c-4d39-a0fa-b6f9a4e277e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:04.563728 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3bc85-9b4c-4d39-a0fa-b6f9a4e277e4 admin admin] PATH_INFO: `/v3/users` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:04.564821 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c3bc85-9b4c-4d39-a0fa-b6f9a4e277e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:04.565803 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 828/1651] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:11:04.567888 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c3bc85-9b4c-4d39-a0fa-b6f9a4e277e4 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:04.570895 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b781f-f857-4658-8231-e0bdc83ebe97 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:04.581768 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b781f-f857-4658-8231-e0bdc83ebe97 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:04.587896 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58d8341-3edc-4a86-8c5a-a6d93752ebcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:04.588636 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d8341-3edc-4a86-8c5a-a6d93752ebcc admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:04.588851 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d8341-3edc-4a86-8c5a-a6d93752ebcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:04.589224 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d8341-3edc-4a86-8c5a-a6d93752ebcc admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:04.589972 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58d8341-3edc-4a86-8c5a-a6d93752ebcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:04.591726 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58d8341-3edc-4a86-8c5a-a6d93752ebcc admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:04.596644 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 824/1652] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:11:04 2022] POST /identity/v3/users => generated 294 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:11:04.597909 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c3bc85-9b4c-4d39-a0fa-b6f9a4e277e4 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:04.608947 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c3bc85-9b4c-4d39-a0fa-b6f9a4e277e4 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:04.615037 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b952f46-1b81-4937-a74c-a4191a3b1939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:04.615816 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b952f46-1b81-4937-a74c-a4191a3b1939 admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:04.616224 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b952f46-1b81-4937-a74c-a4191a3b1939 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:04.616763 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b952f46-1b81-4937-a74c-a4191a3b1939 admin admin] PATH_INFO: `/v3/projects` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:04.617482 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b952f46-1b81-4937-a74c-a4191a3b1939 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:04.619536 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b952f46-1b81-4937-a74c-a4191a3b1939 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:04.623907 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 829/1653] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:11:04 2022] POST /identity/v3/users => generated 298 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:11:04.623907 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58d8341-3edc-4a86-8c5a-a6d93752ebcc admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:04.636302 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58d8341-3edc-4a86-8c5a-a6d93752ebcc admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:04.642548 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6500eb4c-f4c1-4613-bfca-d0016c89d568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:04.643144 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500eb4c-f4c1-4613-bfca-d0016c89d568 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:04.643506 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500eb4c-f4c1-4613-bfca-d0016c89d568 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:04.644048 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500eb4c-f4c1-4613-bfca-d0016c89d568 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:04.644348 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6500eb4c-f4c1-4613-bfca-d0016c89d568 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:04.646541 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6500eb4c-f4c1-4613-bfca-d0016c89d568 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:04.656455 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 825/1654] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:11:04 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:11:04.656455 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b952f46-1b81-4937-a74c-a4191a3b1939 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:04.661320 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 830/1655] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:11:04.661320 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6500eb4c-f4c1-4613-bfca-d0016c89d568 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:04.673391 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6500eb4c-f4c1-4613-bfca-d0016c89d568 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:04.718818 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:04.742030 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b952f46-1b81-4937-a74c-a4191a3b1939 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:04.744110 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7569c9f0-d080-43b6-afea-9d020e8befb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:04.744803 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569c9f0-d080-43b6-afea-9d020e8befb5 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:04.745167 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569c9f0-d080-43b6-afea-9d020e8befb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:04.745442 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569c9f0-d080-43b6-afea-9d020e8befb5 admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:04.746105 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7569c9f0-d080-43b6-afea-9d020e8befb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:04.746847 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b77f22-d9f6-4af4-bf00-b698840fe793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:04.748273 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7569c9f0-d080-43b6-afea-9d020e8befb5 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:04.748378 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b77f22-d9f6-4af4-bf00-b698840fe793 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:04.748608 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b77f22-d9f6-4af4-bf00-b698840fe793 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:04.748944 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b77f22-d9f6-4af4-bf00-b698840fe793 admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:04.749592 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b77f22-d9f6-4af4-bf00-b698840fe793 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:04.751199 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b77f22-d9f6-4af4-bf00-b698840fe793 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:04.761864 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 826/1656] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:11:04.762663 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b77f22-d9f6-4af4-bf00-b698840fe793 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:04.771258 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 831/1657] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:11:04 2022] POST /identity/v3/users => generated 298 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:11:04.772062 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7569c9f0-d080-43b6-afea-9d020e8befb5 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:04.775536 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b77f22-d9f6-4af4-bf00-b698840fe793 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:04.780712 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2e4160-db07-4c78-b379-ffb31fd81360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:04.781423 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e4160-db07-4c78-b379-ffb31fd81360 admin admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:04.781708 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e4160-db07-4c78-b379-ffb31fd81360 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:04.781802 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7569c9f0-d080-43b6-afea-9d020e8befb5 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:04.782006 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e4160-db07-4c78-b379-ffb31fd81360 admin admin] PATH_INFO: `/v3/projects/fb05757729cf4225b40febea70ae6200/users/54fbb4fe7c5e446ca84c3ed5078ba873/roles/ea564961b1db4eb4a1d4d880964611b2` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:04.787477 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f77bcaf-b029-4540-9d57-002db761dd05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:04.788193 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f77bcaf-b029-4540-9d57-002db761dd05 admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:04.788479 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f77bcaf-b029-4540-9d57-002db761dd05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:04.788753 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f77bcaf-b029-4540-9d57-002db761dd05 admin admin] PATH_INFO: `/v3/projects/72bd92fd690f4512850d5f2b811e11b7/users/ed11f37bef174e0eaeace613f1329e81/roles/ea564961b1db4eb4a1d4d880964611b2` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:04.797567 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2e4160-db07-4c78-b379-ffb31fd81360 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb05757729cf4225b40febea70ae6200, user_id=54fbb4fe7c5e446ca84c3ed5078ba873, role_id=ea564961b1db4eb4a1d4d880964611b2)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:04.800258 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2e4160-db07-4c78-b379-ffb31fd81360 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:04.805170 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f77bcaf-b029-4540-9d57-002db761dd05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72bd92fd690f4512850d5f2b811e11b7, user_id=ed11f37bef174e0eaeace613f1329e81, role_id=ea564961b1db4eb4a1d4d880964611b2)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:04.807892 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f77bcaf-b029-4540-9d57-002db761dd05 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:04.813370 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 827/1658] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:11:04 2022] PUT /identity/v3/projects/fb05757729cf4225b40febea70ae6200/users/54fbb4fe7c5e446ca84c3ed5078ba873/roles/ea564961b1db4eb4a1d4d880964611b2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:04.814421 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2e4160-db07-4c78-b379-ffb31fd81360 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:04.823533 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 832/1659] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:11:04 2022] PUT /identity/v3/projects/72bd92fd690f4512850d5f2b811e11b7/users/ed11f37bef174e0eaeace613f1329e81/roles/ea564961b1db4eb4a1d4d880964611b2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:04.824333 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f77bcaf-b029-4540-9d57-002db761dd05 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:04.894862 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2e4160-db07-4c78-b379-ffb31fd81360 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:04.916060 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f77bcaf-b029-4540-9d57-002db761dd05 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:04.921993 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841fe1c8-8b41-48b9-9167-1432470a11d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:04.922612 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841fe1c8-8b41-48b9-9167-1432470a11d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:04.922893 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841fe1c8-8b41-48b9-9167-1432470a11d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:04.923171 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841fe1c8-8b41-48b9-9167-1432470a11d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:04.923815 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841fe1c8-8b41-48b9-9167-1432470a11d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:04.925404 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841fe1c8-8b41-48b9-9167-1432470a11d5 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:04.936195 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 833/1660] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:11:04.937011 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841fe1c8-8b41-48b9-9167-1432470a11d5 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:04.944277 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:04.950424 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841fe1c8-8b41-48b9-9167-1432470a11d5 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:04.955810 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aef2f8-0c67-44c5-b56c-1dcb60407467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:04.956346 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aef2f8-0c67-44c5-b56c-1dcb60407467 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:04.956623 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aef2f8-0c67-44c5-b56c-1dcb60407467 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:04.956898 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aef2f8-0c67-44c5-b56c-1dcb60407467 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:04.957535 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aef2f8-0c67-44c5-b56c-1dcb60407467 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:04.959209 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aef2f8-0c67-44c5-b56c-1dcb60407467 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:04.966479 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b736eed9-bf48-4b6a-82e6-80586f87169c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:04.967084 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b736eed9-bf48-4b6a-82e6-80586f87169c admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:04.967358 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b736eed9-bf48-4b6a-82e6-80586f87169c admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:04.967658 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b736eed9-bf48-4b6a-82e6-80586f87169c admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:04.968291 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b736eed9-bf48-4b6a-82e6-80586f87169c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:04.969036 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 834/1661] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:11:04.969844 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b736eed9-bf48-4b6a-82e6-80586f87169c admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:04.970857 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aef2f8-0c67-44c5-b56c-1dcb60407467 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:04.980110 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 828/1662] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:11:04.981229 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b736eed9-bf48-4b6a-82e6-80586f87169c admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:04.981347 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aef2f8-0c67-44c5-b56c-1dcb60407467 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:04.986840 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cbe4a4-5f0e-4c8b-85dc-157aac2b0cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:04.987474 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cbe4a4-5f0e-4c8b-85dc-157aac2b0cb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:04.987750 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cbe4a4-5f0e-4c8b-85dc-157aac2b0cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:04.988021 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cbe4a4-5f0e-4c8b-85dc-157aac2b0cb8 admin admin] PATH_INFO: `/v3/projects/fb05757729cf4225b40febea70ae6200/users/54fbb4fe7c5e446ca84c3ed5078ba873/roles/ea564961b1db4eb4a1d4d880964611b2` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:04.990565 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cbe4a4-5f0e-4c8b-85dc-157aac2b0cb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb05757729cf4225b40febea70ae6200, user_id=54fbb4fe7c5e446ca84c3ed5078ba873, role_id=ea564961b1db4eb4a1d4d880964611b2)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:04.991589 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b736eed9-bf48-4b6a-82e6-80586f87169c admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:04.993144 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cbe4a4-5f0e-4c8b-85dc-157aac2b0cb8 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:04.996218 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb093f-ab67-4b82-aabd-0502f07b4d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:04.996876 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb093f-ab67-4b82-aabd-0502f07b4d90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:04.997401 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb093f-ab67-4b82-aabd-0502f07b4d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:04.997674 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb093f-ab67-4b82-aabd-0502f07b4d90 admin admin] PATH_INFO: `/v3/projects/72bd92fd690f4512850d5f2b811e11b7/users/ed11f37bef174e0eaeace613f1329e81/roles/ea564961b1db4eb4a1d4d880964611b2` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:04.999593 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eb093f-ab67-4b82-aabd-0502f07b4d90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72bd92fd690f4512850d5f2b811e11b7, user_id=ed11f37bef174e0eaeace613f1329e81, role_id=ea564961b1db4eb4a1d4d880964611b2)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:05.002187 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eb093f-ab67-4b82-aabd-0502f07b4d90 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:05.004661 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 835/1663] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:11:04 2022] PUT /identity/v3/projects/fb05757729cf4225b40febea70ae6200/users/54fbb4fe7c5e446ca84c3ed5078ba873/roles/ea564961b1db4eb4a1d4d880964611b2 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:05.005930 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cbe4a4-5f0e-4c8b-85dc-157aac2b0cb8 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:05.013721 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 829/1664] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:11:04 2022] PUT /identity/v3/projects/72bd92fd690f4512850d5f2b811e11b7/users/ed11f37bef174e0eaeace613f1329e81/roles/ea564961b1db4eb4a1d4d880964611b2 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:05.019966 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81227694-b518-4d25-a685-4e2a88cdc8b1 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:05.020397 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81227694-b518-4d25-a685-4e2a88cdc8b1 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:05.020932 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81227694-b518-4d25-a685-4e2a88cdc8b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:05.048561 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-81227694-b518-4d25-a685-4e2a88cdc8b1 None None] MFA Rules not processed for user `54fbb4fe7c5e446ca84c3ed5078ba873`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:05.049794 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-81227694-b518-4d25-a685-4e2a88cdc8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:05.066546 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cbe4a4-5f0e-4c8b-85dc-157aac2b0cb8 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:05.079703 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:05.118044 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 830/1665] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:05 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:11:05.119615 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19457612-2bb2-4ef7-81d7-e617c33334e2 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:05.119897 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19457612-2bb2-4ef7-81d7-e617c33334e2 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:05.120168 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19457612-2bb2-4ef7-81d7-e617c33334e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:05.134403 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb1ef6-02c8-4e8c-9d31-30c260832cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:05.135061 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb1ef6-02c8-4e8c-9d31-30c260832cfb admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:05.135341 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb1ef6-02c8-4e8c-9d31-30c260832cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:05.135614 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb1ef6-02c8-4e8c-9d31-30c260832cfb admin admin] PATH_INFO: `/v3/projects/7210659d194b4c9495c449c3a2c62a76/users/cb0d937969a54bb7bb77e22b1e061096/roles/ea564961b1db4eb4a1d4d880964611b2` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:05.148331 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-19457612-2bb2-4ef7-81d7-e617c33334e2 None None] MFA Rules not processed for user `ed11f37bef174e0eaeace613f1329e81`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:05.149536 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-19457612-2bb2-4ef7-81d7-e617c33334e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:05.150256 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bb1ef6-02c8-4e8c-9d31-30c260832cfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7210659d194b4c9495c449c3a2c62a76, user_id=cb0d937969a54bb7bb77e22b1e061096, role_id=ea564961b1db4eb4a1d4d880964611b2)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:05.152852 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bb1ef6-02c8-4e8c-9d31-30c260832cfb admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:05.166035 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 836/1666] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:11:05 2022] PUT /identity/v3/projects/7210659d194b4c9495c449c3a2c62a76/users/cb0d937969a54bb7bb77e22b1e061096/roles/ea564961b1db4eb4a1d4d880964611b2 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:05.169811 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb1ef6-02c8-4e8c-9d31-30c260832cfb admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:05.171428 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-f6bb1ef6-02c8-4e8c-9d31-30c260832cfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:05.217426 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 831/1667] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:05 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:11:05.218278 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19457612-2bb2-4ef7-81d7-e617c33334e2 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:05.230909 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19457612-2bb2-4ef7-81d7-e617c33334e2 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:05.231725 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb1ef6-02c8-4e8c-9d31-30c260832cfb admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:05.235519 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb2065-701e-4aa4-9421-fa1da6e371a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f4c2fc51f54f0e977648b13efaed1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:05.236200 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb2065-701e-4aa4-9421-fa1da6e371a9 service cinder] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:05.236488 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb2065-701e-4aa4-9421-fa1da6e371a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:05.236763 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb2065-701e-4aa4-9421-fa1da6e371a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:05.263357 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:05.295619 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd2fe40-7205-4306-8e97-55877b217440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:05.296391 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd2fe40-7205-4306-8e97-55877b217440 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:05.296787 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd2fe40-7205-4306-8e97-55877b217440 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:05.297225 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd2fe40-7205-4306-8e97-55877b217440 admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:05.298018 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd2fe40-7205-4306-8e97-55877b217440 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:05.299747 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd2fe40-7205-4306-8e97-55877b217440 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:05.304613 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fb2065-701e-4aa4-9421-fa1da6e371a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:05.306094 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fb2065-701e-4aa4-9421-fa1da6e371a9 service cinder] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:05.311780 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 832/1668] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:11:05 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:11:05.312549 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd2fe40-7205-4306-8e97-55877b217440 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:05.314315 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-3bd2fe40-7205-4306-8e97-55877b217440 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:05.318078 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 837/1669] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:11:05 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:11:05.319202 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb2065-701e-4aa4-9421-fa1da6e371a9 service cinder] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:05.326398 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd2fe40-7205-4306-8e97-55877b217440 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:05.330189 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8779b7-9319-441b-9f7f-6f7248b52d9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f4c2fc51f54f0e977648b13efaed1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:05.330791 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8779b7-9319-441b-9f7f-6f7248b52d9c service cinder] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:05.330919 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb2065-701e-4aa4-9421-fa1da6e371a9 service cinder] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:05.331120 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8779b7-9319-441b-9f7f-6f7248b52d9c service cinder] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:05.331534 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8779b7-9319-441b-9f7f-6f7248b52d9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:05.336015 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4523e520-f80e-4f76-a721-02180649a06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:05.336678 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4523e520-f80e-4f76-a721-02180649a06c admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:05.336959 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4523e520-f80e-4f76-a721-02180649a06c admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:05.337231 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4523e520-f80e-4f76-a721-02180649a06c admin admin] PATH_INFO: `/v3/projects/7210659d194b4c9495c449c3a2c62a76/users/cb0d937969a54bb7bb77e22b1e061096/roles/ea564961b1db4eb4a1d4d880964611b2` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:05.339139 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4523e520-f80e-4f76-a721-02180649a06c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7210659d194b4c9495c449c3a2c62a76, user_id=cb0d937969a54bb7bb77e22b1e061096, role_id=ea564961b1db4eb4a1d4d880964611b2)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:05.341712 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4523e520-f80e-4f76-a721-02180649a06c admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:05.369497 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 838/1670] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:11:05 2022] PUT /identity/v3/projects/7210659d194b4c9495c449c3a2c62a76/users/cb0d937969a54bb7bb77e22b1e061096/roles/ea564961b1db4eb4a1d4d880964611b2 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:05.372475 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa6abc8-da0f-4845-8bdf-d03ead6fdc0d None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:05.372840 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa6abc8-da0f-4845-8bdf-d03ead6fdc0d None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:05.373206 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa6abc8-da0f-4845-8bdf-d03ead6fdc0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:05.389183 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:05.412891 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-8aa6abc8-da0f-4845-8bdf-d03ead6fdc0d None None] MFA Rules not processed for user `cb0d937969a54bb7bb77e22b1e061096`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:05.415656 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-8aa6abc8-da0f-4845-8bdf-d03ead6fdc0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:05.428597 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8779b7-9319-441b-9f7f-6f7248b52d9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:05.431616 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8779b7-9319-441b-9f7f-6f7248b52d9c service cinder] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:05.457826 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 833/1671] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:11:05 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:11:05.525832 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 839/1672] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:05 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 11:11:05.651381 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8779b7-9319-441b-9f7f-6f7248b52d9c service cinder] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:05.683198 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8779b7-9319-441b-9f7f-6f7248b52d9c service cinder] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:05.793815 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c18bd-9147-4b65-b43b-f94732fa7066 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f4c2fc51f54f0e977648b13efaed1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:05.798438 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c18bd-9147-4b65-b43b-f94732fa7066 service cinder] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:05.798588 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c18bd-9147-4b65-b43b-f94732fa7066 service cinder] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:05.798972 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c18bd-9147-4b65-b43b-f94732fa7066 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:05.859929 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa6abc8-da0f-4845-8bdf-d03ead6fdc0d None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:05.872786 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa6abc8-da0f-4845-8bdf-d03ead6fdc0d None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:05.884105 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c051cd-3a9a-4ddd-ac7f-6f607c3cc501 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f4c2fc51f54f0e977648b13efaed1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:05.884862 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c051cd-3a9a-4ddd-ac7f-6f607c3cc501 service cinder] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:05.885014 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c051cd-3a9a-4ddd-ac7f-6f607c3cc501 service cinder] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:05.885291 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c051cd-3a9a-4ddd-ac7f-6f607c3cc501 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:05.917589 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577c18bd-9147-4b65-b43b-f94732fa7066 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:05.919088 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577c18bd-9147-4b65-b43b-f94732fa7066 service cinder] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:05.931637 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 834/1673] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:11:05 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:11:05.996074 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c051cd-3a9a-4ddd-ac7f-6f607c3cc501 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:05.998846 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c051cd-3a9a-4ddd-ac7f-6f607c3cc501 service cinder] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:06.010537 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 840/1674] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:11:05 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 13 11:11:06.583700 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c18bd-9147-4b65-b43b-f94732fa7066 service cinder] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:06.647532 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c18bd-9147-4b65-b43b-f94732fa7066 service cinder] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:06.652202 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d70613-686a-4232-a335-a145cf1f30a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:06.652841 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d70613-686a-4232-a335-a145cf1f30a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:06.653125 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d70613-686a-4232-a335-a145cf1f30a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:06.653679 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d70613-686a-4232-a335-a145cf1f30a7 admin admin] PATH_INFO: `/v3/users/9a035510aba748af8984ac8c4f391bcf` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:06.654561 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d70613-686a-4232-a335-a145cf1f30a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a035510aba748af8984ac8c4f391bcf)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:06.656524 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d70613-686a-4232-a335-a145cf1f30a7 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:06.700442 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:06.710976 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-58d70613-686a-4232-a335-a145cf1f30a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a035510aba748af8984ac8c4f391bcf'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:06.719198 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-58d70613-686a-4232-a335-a145cf1f30a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a035510aba748af8984ac8c4f391bcf'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:06.719910 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-58d70613-686a-4232-a335-a145cf1f30a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a035510aba748af8984ac8c4f391bcf'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:06.720540 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-58d70613-686a-4232-a335-a145cf1f30a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a035510aba748af8984ac8c4f391bcf'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:06.739624 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-58d70613-686a-4232-a335-a145cf1f30a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a035510aba748af8984ac8c4f391bcf'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:06.760307 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 835/1675] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:11:06 2022] DELETE /identity/v3/users/9a035510aba748af8984ac8c4f391bcf => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:06.764794 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df32544b-cbbd-4626-83d7-10e9a3059616 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:06.765266 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df32544b-cbbd-4626-83d7-10e9a3059616 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:06.765354 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df32544b-cbbd-4626-83d7-10e9a3059616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:06.785286 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-df32544b-cbbd-4626-83d7-10e9a3059616 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:06.787226 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-df32544b-cbbd-4626-83d7-10e9a3059616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:06.820619 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:06.850821 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 841/1676] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 11:11:06.863474 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d70613-686a-4232-a335-a145cf1f30a7 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:06.864996 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-58d70613-686a-4232-a335-a145cf1f30a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:06.924093 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df32544b-cbbd-4626-83d7-10e9a3059616 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:06.925708 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-df32544b-cbbd-4626-83d7-10e9a3059616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:06.929743 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d70613-686a-4232-a335-a145cf1f30a7 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:06.936184 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9fdb61-070d-4247-8e96-9070898d8ebd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:06.936862 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9fdb61-070d-4247-8e96-9070898d8ebd service neutron] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:06.937149 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9fdb61-070d-4247-8e96-9070898d8ebd service neutron] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:06.937473 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9fdb61-070d-4247-8e96-9070898d8ebd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:06.950243 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9fdb61-070d-4247-8e96-9070898d8ebd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:06.952071 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9fdb61-070d-4247-8e96-9070898d8ebd service neutron] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:06.963409 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 836/1677] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:11:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:11:06.987436 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df32544b-cbbd-4626-83d7-10e9a3059616 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:06.991133 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7431b71-658f-4efc-b6a2-d202063b0ee8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f4c2fc51f54f0e977648b13efaed1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:06.991756 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7431b71-658f-4efc-b6a2-d202063b0ee8 service cinder] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:06.992032 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7431b71-658f-4efc-b6a2-d202063b0ee8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:06.992302 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7431b71-658f-4efc-b6a2-d202063b0ee8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:06.995445 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-f7431b71-658f-4efc-b6a2-d202063b0ee8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:07.076513 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7431b71-658f-4efc-b6a2-d202063b0ee8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:07.077881 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7431b71-658f-4efc-b6a2-d202063b0ee8 service cinder] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:07.088359 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 842/1678] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:11:06 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 13 11:11:07.317980 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9fdb61-070d-4247-8e96-9070898d8ebd service neutron] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:07.330801 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-fc9fdb61-070d-4247-8e96-9070898d8ebd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:07.344232 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9fdb61-070d-4247-8e96-9070898d8ebd service neutron] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:07.348944 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dfc92d-5c89-446e-b7cb-6b9365a9d367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:07.349572 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dfc92d-5c89-446e-b7cb-6b9365a9d367 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:07.349855 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dfc92d-5c89-446e-b7cb-6b9365a9d367 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:07.350211 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dfc92d-5c89-446e-b7cb-6b9365a9d367 admin admin] PATH_INFO: `/v3/projects/0f45c5e76bb149249a505aa5c5a7b2eb` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:07.351330 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dfc92d-5c89-446e-b7cb-6b9365a9d367 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f45c5e76bb149249a505aa5c5a7b2eb)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:07.353221 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dfc92d-5c89-446e-b7cb-6b9365a9d367 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:07.401376 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-95dfc92d-5c89-446e-b7cb-6b9365a9d367 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f45c5e76bb149249a505aa5c5a7b2eb', 'request_id': 'req-95dfc92d-5c89-446e-b7cb-6b9365a9d367'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:07.408178 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-95dfc92d-5c89-446e-b7cb-6b9365a9d367 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f45c5e76bb149249a505aa5c5a7b2eb', 'request_id': 'req-95dfc92d-5c89-446e-b7cb-6b9365a9d367'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:07.415482 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-95dfc92d-5c89-446e-b7cb-6b9365a9d367 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f45c5e76bb149249a505aa5c5a7b2eb', 'request_id': 'req-95dfc92d-5c89-446e-b7cb-6b9365a9d367'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:07.431904 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-95dfc92d-5c89-446e-b7cb-6b9365a9d367 admin admin] The token cache is being invalidate because project 0f45c5e76bb149249a505aa5c5a7b2eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:11:07.432342 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-95dfc92d-5c89-446e-b7cb-6b9365a9d367 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:07.433068 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-95dfc92d-5c89-446e-b7cb-6b9365a9d367 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:07.435026 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 837/1679] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:11:07 2022] DELETE /identity/v3/projects/0f45c5e76bb149249a505aa5c5a7b2eb => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:07.438860 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7431b71-658f-4efc-b6a2-d202063b0ee8 service cinder] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:07.451088 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7431b71-658f-4efc-b6a2-d202063b0ee8 service cinder] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:07.542145 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775c4467-3792-4886-a114-1b4ccb6f2532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:07.542656 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c4467-3792-4886-a114-1b4ccb6f2532 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:07.543030 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c4467-3792-4886-a114-1b4ccb6f2532 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:07.543314 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c4467-3792-4886-a114-1b4ccb6f2532 admin admin] PATH_INFO: `/v3/users/ed11f37bef174e0eaeace613f1329e81` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:07.544814 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775c4467-3792-4886-a114-1b4ccb6f2532 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed11f37bef174e0eaeace613f1329e81)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:07.547693 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775c4467-3792-4886-a114-1b4ccb6f2532 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:07.592228 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:07.617417 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-775c4467-3792-4886-a114-1b4ccb6f2532 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed11f37bef174e0eaeace613f1329e81'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:07.618292 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-775c4467-3792-4886-a114-1b4ccb6f2532 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed11f37bef174e0eaeace613f1329e81'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:07.618941 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-775c4467-3792-4886-a114-1b4ccb6f2532 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed11f37bef174e0eaeace613f1329e81'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:07.635782 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-775c4467-3792-4886-a114-1b4ccb6f2532 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed11f37bef174e0eaeace613f1329e81'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:07.649077 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-775c4467-3792-4886-a114-1b4ccb6f2532 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed11f37bef174e0eaeace613f1329e81'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:07.674041 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 843/1680] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:11:07 2022] DELETE /identity/v3/users/ed11f37bef174e0eaeace613f1329e81 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:07.689454 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dfc92d-5c89-446e-b7cb-6b9365a9d367 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:07.690902 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-95dfc92d-5c89-446e-b7cb-6b9365a9d367 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:07.693322 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775c4467-3792-4886-a114-1b4ccb6f2532 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:07.694746 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-775c4467-3792-4886-a114-1b4ccb6f2532 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:07.748878 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:07.769219 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dfc92d-5c89-446e-b7cb-6b9365a9d367 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:07.782690 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775c4467-3792-4886-a114-1b4ccb6f2532 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:07.788720 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a61882-ead4-424c-9ee1-3e4d93160db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:07.789451 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a61882-ead4-424c-9ee1-3e4d93160db8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:07.789729 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a61882-ead4-424c-9ee1-3e4d93160db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:07.790024 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a61882-ead4-424c-9ee1-3e4d93160db8 admin admin] PATH_INFO: `/v3/users/cb6bf725ff084e61ab38a301e575a32b` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:07.791238 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a61882-ead4-424c-9ee1-3e4d93160db8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb6bf725ff084e61ab38a301e575a32b)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:07.794662 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a61882-ead4-424c-9ee1-3e4d93160db8 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:07.832356 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2640a81c-b090-4639-9220-1e03a0b9573b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f4c2fc51f54f0e977648b13efaed1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:07.832927 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640a81c-b090-4639-9220-1e03a0b9573b service cinder] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:07.833668 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640a81c-b090-4639-9220-1e03a0b9573b service cinder] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:07.834498 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640a81c-b090-4639-9220-1e03a0b9573b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:07.835873 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-2640a81c-b090-4639-9220-1e03a0b9573b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:07.895665 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-24a61882-ead4-424c-9ee1-3e4d93160db8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb6bf725ff084e61ab38a301e575a32b'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:07.896966 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-24a61882-ead4-424c-9ee1-3e4d93160db8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb6bf725ff084e61ab38a301e575a32b'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:07.898559 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-24a61882-ead4-424c-9ee1-3e4d93160db8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb6bf725ff084e61ab38a301e575a32b'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:07.928493 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-24a61882-ead4-424c-9ee1-3e4d93160db8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb6bf725ff084e61ab38a301e575a32b'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:07.954530 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-24a61882-ead4-424c-9ee1-3e4d93160db8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb6bf725ff084e61ab38a301e575a32b'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:07.971282 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 844/1681] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:11:07 2022] DELETE /identity/v3/users/cb6bf725ff084e61ab38a301e575a32b => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 11:11:07.978531 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289fe79-0901-4ac5-8f2f-931abfaac689 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:07.980844 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289fe79-0901-4ac5-8f2f-931abfaac689 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:07.981301 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289fe79-0901-4ac5-8f2f-931abfaac689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:08.011677 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-8289fe79-0901-4ac5-8f2f-931abfaac689 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:08.013019 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-8289fe79-0901-4ac5-8f2f-931abfaac689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:08.016804 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2640a81c-b090-4639-9220-1e03a0b9573b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:08.021367 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2640a81c-b090-4639-9220-1e03a0b9573b service cinder] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:08.038195 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 838/1682] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:11:07 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:11:08.039080 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2640a81c-b090-4639-9220-1e03a0b9573b service cinder] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:08.040476 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-2640a81c-b090-4639-9220-1e03a0b9573b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:08.045295 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:08.056246 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2640a81c-b090-4639-9220-1e03a0b9573b service cinder] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:08.113488 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 845/1683] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:11:08.132359 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8289fe79-0901-4ac5-8f2f-931abfaac689 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:08.136702 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0673ea-00d7-4593-896d-00a99a37de58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:08.137345 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0673ea-00d7-4593-896d-00a99a37de58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:08.137616 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-8289fe79-0901-4ac5-8f2f-931abfaac689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:08.137718 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0673ea-00d7-4593-896d-00a99a37de58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:08.137885 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0673ea-00d7-4593-896d-00a99a37de58 admin admin] PATH_INFO: `/v3/projects/72bd92fd690f4512850d5f2b811e11b7` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:08.139084 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0673ea-00d7-4593-896d-00a99a37de58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72bd92fd690f4512850d5f2b811e11b7)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:08.141177 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0673ea-00d7-4593-896d-00a99a37de58 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:08.193063 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-bc0673ea-00d7-4593-896d-00a99a37de58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72bd92fd690f4512850d5f2b811e11b7', 'request_id': 'req-bc0673ea-00d7-4593-896d-00a99a37de58'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:08.200403 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-bc0673ea-00d7-4593-896d-00a99a37de58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72bd92fd690f4512850d5f2b811e11b7', 'request_id': 'req-bc0673ea-00d7-4593-896d-00a99a37de58'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:08.201876 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:08.209296 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-bc0673ea-00d7-4593-896d-00a99a37de58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72bd92fd690f4512850d5f2b811e11b7', 'request_id': 'req-bc0673ea-00d7-4593-896d-00a99a37de58'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:08.215831 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8289fe79-0901-4ac5-8f2f-931abfaac689 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:08.222194 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-bc0673ea-00d7-4593-896d-00a99a37de58 admin admin] The token cache is being invalidate because project 72bd92fd690f4512850d5f2b811e11b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:11:08.222613 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-bc0673ea-00d7-4593-896d-00a99a37de58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:08.224039 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-bc0673ea-00d7-4593-896d-00a99a37de58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:08.225561 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 839/1684] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:11:08 2022] DELETE /identity/v3/projects/72bd92fd690f4512850d5f2b811e11b7 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:08.230065 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f9edf-8310-4051-b790-f84bb4d709c0 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:08.230354 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f9edf-8310-4051-b790-f84bb4d709c0 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:08.230631 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f9edf-8310-4051-b790-f84bb4d709c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:08.264019 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-bd1f9edf-8310-4051-b790-f84bb4d709c0 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:08.265331 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-bd1f9edf-8310-4051-b790-f84bb4d709c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:08.281000 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a564cbe-ac3a-452b-a0b0-d199d95d4eeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:08.282150 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a564cbe-ac3a-452b-a0b0-d199d95d4eeb service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:08.282574 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a564cbe-ac3a-452b-a0b0-d199d95d4eeb service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:08.283046 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a564cbe-ac3a-452b-a0b0-d199d95d4eeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:08.285164 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-1a564cbe-ac3a-452b-a0b0-d199d95d4eeb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:08.347306 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 840/1685] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 11:11:08.356280 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf124043-4f9b-4d13-8c7b-adcf1ee248af None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:08.356483 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf124043-4f9b-4d13-8c7b-adcf1ee248af None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:08.356851 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf124043-4f9b-4d13-8c7b-adcf1ee248af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:08.380861 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-bf124043-4f9b-4d13-8c7b-adcf1ee248af None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:08.382168 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-bf124043-4f9b-4d13-8c7b-adcf1ee248af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:08.391005 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 841/1686] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 11:11:08.395861 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf124043-4f9b-4d13-8c7b-adcf1ee248af None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:08.405991 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf124043-4f9b-4d13-8c7b-adcf1ee248af None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:08.411919 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e087ba3f-fd60-4c5f-8bba-d120c8f63d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:08.412780 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e087ba3f-fd60-4c5f-8bba-d120c8f63d31 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:08.413121 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e087ba3f-fd60-4c5f-8bba-d120c8f63d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:08.413459 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e087ba3f-fd60-4c5f-8bba-d120c8f63d31 admin admin] PATH_INFO: `/v3/domains` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:08.414313 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e087ba3f-fd60-4c5f-8bba-d120c8f63d31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:11:08.414642 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e087ba3f-fd60-4c5f-8bba-d120c8f63d31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:08.416306 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e087ba3f-fd60-4c5f-8bba-d120c8f63d31 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:08.434406 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a564cbe-ac3a-452b-a0b0-d199d95d4eeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:08.434616 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 842/1687] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 11:11:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 11:11:08.436354 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a564cbe-ac3a-452b-a0b0-d199d95d4eeb service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:08.437924 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e087ba3f-fd60-4c5f-8bba-d120c8f63d31 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:08.450215 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e087ba3f-fd60-4c5f-8bba-d120c8f63d31 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:08.450935 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 846/1688] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:11:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:11:08.460646 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3265163f-9a88-4ae4-94ea-6c160a2abebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:08.462063 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3265163f-9a88-4ae4-94ea-6c160a2abebd admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:08.462578 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3265163f-9a88-4ae4-94ea-6c160a2abebd admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:08.463153 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3265163f-9a88-4ae4-94ea-6c160a2abebd admin admin] PATH_INFO: `/v3/projects` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:08.463977 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3265163f-9a88-4ae4-94ea-6c160a2abebd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:08.474215 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3265163f-9a88-4ae4-94ea-6c160a2abebd admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:08.515933 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 843/1689] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:11:08 2022] POST /identity/v3/projects => generated 375 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 11:11:08.521322 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a564cbe-ac3a-452b-a0b0-d199d95d4eeb service neutron] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:08.542226 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a564cbe-ac3a-452b-a0b0-d199d95d4eeb service neutron] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:08.597220 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:08.647144 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4694146-cc7c-4004-b395-4f8271ad70a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:08.647858 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4694146-cc7c-4004-b395-4f8271ad70a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:08.649251 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4694146-cc7c-4004-b395-4f8271ad70a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:08.649685 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4694146-cc7c-4004-b395-4f8271ad70a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:08.650431 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4694146-cc7c-4004-b395-4f8271ad70a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:08.652513 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4694146-cc7c-4004-b395-4f8271ad70a4 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:08.677138 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 847/1690] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:11:08 2022] POST /identity/v3/users => generated 288 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:11:08.680917 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3265163f-9a88-4ae4-94ea-6c160a2abebd admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:08.708138 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3265163f-9a88-4ae4-94ea-6c160a2abebd admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:08.716044 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c55932b-22bc-4e6a-80fb-4e9f32ba8929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:08.716905 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55932b-22bc-4e6a-80fb-4e9f32ba8929 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:08.717372 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55932b-22bc-4e6a-80fb-4e9f32ba8929 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:08.717826 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55932b-22bc-4e6a-80fb-4e9f32ba8929 admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:08.719243 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c55932b-22bc-4e6a-80fb-4e9f32ba8929 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:08.722041 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c55932b-22bc-4e6a-80fb-4e9f32ba8929 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:08.746706 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 844/1691] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:11:08 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 13 11:11:08.746985 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4694146-cc7c-4004-b395-4f8271ad70a4 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:08.760164 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4694146-cc7c-4004-b395-4f8271ad70a4 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:08.764843 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9fe3f8-582f-470d-a5a5-f24cae71866f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:08.765550 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9fe3f8-582f-470d-a5a5-f24cae71866f admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:08.765893 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9fe3f8-582f-470d-a5a5-f24cae71866f admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:08.766274 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9fe3f8-582f-470d-a5a5-f24cae71866f admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:08.767096 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9fe3f8-582f-470d-a5a5-f24cae71866f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:08.775045 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9fe3f8-582f-470d-a5a5-f24cae71866f admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:08.788974 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 848/1692] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:11:08 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 13 11:11:08.792673 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c55932b-22bc-4e6a-80fb-4e9f32ba8929 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:08.807428 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c55932b-22bc-4e6a-80fb-4e9f32ba8929 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:08.814802 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c56070-62de-4d95-8dd1-42a6b98ec3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:08.815561 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c56070-62de-4d95-8dd1-42a6b98ec3df admin admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:08.815830 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c56070-62de-4d95-8dd1-42a6b98ec3df admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:08.816126 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c56070-62de-4d95-8dd1-42a6b98ec3df admin admin] PATH_INFO: `/v3/projects/5977413e769b486e8542c54abb8c31ce/users/19ac7e4ca71046bfae030d7a239bdc5c/roles/7c3871c0ab68438b9014489d50b53a22` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:08.842097 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9fe3f8-582f-470d-a5a5-f24cae71866f admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:08.844797 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-ae9fe3f8-582f-470d-a5a5-f24cae71866f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:08.847610 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c56070-62de-4d95-8dd1-42a6b98ec3df admin admin] RBAC: Authorizing `identity:create_grant(project_id=5977413e769b486e8542c54abb8c31ce, user_id=19ac7e4ca71046bfae030d7a239bdc5c, role_id=7c3871c0ab68438b9014489d50b53a22)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:08.852699 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c56070-62de-4d95-8dd1-42a6b98ec3df admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:08.873409 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 845/1693] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:11:08 2022] PUT /identity/v3/projects/5977413e769b486e8542c54abb8c31ce/users/19ac7e4ca71046bfae030d7a239bdc5c/roles/7c3871c0ab68438b9014489d50b53a22 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 11:11:08.877506 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9fe3f8-582f-470d-a5a5-f24cae71866f admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:08.888500 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33078c50-3cfc-4bcb-a801-c07e08217ad0 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:08.888787 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33078c50-3cfc-4bcb-a801-c07e08217ad0 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:08.889062 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33078c50-3cfc-4bcb-a801-c07e08217ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:08.920073 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-33078c50-3cfc-4bcb-a801-c07e08217ad0 None None] MFA Rules not processed for user `19ac7e4ca71046bfae030d7a239bdc5c`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:08.921497 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-33078c50-3cfc-4bcb-a801-c07e08217ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:08.950985 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de1b05-2f31-49a0-af51-d6db23a51cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:08.951617 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de1b05-2f31-49a0-af51-d6db23a51cb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:08.951892 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de1b05-2f31-49a0-af51-d6db23a51cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:08.952163 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de1b05-2f31-49a0-af51-d6db23a51cb8 admin admin] PATH_INFO: `/v3/projects/eb78fa05bc5e40f1af5259659364d7d1` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:08.954759 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06de1b05-2f31-49a0-af51-d6db23a51cb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb78fa05bc5e40f1af5259659364d7d1)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:08.956660 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06de1b05-2f31-49a0-af51-d6db23a51cb8 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:08.982870 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:08.996450 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 846/1694] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 11:11:08.997639 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33078c50-3cfc-4bcb-a801-c07e08217ad0 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:08.999108 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-33078c50-3cfc-4bcb-a801-c07e08217ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:09.016662 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-06de1b05-2f31-49a0-af51-d6db23a51cb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb78fa05bc5e40f1af5259659364d7d1', 'request_id': 'req-06de1b05-2f31-49a0-af51-d6db23a51cb8'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:09.026973 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-06de1b05-2f31-49a0-af51-d6db23a51cb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb78fa05bc5e40f1af5259659364d7d1', 'request_id': 'req-06de1b05-2f31-49a0-af51-d6db23a51cb8'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:09.034026 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-06de1b05-2f31-49a0-af51-d6db23a51cb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb78fa05bc5e40f1af5259659364d7d1', 'request_id': 'req-06de1b05-2f31-49a0-af51-d6db23a51cb8'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:09.045322 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-06de1b05-2f31-49a0-af51-d6db23a51cb8 admin admin] The token cache is being invalidate because project eb78fa05bc5e40f1af5259659364d7d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:11:09.045619 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-06de1b05-2f31-49a0-af51-d6db23a51cb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:09.046337 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-06de1b05-2f31-49a0-af51-d6db23a51cb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:09.048659 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 849/1695] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:11:08 2022] DELETE /identity/v3/projects/eb78fa05bc5e40f1af5259659364d7d1 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:09.052792 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de1b05-2f31-49a0-af51-d6db23a51cb8 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:09.054438 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-06de1b05-2f31-49a0-af51-d6db23a51cb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:09.079511 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33078c50-3cfc-4bcb-a801-c07e08217ad0 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:09.108594 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:09.138145 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d52fb5-be54-4d96-8ec7-5f1f2911b1f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f4c2fc51f54f0e977648b13efaed1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:09.138762 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d52fb5-be54-4d96-8ec7-5f1f2911b1f4 service cinder] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:09.139133 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d52fb5-be54-4d96-8ec7-5f1f2911b1f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:09.139515 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d52fb5-be54-4d96-8ec7-5f1f2911b1f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:09.143569 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-63d52fb5-be54-4d96-8ec7-5f1f2911b1f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:09.149321 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de1b05-2f31-49a0-af51-d6db23a51cb8 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:09.153561 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba8e7a2-5acc-4e9f-84c6-d4baf4fb9ad5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '399f7d3700a24cb486e56b409a6e5429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:09.154362 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8e7a2-5acc-4e9f-84c6-d4baf4fb9ad5 service glance] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:09.154820 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8e7a2-5acc-4e9f-84c6-d4baf4fb9ad5 service glance] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:09.155438 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8e7a2-5acc-4e9f-84c6-d4baf4fb9ad5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:09.156858 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-5ba8e7a2-5acc-4e9f-84c6-d4baf4fb9ad5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:09.212523 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d52fb5-be54-4d96-8ec7-5f1f2911b1f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:09.213983 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d52fb5-be54-4d96-8ec7-5f1f2911b1f4 service cinder] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:09.226168 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 847/1696] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:11:08 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:11:09.227174 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d52fb5-be54-4d96-8ec7-5f1f2911b1f4 service cinder] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:09.228565 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-63d52fb5-be54-4d96-8ec7-5f1f2911b1f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:09.253710 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba8e7a2-5acc-4e9f-84c6-d4baf4fb9ad5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:09.255562 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba8e7a2-5acc-4e9f-84c6-d4baf4fb9ad5 service glance] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:09.276870 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 850/1697] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:11:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:11:09.344470 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d52fb5-be54-4d96-8ec7-5f1f2911b1f4 service cinder] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:09.350496 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31bafa5-c012-4e88-8ea5-4e0c01acba08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:09.351410 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31bafa5-c012-4e88-8ea5-4e0c01acba08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:09.351986 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31bafa5-c012-4e88-8ea5-4e0c01acba08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:09.352466 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31bafa5-c012-4e88-8ea5-4e0c01acba08 admin admin] PATH_INFO: `/v3/users/ba801bd230db478a94ca8d513d991986` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:09.353836 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31bafa5-c012-4e88-8ea5-4e0c01acba08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba801bd230db478a94ca8d513d991986)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:09.356656 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31bafa5-c012-4e88-8ea5-4e0c01acba08 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:09.379381 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:09.439048 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-f31bafa5-c012-4e88-8ea5-4e0c01acba08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba801bd230db478a94ca8d513d991986'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:09.450938 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-f31bafa5-c012-4e88-8ea5-4e0c01acba08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba801bd230db478a94ca8d513d991986'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:09.451821 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-f31bafa5-c012-4e88-8ea5-4e0c01acba08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba801bd230db478a94ca8d513d991986'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:09.452529 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-f31bafa5-c012-4e88-8ea5-4e0c01acba08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba801bd230db478a94ca8d513d991986'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:09.466769 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-f31bafa5-c012-4e88-8ea5-4e0c01acba08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba801bd230db478a94ca8d513d991986'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:09.487731 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 848/1698] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:11:09 2022] DELETE /identity/v3/users/ba801bd230db478a94ca8d513d991986 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:09.999975 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba8e7a2-5acc-4e9f-84c6-d4baf4fb9ad5 service glance] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:10.013196 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba8e7a2-5acc-4e9f-84c6-d4baf4fb9ad5 service glance] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:10.113684 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962c0fc0-a799-412f-afce-e7630843b05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:10.115183 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c0fc0-a799-412f-afce-e7630843b05c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:10.115463 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c0fc0-a799-412f-afce-e7630843b05c admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:10.116711 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c0fc0-a799-412f-afce-e7630843b05c admin admin] PATH_INFO: `/v3/projects/c3113f4154f546d0ad3f222cab9bfbf0` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:10.120999 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962c0fc0-a799-412f-afce-e7630843b05c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3113f4154f546d0ad3f222cab9bfbf0)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:10.124277 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962c0fc0-a799-412f-afce-e7630843b05c admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:10.241754 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-962c0fc0-a799-412f-afce-e7630843b05c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3113f4154f546d0ad3f222cab9bfbf0', 'request_id': 'req-962c0fc0-a799-412f-afce-e7630843b05c'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:10.270701 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-962c0fc0-a799-412f-afce-e7630843b05c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3113f4154f546d0ad3f222cab9bfbf0', 'request_id': 'req-962c0fc0-a799-412f-afce-e7630843b05c'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:10.278589 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-962c0fc0-a799-412f-afce-e7630843b05c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3113f4154f546d0ad3f222cab9bfbf0', 'request_id': 'req-962c0fc0-a799-412f-afce-e7630843b05c'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:10.296614 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-962c0fc0-a799-412f-afce-e7630843b05c admin admin] The token cache is being invalidate because project c3113f4154f546d0ad3f222cab9bfbf0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:11:10.297152 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-962c0fc0-a799-412f-afce-e7630843b05c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:10.298061 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-962c0fc0-a799-412f-afce-e7630843b05c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:10.300010 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 851/1699] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:11:09 2022] DELETE /identity/v3/projects/c3113f4154f546d0ad3f222cab9bfbf0 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:10.304786 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903fe06e-4e40-4835-94f8-e4daf1f5f34e None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:10.305510 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903fe06e-4e40-4835-94f8-e4daf1f5f34e None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:10.305876 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903fe06e-4e40-4835-94f8-e4daf1f5f34e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:10.332545 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-903fe06e-4e40-4835-94f8-e4daf1f5f34e None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:10.334802 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-903fe06e-4e40-4835-94f8-e4daf1f5f34e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:10.450195 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 849/1700] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:11:10.450646 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1141ff4-1f51-4437-b990-b6ea54ecd549 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:10.450646 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1141ff4-1f51-4437-b990-b6ea54ecd549 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:10.450804 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1141ff4-1f51-4437-b990-b6ea54ecd549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:10.460801 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:10.478099 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-c1141ff4-1f51-4437-b990-b6ea54ecd549 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:10.479784 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-c1141ff4-1f51-4437-b990-b6ea54ecd549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:10.510265 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 852/1701] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:11:10.514428 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903fe06e-4e40-4835-94f8-e4daf1f5f34e None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:10.528960 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903fe06e-4e40-4835-94f8-e4daf1f5f34e None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:10.543680 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c599f9-932e-4969-af9d-eeea63df6712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:10.544323 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c599f9-932e-4969-af9d-eeea63df6712 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:10.544609 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c599f9-932e-4969-af9d-eeea63df6712 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:10.544884 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c599f9-932e-4969-af9d-eeea63df6712 admin admin] PATH_INFO: `/v3/domains` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:10.545677 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c599f9-932e-4969-af9d-eeea63df6712 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:11:10.545861 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c599f9-932e-4969-af9d-eeea63df6712 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:10.551909 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c599f9-932e-4969-af9d-eeea63df6712 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:10.585781 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 850/1702] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 11:11:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 11:11:10.588747 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1141ff4-1f51-4437-b990-b6ea54ecd549 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:10.601380 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1141ff4-1f51-4437-b990-b6ea54ecd549 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:10.615037 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aa488f-dfbd-4f29-8740-315f587f35ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:10.615799 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa488f-dfbd-4f29-8740-315f587f35ed admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:10.615898 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa488f-dfbd-4f29-8740-315f587f35ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:10.616589 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa488f-dfbd-4f29-8740-315f587f35ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:10.616750 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aa488f-dfbd-4f29-8740-315f587f35ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:10.618710 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aa488f-dfbd-4f29-8740-315f587f35ed admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:10.714559 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 853/1703] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:11:10 2022] POST /identity/v3/projects => generated 373 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:11:10.718336 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c599f9-932e-4969-af9d-eeea63df6712 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:10.729214 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c599f9-932e-4969-af9d-eeea63df6712 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:10.849627 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66c55e0-4bb1-4f6d-8f4b-d8ffd7eb951a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:10.850364 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c55e0-4bb1-4f6d-8f4b-d8ffd7eb951a admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:10.850687 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c55e0-4bb1-4f6d-8f4b-d8ffd7eb951a admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:10.850952 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c55e0-4bb1-4f6d-8f4b-d8ffd7eb951a admin admin] PATH_INFO: `/v3/users` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:10.851745 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66c55e0-4bb1-4f6d-8f4b-d8ffd7eb951a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:10.853766 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66c55e0-4bb1-4f6d-8f4b-d8ffd7eb951a admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:10.883063 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:10.903176 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 851/1704] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:11:10 2022] POST /identity/v3/users => generated 287 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:11:10.904219 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aa488f-dfbd-4f29-8740-315f587f35ed admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:10.918114 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aa488f-dfbd-4f29-8740-315f587f35ed admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:10.923328 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdbda17-7cab-4965-ab4d-df612678bf97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:10.924331 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdbda17-7cab-4965-ab4d-df612678bf97 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:10.924694 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdbda17-7cab-4965-ab4d-df612678bf97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:10.925126 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdbda17-7cab-4965-ab4d-df612678bf97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:10.925886 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdbda17-7cab-4965-ab4d-df612678bf97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:10.929759 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdbda17-7cab-4965-ab4d-df612678bf97 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:10.963868 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66c55e0-4bb1-4f6d-8f4b-d8ffd7eb951a admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:10.971933 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 854/1705] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:11:10.976081 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66c55e0-4bb1-4f6d-8f4b-d8ffd7eb951a admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:10.981393 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f0623a-8a74-40f6-8f6c-d8243f315d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:10.982043 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0623a-8a74-40f6-8f6c-d8243f315d37 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:10.982460 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0623a-8a74-40f6-8f6c-d8243f315d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:10.982746 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0623a-8a74-40f6-8f6c-d8243f315d37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:10.983400 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f0623a-8a74-40f6-8f6c-d8243f315d37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:10.987893 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f0623a-8a74-40f6-8f6c-d8243f315d37 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:11.006557 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 852/1706] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:11:11.011215 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdbda17-7cab-4965-ab4d-df612678bf97 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:11.024689 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdbda17-7cab-4965-ab4d-df612678bf97 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:11.030905 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad27b76d-644d-49af-8501-a739c658b14c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:11.031571 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad27b76d-644d-49af-8501-a739c658b14c admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:11.031854 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad27b76d-644d-49af-8501-a739c658b14c admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:11.032133 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad27b76d-644d-49af-8501-a739c658b14c admin admin] PATH_INFO: `/v3/projects/e85f201ee5264a83a783d1553819de58/users/f7dea86fcfdc41a4ac67bcd6e97e9535/roles/7c3871c0ab68438b9014489d50b53a22` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:11.047820 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad27b76d-644d-49af-8501-a739c658b14c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e85f201ee5264a83a783d1553819de58, user_id=f7dea86fcfdc41a4ac67bcd6e97e9535, role_id=7c3871c0ab68438b9014489d50b53a22)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:11.050583 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad27b76d-644d-49af-8501-a739c658b14c admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:11.067773 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 855/1707] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:11:11 2022] PUT /identity/v3/projects/e85f201ee5264a83a783d1553819de58/users/f7dea86fcfdc41a4ac67bcd6e97e9535/roles/7c3871c0ab68438b9014489d50b53a22 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:11.078967 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41646ff1-e6e2-4c7b-acc3-d8d5b33912a8 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:11.079251 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41646ff1-e6e2-4c7b-acc3-d8d5b33912a8 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:11.079521 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41646ff1-e6e2-4c7b-acc3-d8d5b33912a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:11.106106 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-41646ff1-e6e2-4c7b-acc3-d8d5b33912a8 None None] MFA Rules not processed for user `f7dea86fcfdc41a4ac67bcd6e97e9535`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:11.107305 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-41646ff1-e6e2-4c7b-acc3-d8d5b33912a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:11.170743 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 853/1708] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:11:11.175071 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad27b76d-644d-49af-8501-a739c658b14c admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:11.236726 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad27b76d-644d-49af-8501-a739c658b14c admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:11.241920 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d1beae-cc69-4fae-b8f4-733c0fa47189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:11.242557 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d1beae-cc69-4fae-b8f4-733c0fa47189 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:11.242839 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d1beae-cc69-4fae-b8f4-733c0fa47189 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:11.243168 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d1beae-cc69-4fae-b8f4-733c0fa47189 admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:11.243819 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d1beae-cc69-4fae-b8f4-733c0fa47189 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:11.245753 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d1beae-cc69-4fae-b8f4-733c0fa47189 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:11.278490 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 856/1709] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:11:11 2022] POST /identity/v3/projects => generated 377 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:11:11.283378 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41646ff1-e6e2-4c7b-acc3-d8d5b33912a8 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:11.297155 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41646ff1-e6e2-4c7b-acc3-d8d5b33912a8 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:11.315007 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d1beae-cc69-4fae-b8f4-733c0fa47189 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:11.316798 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-09d1beae-cc69-4fae-b8f4-733c0fa47189 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:11.359237 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e3943d-9ad3-43d6-b86e-382f9ced7e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:11.359872 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3943d-9ad3-43d6-b86e-382f9ced7e98 admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:11.360719 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3943d-9ad3-43d6-b86e-382f9ced7e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:11.360719 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3943d-9ad3-43d6-b86e-382f9ced7e98 admin admin] PATH_INFO: `/v3/users` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:11.361011 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e3943d-9ad3-43d6-b86e-382f9ced7e98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:11.362977 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e3943d-9ad3-43d6-b86e-382f9ced7e98 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:11.392923 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 854/1710] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:11:11 2022] POST /identity/v3/users => generated 295 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 11:11:11.394001 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e3943d-9ad3-43d6-b86e-382f9ced7e98 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:11.405390 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e3943d-9ad3-43d6-b86e-382f9ced7e98 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:11.405559 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d1beae-cc69-4fae-b8f4-733c0fa47189 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:11.410348 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0505099d-a71d-46d7-a3e5-44eccad6bb74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:11.411562 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0505099d-a71d-46d7-a3e5-44eccad6bb74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:11.411842 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0505099d-a71d-46d7-a3e5-44eccad6bb74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:11.412119 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0505099d-a71d-46d7-a3e5-44eccad6bb74 admin admin] PATH_INFO: `/v3/users/59e8f9a157df42beaf2ff0977e187910` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:11.413306 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6243284-a130-476d-891e-54aa1a7d7b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:11.413438 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0505099d-a71d-46d7-a3e5-44eccad6bb74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59e8f9a157df42beaf2ff0977e187910)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:11.414559 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6243284-a130-476d-891e-54aa1a7d7b56 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:11.414979 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6243284-a130-476d-891e-54aa1a7d7b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:11.415439 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0505099d-a71d-46d7-a3e5-44eccad6bb74 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:11.415547 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6243284-a130-476d-891e-54aa1a7d7b56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:11.416515 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6243284-a130-476d-891e-54aa1a7d7b56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:11.419707 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6243284-a130-476d-891e-54aa1a7d7b56 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:11.433018 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 855/1711] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:11:11 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:11:11.437113 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6243284-a130-476d-891e-54aa1a7d7b56 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:11.453966 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:11.458750 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6243284-a130-476d-891e-54aa1a7d7b56 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:11.464008 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eec85a8-4ef0-430f-b80a-efffa6485c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:11.464876 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec85a8-4ef0-430f-b80a-efffa6485c25 admin admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:11.465258 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec85a8-4ef0-430f-b80a-efffa6485c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:11.465538 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec85a8-4ef0-430f-b80a-efffa6485c25 admin admin] PATH_INFO: `/v3/projects/534d496a17fd4f4eb896d6d1b26c36b9/users/d4dd04f91197468d9f187844dbe092b4/roles/ea564961b1db4eb4a1d4d880964611b2` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:11.485484 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eec85a8-4ef0-430f-b80a-efffa6485c25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=534d496a17fd4f4eb896d6d1b26c36b9, user_id=d4dd04f91197468d9f187844dbe092b4, role_id=ea564961b1db4eb4a1d4d880964611b2)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:11.487716 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-0505099d-a71d-46d7-a3e5-44eccad6bb74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59e8f9a157df42beaf2ff0977e187910'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:11.488299 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eec85a8-4ef0-430f-b80a-efffa6485c25 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:11.489522 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-0505099d-a71d-46d7-a3e5-44eccad6bb74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59e8f9a157df42beaf2ff0977e187910'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:11.490421 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-0505099d-a71d-46d7-a3e5-44eccad6bb74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59e8f9a157df42beaf2ff0977e187910'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:11.506833 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-0505099d-a71d-46d7-a3e5-44eccad6bb74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59e8f9a157df42beaf2ff0977e187910'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:11.507167 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 856/1712] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:11:11 2022] PUT /identity/v3/projects/534d496a17fd4f4eb896d6d1b26c36b9/users/d4dd04f91197468d9f187844dbe092b4/roles/ea564961b1db4eb4a1d4d880964611b2 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 11:11:11.511492 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eec85a8-4ef0-430f-b80a-efffa6485c25 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:11.515070 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-4eec85a8-4ef0-430f-b80a-efffa6485c25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:11.524624 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-0505099d-a71d-46d7-a3e5-44eccad6bb74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59e8f9a157df42beaf2ff0977e187910'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:11.539674 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 857/1713] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:11:11 2022] DELETE /identity/v3/users/59e8f9a157df42beaf2ff0977e187910 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 11:11:11.544103 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618aff5d-3c57-4fca-a931-4dd58d4da1d7 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:11.544455 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618aff5d-3c57-4fca-a931-4dd58d4da1d7 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:11.544897 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618aff5d-3c57-4fca-a931-4dd58d4da1d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:11.565528 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:11.567112 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-618aff5d-3c57-4fca-a931-4dd58d4da1d7 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:11.568286 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-618aff5d-3c57-4fca-a931-4dd58d4da1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:11.597591 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eec85a8-4ef0-430f-b80a-efffa6485c25 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:11.639706 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 858/1714] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 11:11:11.654341 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618aff5d-3c57-4fca-a931-4dd58d4da1d7 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:11.656610 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-618aff5d-3c57-4fca-a931-4dd58d4da1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:11.715851 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620b626b-212e-4a7b-87fa-4eebebe94f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:11.716499 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b626b-212e-4a7b-87fa-4eebebe94f50 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:11.716806 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b626b-212e-4a7b-87fa-4eebebe94f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:11.717122 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b626b-212e-4a7b-87fa-4eebebe94f50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:11.719373 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620b626b-212e-4a7b-87fa-4eebebe94f50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:11.721361 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620b626b-212e-4a7b-87fa-4eebebe94f50 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:11.743505 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618aff5d-3c57-4fca-a931-4dd58d4da1d7 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:11.749170 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c2fa81-21ea-400c-bb55-a1cca7f2c2c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:11.750358 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c2fa81-21ea-400c-bb55-a1cca7f2c2c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:11.750358 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c2fa81-21ea-400c-bb55-a1cca7f2c2c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:11.750636 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c2fa81-21ea-400c-bb55-a1cca7f2c2c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:11.762078 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c2fa81-21ea-400c-bb55-a1cca7f2c2c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:11.763281 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c2fa81-21ea-400c-bb55-a1cca7f2c2c4 service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:11.781159 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 859/1716] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:11:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 13 11:11:11.783499 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c2fa81-21ea-400c-bb55-a1cca7f2c2c4 service neutron] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:11.792953 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 857/1715] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:11:11 2022] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:11:11.801179 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c2fa81-21ea-400c-bb55-a1cca7f2c2c4 service neutron] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:11.806636 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e604e61e-067f-4577-a523-704e4b94182e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:11.807406 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e604e61e-067f-4577-a523-704e4b94182e admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:11.807752 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e604e61e-067f-4577-a523-704e4b94182e admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:11.808147 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e604e61e-067f-4577-a523-704e4b94182e admin admin] PATH_INFO: `/v3/projects/534d496a17fd4f4eb896d6d1b26c36b9/users/d4dd04f91197468d9f187844dbe092b4/roles/ea564961b1db4eb4a1d4d880964611b2` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:11.810087 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e604e61e-067f-4577-a523-704e4b94182e admin admin] RBAC: Authorizing `identity:create_grant(project_id=534d496a17fd4f4eb896d6d1b26c36b9, user_id=d4dd04f91197468d9f187844dbe092b4, role_id=ea564961b1db4eb4a1d4d880964611b2)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:11.812802 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e604e61e-067f-4577-a523-704e4b94182e admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:11.832386 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 860/1717] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:11:11 2022] PUT /identity/v3/projects/534d496a17fd4f4eb896d6d1b26c36b9/users/d4dd04f91197468d9f187844dbe092b4/roles/ea564961b1db4eb4a1d4d880964611b2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:11.843957 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307fe09-4d90-4ee7-967f-817c3217aefd None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:11.844488 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307fe09-4d90-4ee7-967f-817c3217aefd None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:11.844868 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307fe09-4d90-4ee7-967f-817c3217aefd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:11.884047 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-4307fe09-4d90-4ee7-967f-817c3217aefd None None] MFA Rules not processed for user `d4dd04f91197468d9f187844dbe092b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:11.884047 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-4307fe09-4d90-4ee7-967f-817c3217aefd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:11.955030 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 858/1718] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:11 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:11:11.968766 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e604e61e-067f-4577-a523-704e4b94182e admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:11.970557 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-e604e61e-067f-4577-a523-704e4b94182e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:12.015888 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:12.046859 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e604e61e-067f-4577-a523-704e4b94182e admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:12.051380 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6910d4-1aee-45a3-840f-3dadd761961d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f4c2fc51f54f0e977648b13efaed1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:12.052009 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6910d4-1aee-45a3-840f-3dadd761961d service cinder] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:12.052447 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6910d4-1aee-45a3-840f-3dadd761961d service cinder] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:12.052732 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6910d4-1aee-45a3-840f-3dadd761961d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:12.055416 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-9e6910d4-1aee-45a3-840f-3dadd761961d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:12.181261 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6910d4-1aee-45a3-840f-3dadd761961d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:12.183126 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6910d4-1aee-45a3-840f-3dadd761961d service cinder] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:12.219911 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 861/1719] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:11:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:11:12.303529 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4307fe09-4d90-4ee7-967f-817c3217aefd None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:12.305899 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-4307fe09-4d90-4ee7-967f-817c3217aefd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:12.459437 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4307fe09-4d90-4ee7-967f-817c3217aefd None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:12.475835 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a5e83b-0bad-45d9-93e7-e2d8db06bd52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:12.476543 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a5e83b-0bad-45d9-93e7-e2d8db06bd52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:12.476819 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a5e83b-0bad-45d9-93e7-e2d8db06bd52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:12.477087 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a5e83b-0bad-45d9-93e7-e2d8db06bd52 admin admin] PATH_INFO: `/v3/projects/a15c4bba19e84537aea4e50d73af97cc` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:12.478354 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a5e83b-0bad-45d9-93e7-e2d8db06bd52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a15c4bba19e84537aea4e50d73af97cc)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:12.480303 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a5e83b-0bad-45d9-93e7-e2d8db06bd52 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:12.484502 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:12.585359 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-00a5e83b-0bad-45d9-93e7-e2d8db06bd52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a15c4bba19e84537aea4e50d73af97cc', 'request_id': 'req-00a5e83b-0bad-45d9-93e7-e2d8db06bd52'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:12.598872 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-00a5e83b-0bad-45d9-93e7-e2d8db06bd52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a15c4bba19e84537aea4e50d73af97cc', 'request_id': 'req-00a5e83b-0bad-45d9-93e7-e2d8db06bd52'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:12.625349 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-00a5e83b-0bad-45d9-93e7-e2d8db06bd52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a15c4bba19e84537aea4e50d73af97cc', 'request_id': 'req-00a5e83b-0bad-45d9-93e7-e2d8db06bd52'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:12.644065 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-00a5e83b-0bad-45d9-93e7-e2d8db06bd52 admin admin] The token cache is being invalidate because project a15c4bba19e84537aea4e50d73af97cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:11:12.644357 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-00a5e83b-0bad-45d9-93e7-e2d8db06bd52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:12.645438 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-00a5e83b-0bad-45d9-93e7-e2d8db06bd52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:12.651962 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 859/1720] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:11:12 2022] DELETE /identity/v3/projects/a15c4bba19e84537aea4e50d73af97cc => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:12.656520 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6910d4-1aee-45a3-840f-3dadd761961d service cinder] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:12.670429 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6910d4-1aee-45a3-840f-3dadd761961d service cinder] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:12.814206 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e01ec3-da5b-454a-9837-36b57aa2931d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:12.820084 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e01ec3-da5b-454a-9837-36b57aa2931d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:12.822276 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e01ec3-da5b-454a-9837-36b57aa2931d admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:12.823266 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e01ec3-da5b-454a-9837-36b57aa2931d admin admin] PATH_INFO: `/v3/users/54fbb4fe7c5e446ca84c3ed5078ba873` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:12.826857 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e01ec3-da5b-454a-9837-36b57aa2931d admin admin] RBAC: Authorizing `identity:delete_user(user_id=54fbb4fe7c5e446ca84c3ed5078ba873)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:12.829165 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e01ec3-da5b-454a-9837-36b57aa2931d admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:12.924306 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-d6e01ec3-da5b-454a-9837-36b57aa2931d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54fbb4fe7c5e446ca84c3ed5078ba873'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:12.926134 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-d6e01ec3-da5b-454a-9837-36b57aa2931d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54fbb4fe7c5e446ca84c3ed5078ba873'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:12.927263 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-d6e01ec3-da5b-454a-9837-36b57aa2931d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54fbb4fe7c5e446ca84c3ed5078ba873'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:12.944940 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-d6e01ec3-da5b-454a-9837-36b57aa2931d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54fbb4fe7c5e446ca84c3ed5078ba873'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:12.962613 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-d6e01ec3-da5b-454a-9837-36b57aa2931d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54fbb4fe7c5e446ca84c3ed5078ba873'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:12.983219 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 862/1721] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:11:12 2022] DELETE /identity/v3/users/54fbb4fe7c5e446ca84c3ed5078ba873 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:13.290212 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a5e83b-0bad-45d9-93e7-e2d8db06bd52 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:13.291744 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-00a5e83b-0bad-45d9-93e7-e2d8db06bd52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:13.306877 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a5e83b-0bad-45d9-93e7-e2d8db06bd52 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:13.367242 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1e7c7f-5428-4d2d-9df0-efb849504241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:13.367878 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e7c7f-5428-4d2d-9df0-efb849504241 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:13.368152 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e7c7f-5428-4d2d-9df0-efb849504241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:13.368417 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e7c7f-5428-4d2d-9df0-efb849504241 admin admin] PATH_INFO: `/v3/projects/fb05757729cf4225b40febea70ae6200` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:13.369553 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1e7c7f-5428-4d2d-9df0-efb849504241 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb05757729cf4225b40febea70ae6200)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:13.371796 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1e7c7f-5428-4d2d-9df0-efb849504241 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:13.425687 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-ea1e7c7f-5428-4d2d-9df0-efb849504241 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb05757729cf4225b40febea70ae6200', 'request_id': 'req-ea1e7c7f-5428-4d2d-9df0-efb849504241'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:13.432383 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-ea1e7c7f-5428-4d2d-9df0-efb849504241 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb05757729cf4225b40febea70ae6200', 'request_id': 'req-ea1e7c7f-5428-4d2d-9df0-efb849504241'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:13.439725 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-ea1e7c7f-5428-4d2d-9df0-efb849504241 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb05757729cf4225b40febea70ae6200', 'request_id': 'req-ea1e7c7f-5428-4d2d-9df0-efb849504241'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:13.453140 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-ea1e7c7f-5428-4d2d-9df0-efb849504241 admin admin] The token cache is being invalidate because project fb05757729cf4225b40febea70ae6200 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:11:13.453445 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-ea1e7c7f-5428-4d2d-9df0-efb849504241 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:13.454086 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-ea1e7c7f-5428-4d2d-9df0-efb849504241 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:13.455852 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 860/1722] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:11:13 2022] DELETE /identity/v3/projects/fb05757729cf4225b40febea70ae6200 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:13.461320 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc3404-1270-4106-83a8-b1e13a4d0a90 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:13.461821 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc3404-1270-4106-83a8-b1e13a4d0a90 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:13.461928 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc3404-1270-4106-83a8-b1e13a4d0a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:13.483906 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-d3bc3404-1270-4106-83a8-b1e13a4d0a90 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:13.485087 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-d3bc3404-1270-4106-83a8-b1e13a4d0a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:13.490512 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:13.563466 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 863/1723] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 11:11:13.572013 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0be838-72eb-4ac4-8a66-0d0f5e9706a6 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:13.572487 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0be838-72eb-4ac4-8a66-0d0f5e9706a6 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:13.572602 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0be838-72eb-4ac4-8a66-0d0f5e9706a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:13.596196 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-1e0be838-72eb-4ac4-8a66-0d0f5e9706a6 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:13.597409 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-1e0be838-72eb-4ac4-8a66-0d0f5e9706a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:13.607935 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 861/1724] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:11:13.612332 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc3404-1270-4106-83a8-b1e13a4d0a90 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:13.624277 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc3404-1270-4106-83a8-b1e13a4d0a90 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:13.639718 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d672b6-8e08-4bd2-92a4-e9bc66463dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:13.640359 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d672b6-8e08-4bd2-92a4-e9bc66463dd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:13.640640 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d672b6-8e08-4bd2-92a4-e9bc66463dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:13.640914 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d672b6-8e08-4bd2-92a4-e9bc66463dd2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:13.641609 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d672b6-8e08-4bd2-92a4-e9bc66463dd2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:11:13.641915 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d672b6-8e08-4bd2-92a4-e9bc66463dd2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:13.643606 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d672b6-8e08-4bd2-92a4-e9bc66463dd2 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:13.656025 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 864/1725] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 11:11:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 11:11:13.660341 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0be838-72eb-4ac4-8a66-0d0f5e9706a6 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:13.670201 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0be838-72eb-4ac4-8a66-0d0f5e9706a6 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:13.674897 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67acd691-40a6-40f1-b654-45d0437f7895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:13.675498 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67acd691-40a6-40f1-b654-45d0437f7895 admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:13.675779 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67acd691-40a6-40f1-b654-45d0437f7895 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:13.676052 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67acd691-40a6-40f1-b654-45d0437f7895 admin admin] PATH_INFO: `/v3/projects` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:13.677295 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67acd691-40a6-40f1-b654-45d0437f7895 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:13.679213 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67acd691-40a6-40f1-b654-45d0437f7895 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:13.690609 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:13.715237 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 862/1726] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:11:13 2022] POST /identity/v3/projects => generated 379 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 11:11:13.719232 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d672b6-8e08-4bd2-92a4-e9bc66463dd2 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:13.729882 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d672b6-8e08-4bd2-92a4-e9bc66463dd2 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:13.793602 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e28e18-dd01-4601-b12b-76bc876271ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:13.794254 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e28e18-dd01-4601-b12b-76bc876271ca admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:13.794532 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e28e18-dd01-4601-b12b-76bc876271ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:13.794802 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e28e18-dd01-4601-b12b-76bc876271ca admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:13.795442 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e28e18-dd01-4601-b12b-76bc876271ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:13.797706 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e28e18-dd01-4601-b12b-76bc876271ca admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:13.870125 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 865/1727] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:11:13 2022] POST /identity/v3/users => generated 290 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 11:11:13.870741 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67acd691-40a6-40f1-b654-45d0437f7895 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:13.897552 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67acd691-40a6-40f1-b654-45d0437f7895 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:13.905251 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e28e18-dd01-4601-b12b-76bc876271ca admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:13.905642 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97495e7f-d31c-4a7e-a9bd-f3b577d51996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:13.906299 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97495e7f-d31c-4a7e-a9bd-f3b577d51996 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:13.906746 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97495e7f-d31c-4a7e-a9bd-f3b577d51996 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:13.907022 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97495e7f-d31c-4a7e-a9bd-f3b577d51996 admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:13.907584 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-60e28e18-dd01-4601-b12b-76bc876271ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:13.907710 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97495e7f-d31c-4a7e-a9bd-f3b577d51996 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:13.909261 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97495e7f-d31c-4a7e-a9bd-f3b577d51996 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:13.920963 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 863/1728] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:11:13 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:11:13.924902 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97495e7f-d31c-4a7e-a9bd-f3b577d51996 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:13.927807 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e28e18-dd01-4601-b12b-76bc876271ca admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:13.933314 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104b330f-6452-4f0c-b94d-fcd34584c534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:13.934141 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104b330f-6452-4f0c-b94d-fcd34584c534 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:13.934529 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104b330f-6452-4f0c-b94d-fcd34584c534 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:13.935097 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104b330f-6452-4f0c-b94d-fcd34584c534 admin admin] PATH_INFO: `/v3/users/4b52958b164d4d108460518c5367e199` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:13.937312 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104b330f-6452-4f0c-b94d-fcd34584c534 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b52958b164d4d108460518c5367e199)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:13.940313 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104b330f-6452-4f0c-b94d-fcd34584c534 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:13.947178 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97495e7f-d31c-4a7e-a9bd-f3b577d51996 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:13.962517 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81c3359-fba8-42e1-8554-6ae59a48c12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:13.963146 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c3359-fba8-42e1-8554-6ae59a48c12d admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:13.963432 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c3359-fba8-42e1-8554-6ae59a48c12d admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:13.963710 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c3359-fba8-42e1-8554-6ae59a48c12d admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:13.964378 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81c3359-fba8-42e1-8554-6ae59a48c12d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:13.965996 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81c3359-fba8-42e1-8554-6ae59a48c12d admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:13.983617 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 864/1729] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:11:13 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:11:13.988348 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81c3359-fba8-42e1-8554-6ae59a48c12d admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:14.018613 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-104b330f-6452-4f0c-b94d-fcd34584c534 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b52958b164d4d108460518c5367e199'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:14.020950 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-104b330f-6452-4f0c-b94d-fcd34584c534 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b52958b164d4d108460518c5367e199'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:14.021810 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-104b330f-6452-4f0c-b94d-fcd34584c534 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b52958b164d4d108460518c5367e199'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:14.026510 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81c3359-fba8-42e1-8554-6ae59a48c12d admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:14.040683 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d51233-593f-4714-a543-84afd689873f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:14.041392 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d51233-593f-4714-a543-84afd689873f admin admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:14.041748 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d51233-593f-4714-a543-84afd689873f admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:14.042163 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d51233-593f-4714-a543-84afd689873f admin admin] PATH_INFO: `/v3/projects/d38a919ac66b4a95af47c2dac611980b/users/1e6538d23c0e46729f30a0c33fd820a2/roles/7c3871c0ab68438b9014489d50b53a22` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:14.050527 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-104b330f-6452-4f0c-b94d-fcd34584c534 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b52958b164d4d108460518c5367e199'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:14.065984 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-104b330f-6452-4f0c-b94d-fcd34584c534 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b52958b164d4d108460518c5367e199'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:14.070502 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d51233-593f-4714-a543-84afd689873f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d38a919ac66b4a95af47c2dac611980b, user_id=1e6538d23c0e46729f30a0c33fd820a2, role_id=7c3871c0ab68438b9014489d50b53a22)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:14.073340 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d51233-593f-4714-a543-84afd689873f admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:14.088772 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:14.106129 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 865/1730] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:11:13 2022] PUT /identity/v3/projects/d38a919ac66b4a95af47c2dac611980b/users/1e6538d23c0e46729f30a0c33fd820a2/roles/7c3871c0ab68438b9014489d50b53a22 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:14.106342 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 866/1731] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:11:13 2022] DELETE /identity/v3/users/4b52958b164d4d108460518c5367e199 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 11:11:14.106428 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c00a55-f758-4ead-bf2e-9bc526d05edf None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:14.106501 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c00a55-f758-4ead-bf2e-9bc526d05edf None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:14.106735 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c00a55-f758-4ead-bf2e-9bc526d05edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:14.111461 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcdc707-2241-4771-a3ec-1b80e4d2f1d9 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:14.111751 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcdc707-2241-4771-a3ec-1b80e4d2f1d9 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:14.112028 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcdc707-2241-4771-a3ec-1b80e4d2f1d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:14.155834 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-efcdc707-2241-4771-a3ec-1b80e4d2f1d9 None None] MFA Rules not processed for user `1e6538d23c0e46729f30a0c33fd820a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:14.157313 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-efcdc707-2241-4771-a3ec-1b80e4d2f1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:14.167540 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-a6c00a55-f758-4ead-bf2e-9bc526d05edf None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:14.168765 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-a6c00a55-f758-4ead-bf2e-9bc526d05edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:14.271691 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 867/1732] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:11:14.272731 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcdc707-2241-4771-a3ec-1b80e4d2f1d9 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:14.274845 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-efcdc707-2241-4771-a3ec-1b80e4d2f1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:14.283169 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 866/1733] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:11:14.291340 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c00a55-f758-4ead-bf2e-9bc526d05edf None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:14.298278 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-a6c00a55-f758-4ead-bf2e-9bc526d05edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:14.310124 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcdc707-2241-4771-a3ec-1b80e4d2f1d9 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:14.340125 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935b5834-6a94-4785-80fd-651e0162fbf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:14.344320 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b5834-6a94-4785-80fd-651e0162fbf2 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:14.346068 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b5834-6a94-4785-80fd-651e0162fbf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:14.346625 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b5834-6a94-4785-80fd-651e0162fbf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:14.349533 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935b5834-6a94-4785-80fd-651e0162fbf2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:14.353172 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935b5834-6a94-4785-80fd-651e0162fbf2 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:14.420253 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 868/1734] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:11:14 2022] POST /identity/v3/projects => generated 381 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:11:14.424991 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935b5834-6a94-4785-80fd-651e0162fbf2 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:14.484852 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c00a55-f758-4ead-bf2e-9bc526d05edf None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:14.537831 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935b5834-6a94-4785-80fd-651e0162fbf2 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:14.546386 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ede9f-62e3-40f6-bbbe-19687145e7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:14.547842 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ede9f-62e3-40f6-bbbe-19687145e7ab admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:14.548132 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ede9f-62e3-40f6-bbbe-19687145e7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:14.548413 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ede9f-62e3-40f6-bbbe-19687145e7ab admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:14.549131 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0ede9f-62e3-40f6-bbbe-19687145e7ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:14.551169 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0ede9f-62e3-40f6-bbbe-19687145e7ab admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:14.570805 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f97a2-1abb-4e52-87fa-ce2e2fa80da6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:14.571445 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f97a2-1abb-4e52-87fa-ce2e2fa80da6 service neutron] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:14.571727 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f97a2-1abb-4e52-87fa-ce2e2fa80da6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:14.572330 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f97a2-1abb-4e52-87fa-ce2e2fa80da6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:14.584309 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 869/1735] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:11:14 2022] POST /identity/v3/users => generated 297 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 11:11:14.586319 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ede9f-62e3-40f6-bbbe-19687145e7ab admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:14.601322 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206f97a2-1abb-4e52-87fa-ce2e2fa80da6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:14.603367 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206f97a2-1abb-4e52-87fa-ce2e2fa80da6 service neutron] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:14.606903 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ede9f-62e3-40f6-bbbe-19687145e7ab admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:14.612564 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d515457-2838-44fb-81d2-ac4543dddbbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:14.613383 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d515457-2838-44fb-81d2-ac4543dddbbf admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:14.613660 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d515457-2838-44fb-81d2-ac4543dddbbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:14.614002 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d515457-2838-44fb-81d2-ac4543dddbbf admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:14.614667 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d515457-2838-44fb-81d2-ac4543dddbbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:14.616682 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d515457-2838-44fb-81d2-ac4543dddbbf admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:14.619755 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 867/1736] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:11:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 13 11:11:14.638837 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 870/1737] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:11:14 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:11:14.640325 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f97a2-1abb-4e52-87fa-ce2e2fa80da6 service neutron] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:14.649377 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:14.655861 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f97a2-1abb-4e52-87fa-ce2e2fa80da6 service neutron] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:14.665494 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd8d9e-fa69-4ebd-942e-8ec5e1a3173e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:14.666589 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd8d9e-fa69-4ebd-942e-8ec5e1a3173e admin admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:14.667203 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd8d9e-fa69-4ebd-942e-8ec5e1a3173e admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:14.667583 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd8d9e-fa69-4ebd-942e-8ec5e1a3173e admin admin] PATH_INFO: `/v3/projects/0d96046d5c6046d89bbfedb284c2704e/users/67c5ea1d65d64782bd232b23c929ba2a/roles/ea564961b1db4eb4a1d4d880964611b2` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:14.688413 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdd8d9e-fa69-4ebd-942e-8ec5e1a3173e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d96046d5c6046d89bbfedb284c2704e, user_id=67c5ea1d65d64782bd232b23c929ba2a, role_id=ea564961b1db4eb4a1d4d880964611b2)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:14.691185 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdd8d9e-fa69-4ebd-942e-8ec5e1a3173e admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:14.722776 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 868/1738] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:11:14 2022] PUT /identity/v3/projects/0d96046d5c6046d89bbfedb284c2704e/users/67c5ea1d65d64782bd232b23c929ba2a/roles/ea564961b1db4eb4a1d4d880964611b2 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:14.726926 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d515457-2838-44fb-81d2-ac4543dddbbf admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:14.742691 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d515457-2838-44fb-81d2-ac4543dddbbf admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:14.814413 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:14.850635 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147d6089-1f9f-4877-922b-7839cba5db5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:14.851264 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147d6089-1f9f-4877-922b-7839cba5db5b admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:14.851542 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147d6089-1f9f-4877-922b-7839cba5db5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:14.851867 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147d6089-1f9f-4877-922b-7839cba5db5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:14.852618 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147d6089-1f9f-4877-922b-7839cba5db5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:14.854754 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147d6089-1f9f-4877-922b-7839cba5db5b admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:14.870229 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 871/1739] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:11:14 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:11:14.873418 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd8d9e-fa69-4ebd-942e-8ec5e1a3173e admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:14.885882 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd8d9e-fa69-4ebd-942e-8ec5e1a3173e admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:14.891977 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac985e2f-d782-479e-a545-5582d94a7d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:14.892670 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac985e2f-d782-479e-a545-5582d94a7d75 admin admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:14.892954 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac985e2f-d782-479e-a545-5582d94a7d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:14.895914 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac985e2f-d782-479e-a545-5582d94a7d75 admin admin] PATH_INFO: `/v3/projects/0d96046d5c6046d89bbfedb284c2704e/users/67c5ea1d65d64782bd232b23c929ba2a/roles/ea564961b1db4eb4a1d4d880964611b2` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:14.899108 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac985e2f-d782-479e-a545-5582d94a7d75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d96046d5c6046d89bbfedb284c2704e, user_id=67c5ea1d65d64782bd232b23c929ba2a, role_id=ea564961b1db4eb4a1d4d880964611b2)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:14.904387 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac985e2f-d782-479e-a545-5582d94a7d75 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:14.933114 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 869/1740] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:11:14 2022] PUT /identity/v3/projects/0d96046d5c6046d89bbfedb284c2704e/users/67c5ea1d65d64782bd232b23c929ba2a/roles/ea564961b1db4eb4a1d4d880964611b2 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:14.943997 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac5bcd-5788-41af-838e-48064c80d828 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:14.944277 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac5bcd-5788-41af-838e-48064c80d828 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:14.944552 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac5bcd-5788-41af-838e-48064c80d828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:14.990660 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-ecac5bcd-5788-41af-838e-48064c80d828 None None] MFA Rules not processed for user `67c5ea1d65d64782bd232b23c929ba2a`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:14.991775 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-ecac5bcd-5788-41af-838e-48064c80d828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:15.087161 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 872/1741] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:14 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:11:15.095513 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac985e2f-d782-479e-a545-5582d94a7d75 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:15.097590 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-ac985e2f-d782-479e-a545-5582d94a7d75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:15.191153 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac985e2f-d782-479e-a545-5582d94a7d75 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:15.196505 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e172c1-4a94-4f70-84fa-4ac46a9c4510 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f4c2fc51f54f0e977648b13efaed1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:15.197103 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e172c1-4a94-4f70-84fa-4ac46a9c4510 service cinder] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:15.197475 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e172c1-4a94-4f70-84fa-4ac46a9c4510 service cinder] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:15.197841 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e172c1-4a94-4f70-84fa-4ac46a9c4510 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:15.207692 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e172c1-4a94-4f70-84fa-4ac46a9c4510 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:15.209355 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e172c1-4a94-4f70-84fa-4ac46a9c4510 service cinder] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:15.220509 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 870/1742] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:11:15 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:11:15.322859 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac5bcd-5788-41af-838e-48064c80d828 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:15.333888 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-ecac5bcd-5788-41af-838e-48064c80d828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:15.467131 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac5bcd-5788-41af-838e-48064c80d828 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:15.478755 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604e1a81-4917-43d7-a8aa-c006ba94abac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:15.479755 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e1a81-4917-43d7-a8aa-c006ba94abac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:15.480264 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e1a81-4917-43d7-a8aa-c006ba94abac admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:15.480762 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e1a81-4917-43d7-a8aa-c006ba94abac admin admin] PATH_INFO: `/v3/projects/68c57a439db940d28aa3d17c8977f42f` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:15.483618 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604e1a81-4917-43d7-a8aa-c006ba94abac admin admin] RBAC: Authorizing `identity:delete_project(project_id=68c57a439db940d28aa3d17c8977f42f)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:15.486251 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604e1a81-4917-43d7-a8aa-c006ba94abac admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:15.530124 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e172c1-4a94-4f70-84fa-4ac46a9c4510 service cinder] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:15.541370 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e172c1-4a94-4f70-84fa-4ac46a9c4510 service cinder] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:15.552315 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397edec5-0085-41b6-b035-84f27813ee86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f4c2fc51f54f0e977648b13efaed1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:15.552942 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397edec5-0085-41b6-b035-84f27813ee86 service cinder] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:15.553227 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397edec5-0085-41b6-b035-84f27813ee86 service cinder] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:15.553504 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397edec5-0085-41b6-b035-84f27813ee86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:15.558265 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-397edec5-0085-41b6-b035-84f27813ee86 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:15.618312 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-604e1a81-4917-43d7-a8aa-c006ba94abac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68c57a439db940d28aa3d17c8977f42f', 'request_id': 'req-604e1a81-4917-43d7-a8aa-c006ba94abac'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:15.635092 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-604e1a81-4917-43d7-a8aa-c006ba94abac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68c57a439db940d28aa3d17c8977f42f', 'request_id': 'req-604e1a81-4917-43d7-a8aa-c006ba94abac'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:15.654446 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-604e1a81-4917-43d7-a8aa-c006ba94abac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68c57a439db940d28aa3d17c8977f42f', 'request_id': 'req-604e1a81-4917-43d7-a8aa-c006ba94abac'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:15.659957 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:15.672411 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-604e1a81-4917-43d7-a8aa-c006ba94abac admin admin] The token cache is being invalidate because project 68c57a439db940d28aa3d17c8977f42f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:11:15.672862 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-604e1a81-4917-43d7-a8aa-c006ba94abac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:15.674246 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-604e1a81-4917-43d7-a8aa-c006ba94abac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:15.677470 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 873/1743] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:11:15 2022] DELETE /identity/v3/projects/68c57a439db940d28aa3d17c8977f42f => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:15.681365 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604e1a81-4917-43d7-a8aa-c006ba94abac admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:15.683882 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-604e1a81-4917-43d7-a8aa-c006ba94abac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:15.693821 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397edec5-0085-41b6-b035-84f27813ee86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:15.694801 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397edec5-0085-41b6-b035-84f27813ee86 service cinder] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:15.712833 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 871/1744] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:11:15 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 13 11:11:15.775897 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397edec5-0085-41b6-b035-84f27813ee86 service cinder] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:15.788250 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397edec5-0085-41b6-b035-84f27813ee86 service cinder] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:15.793987 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604e1a81-4917-43d7-a8aa-c006ba94abac admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:15.800449 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6ef8b-e705-4aef-82dc-bdaac87b5952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:15.801653 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6ef8b-e705-4aef-82dc-bdaac87b5952 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:15.801653 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6ef8b-e705-4aef-82dc-bdaac87b5952 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:15.801933 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6ef8b-e705-4aef-82dc-bdaac87b5952 admin admin] PATH_INFO: `/v3/users/e22a49486c13418e97ad1358850f8568` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:15.803352 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d6ef8b-e705-4aef-82dc-bdaac87b5952 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e22a49486c13418e97ad1358850f8568)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:15.805288 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d6ef8b-e705-4aef-82dc-bdaac87b5952 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:15.866171 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086e042c-2c82-4f42-89b4-4914164efb53 tempest-VolumeQuotaClassesTest-1713546025 tempest-VolumeQuotaClassesTest-1713546025-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c5ea1d65d64782bd232b23c929ba2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d96046d5c6046d89bbfedb284c2704e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:15.867160 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e042c-2c82-4f42-89b4-4914164efb53 tempest-VolumeQuotaClassesTest-1713546025 tempest-VolumeQuotaClassesTest-1713546025-project-admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:15.867587 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e042c-2c82-4f42-89b4-4914164efb53 tempest-VolumeQuotaClassesTest-1713546025 tempest-VolumeQuotaClassesTest-1713546025-project-admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:15.868114 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e042c-2c82-4f42-89b4-4914164efb53 tempest-VolumeQuotaClassesTest-1713546025 tempest-VolumeQuotaClassesTest-1713546025-project-admin] PATH_INFO: `/v3/domains` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:15.869074 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086e042c-2c82-4f42-89b4-4914164efb53 tempest-VolumeQuotaClassesTest-1713546025 tempest-VolumeQuotaClassesTest-1713546025-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:11:15.869672 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086e042c-2c82-4f42-89b4-4914164efb53 tempest-VolumeQuotaClassesTest-1713546025 tempest-VolumeQuotaClassesTest-1713546025-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:15.871964 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086e042c-2c82-4f42-89b4-4914164efb53 tempest-VolumeQuotaClassesTest-1713546025 tempest-VolumeQuotaClassesTest-1713546025-project-admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:15.892578 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-b0d6ef8b-e705-4aef-82dc-bdaac87b5952 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e22a49486c13418e97ad1358850f8568'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:15.896987 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-b0d6ef8b-e705-4aef-82dc-bdaac87b5952 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e22a49486c13418e97ad1358850f8568'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:15.900393 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-b0d6ef8b-e705-4aef-82dc-bdaac87b5952 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e22a49486c13418e97ad1358850f8568'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:15.901113 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:15.907460 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 872/1745] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 11:11:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:11:15.912748 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086e042c-2c82-4f42-89b4-4914164efb53 tempest-VolumeQuotaClassesTest-1713546025 tempest-VolumeQuotaClassesTest-1713546025-project-admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:15.915164 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-086e042c-2c82-4f42-89b4-4914164efb53 tempest-VolumeQuotaClassesTest-1713546025 tempest-VolumeQuotaClassesTest-1713546025-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:15.923056 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-b0d6ef8b-e705-4aef-82dc-bdaac87b5952 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e22a49486c13418e97ad1358850f8568'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:15.933389 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-b0d6ef8b-e705-4aef-82dc-bdaac87b5952 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e22a49486c13418e97ad1358850f8568'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:15.934927 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086e042c-2c82-4f42-89b4-4914164efb53 tempest-VolumeQuotaClassesTest-1713546025 tempest-VolumeQuotaClassesTest-1713546025-project-admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:15.939884 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d55e3-9986-4740-9ce7-0acb1354049b tempest-VolumeQuotaClassesTest-1713546025 tempest-VolumeQuotaClassesTest-1713546025-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c5ea1d65d64782bd232b23c929ba2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d96046d5c6046d89bbfedb284c2704e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:15.940691 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d55e3-9986-4740-9ce7-0acb1354049b tempest-VolumeQuotaClassesTest-1713546025 tempest-VolumeQuotaClassesTest-1713546025-project-admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:15.941004 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d55e3-9986-4740-9ce7-0acb1354049b tempest-VolumeQuotaClassesTest-1713546025 tempest-VolumeQuotaClassesTest-1713546025-project-admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:15.941555 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d55e3-9986-4740-9ce7-0acb1354049b tempest-VolumeQuotaClassesTest-1713546025 tempest-VolumeQuotaClassesTest-1713546025-project-admin] PATH_INFO: `/v3/projects` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:15.943074 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467d55e3-9986-4740-9ce7-0acb1354049b tempest-VolumeQuotaClassesTest-1713546025 tempest-VolumeQuotaClassesTest-1713546025-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:15.945147 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467d55e3-9986-4740-9ce7-0acb1354049b tempest-VolumeQuotaClassesTest-1713546025 tempest-VolumeQuotaClassesTest-1713546025-project-admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:15.949252 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 874/1746] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:11:15 2022] DELETE /identity/v3/users/e22a49486c13418e97ad1358850f8568 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:16.011211 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 873/1747] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:11:15 2022] POST /identity/v3/projects => generated 354 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 11:11:16.012783 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6ef8b-e705-4aef-82dc-bdaac87b5952 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:16.169150 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6ef8b-e705-4aef-82dc-bdaac87b5952 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:16.204590 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:16.280085 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93801657-42ba-4203-9f6f-19f003d69503 tempest-VolumeQuotaClassesTest-1713546025 tempest-VolumeQuotaClassesTest-1713546025-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c5ea1d65d64782bd232b23c929ba2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d96046d5c6046d89bbfedb284c2704e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:16.280724 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93801657-42ba-4203-9f6f-19f003d69503 tempest-VolumeQuotaClassesTest-1713546025 tempest-VolumeQuotaClassesTest-1713546025-project-admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:16.281011 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93801657-42ba-4203-9f6f-19f003d69503 tempest-VolumeQuotaClassesTest-1713546025 tempest-VolumeQuotaClassesTest-1713546025-project-admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:16.281291 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93801657-42ba-4203-9f6f-19f003d69503 tempest-VolumeQuotaClassesTest-1713546025 tempest-VolumeQuotaClassesTest-1713546025-project-admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:16.282123 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93801657-42ba-4203-9f6f-19f003d69503 tempest-VolumeQuotaClassesTest-1713546025 tempest-VolumeQuotaClassesTest-1713546025-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:11:16.283179 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93801657-42ba-4203-9f6f-19f003d69503 tempest-VolumeQuotaClassesTest-1713546025 tempest-VolumeQuotaClassesTest-1713546025-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:16.286340 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93801657-42ba-4203-9f6f-19f003d69503 tempest-VolumeQuotaClassesTest-1713546025 tempest-VolumeQuotaClassesTest-1713546025-project-admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:16.303006 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 875/1748] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 11:11:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:11:16.357814 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d55e3-9986-4740-9ce7-0acb1354049b tempest-VolumeQuotaClassesTest-1713546025 tempest-VolumeQuotaClassesTest-1713546025-project-admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:16.375794 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d55e3-9986-4740-9ce7-0acb1354049b tempest-VolumeQuotaClassesTest-1713546025 tempest-VolumeQuotaClassesTest-1713546025-project-admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:16.378908 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93801657-42ba-4203-9f6f-19f003d69503 tempest-VolumeQuotaClassesTest-1713546025 tempest-VolumeQuotaClassesTest-1713546025-project-admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:16.381550 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-93801657-42ba-4203-9f6f-19f003d69503 tempest-VolumeQuotaClassesTest-1713546025 tempest-VolumeQuotaClassesTest-1713546025-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:16.382974 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb66ad-293b-489b-8b86-bc51c353e0ce tempest-VolumeQuotaClassesTest-1713546025 tempest-VolumeQuotaClassesTest-1713546025-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c5ea1d65d64782bd232b23c929ba2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d96046d5c6046d89bbfedb284c2704e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:16.383675 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb66ad-293b-489b-8b86-bc51c353e0ce tempest-VolumeQuotaClassesTest-1713546025 tempest-VolumeQuotaClassesTest-1713546025-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:16.384122 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb66ad-293b-489b-8b86-bc51c353e0ce tempest-VolumeQuotaClassesTest-1713546025 tempest-VolumeQuotaClassesTest-1713546025-project-admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:16.384840 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb66ad-293b-489b-8b86-bc51c353e0ce tempest-VolumeQuotaClassesTest-1713546025 tempest-VolumeQuotaClassesTest-1713546025-project-admin] PATH_INFO: `/v3/projects/23dfe1edf939482898e67ad4fdfc8f01` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:16.387456 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeb66ad-293b-489b-8b86-bc51c353e0ce tempest-VolumeQuotaClassesTest-1713546025 tempest-VolumeQuotaClassesTest-1713546025-project-admin] RBAC: Authorizing `identity:delete_project(project_id=23dfe1edf939482898e67ad4fdfc8f01)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:16.392250 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeb66ad-293b-489b-8b86-bc51c353e0ce tempest-VolumeQuotaClassesTest-1713546025 tempest-VolumeQuotaClassesTest-1713546025-project-admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:16.462722 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-cfeb66ad-293b-489b-8b86-bc51c353e0ce tempest-VolumeQuotaClassesTest-1713546025 tempest-VolumeQuotaClassesTest-1713546025-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23dfe1edf939482898e67ad4fdfc8f01', 'request_id': 'req-cfeb66ad-293b-489b-8b86-bc51c353e0ce'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:16.472721 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-cfeb66ad-293b-489b-8b86-bc51c353e0ce tempest-VolumeQuotaClassesTest-1713546025 tempest-VolumeQuotaClassesTest-1713546025-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23dfe1edf939482898e67ad4fdfc8f01', 'request_id': 'req-cfeb66ad-293b-489b-8b86-bc51c353e0ce'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:16.480420 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-cfeb66ad-293b-489b-8b86-bc51c353e0ce tempest-VolumeQuotaClassesTest-1713546025 tempest-VolumeQuotaClassesTest-1713546025-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23dfe1edf939482898e67ad4fdfc8f01', 'request_id': 'req-cfeb66ad-293b-489b-8b86-bc51c353e0ce'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:16.497023 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-cfeb66ad-293b-489b-8b86-bc51c353e0ce tempest-VolumeQuotaClassesTest-1713546025 tempest-VolumeQuotaClassesTest-1713546025-project-admin] The token cache is being invalidate because project 23dfe1edf939482898e67ad4fdfc8f01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:11:16.497597 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-cfeb66ad-293b-489b-8b86-bc51c353e0ce tempest-VolumeQuotaClassesTest-1713546025 tempest-VolumeQuotaClassesTest-1713546025-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:16.498911 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-cfeb66ad-293b-489b-8b86-bc51c353e0ce tempest-VolumeQuotaClassesTest-1713546025 tempest-VolumeQuotaClassesTest-1713546025-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:16.503712 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 874/1749] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:11:16 2022] DELETE /identity/v3/projects/23dfe1edf939482898e67ad4fdfc8f01 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:16.513983 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93801657-42ba-4203-9f6f-19f003d69503 tempest-VolumeQuotaClassesTest-1713546025 tempest-VolumeQuotaClassesTest-1713546025-project-admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:16.606041 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc81960b-22ef-4858-9de0-60bd71878355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:16.607519 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81960b-22ef-4858-9de0-60bd71878355 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:16.607805 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81960b-22ef-4858-9de0-60bd71878355 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:16.608082 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81960b-22ef-4858-9de0-60bd71878355 admin admin] PATH_INFO: `/v3/projects/493839e1607244b586d8a61dd90e966e` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:16.609614 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc81960b-22ef-4858-9de0-60bd71878355 admin admin] RBAC: Authorizing `identity:delete_project(project_id=493839e1607244b586d8a61dd90e966e)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:16.612245 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc81960b-22ef-4858-9de0-60bd71878355 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:16.723631 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-bc81960b-22ef-4858-9de0-60bd71878355 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '493839e1607244b586d8a61dd90e966e', 'request_id': 'req-bc81960b-22ef-4858-9de0-60bd71878355'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:16.736156 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-bc81960b-22ef-4858-9de0-60bd71878355 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '493839e1607244b586d8a61dd90e966e', 'request_id': 'req-bc81960b-22ef-4858-9de0-60bd71878355'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:16.747185 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-bc81960b-22ef-4858-9de0-60bd71878355 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '493839e1607244b586d8a61dd90e966e', 'request_id': 'req-bc81960b-22ef-4858-9de0-60bd71878355'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:16.756620 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:16.774354 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-bc81960b-22ef-4858-9de0-60bd71878355 admin admin] The token cache is being invalidate because project 493839e1607244b586d8a61dd90e966e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:11:16.774651 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-bc81960b-22ef-4858-9de0-60bd71878355 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:16.775353 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-bc81960b-22ef-4858-9de0-60bd71878355 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:16.777663 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 876/1750] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:11:16 2022] DELETE /identity/v3/projects/493839e1607244b586d8a61dd90e966e => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 11:11:16.781295 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb66ad-293b-489b-8b86-bc51c353e0ce tempest-VolumeQuotaClassesTest-1713546025 tempest-VolumeQuotaClassesTest-1713546025-project-admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:16.782944 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-cfeb66ad-293b-489b-8b86-bc51c353e0ce tempest-VolumeQuotaClassesTest-1713546025 tempest-VolumeQuotaClassesTest-1713546025-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:16.809108 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb66ad-293b-489b-8b86-bc51c353e0ce tempest-VolumeQuotaClassesTest-1713546025 tempest-VolumeQuotaClassesTest-1713546025-project-admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:16.846874 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc81960b-22ef-4858-9de0-60bd71878355 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:16.848897 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-bc81960b-22ef-4858-9de0-60bd71878355 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:16.945189 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e21141-c778-45ac-9588-5584a1fb6b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:16.946552 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e21141-c778-45ac-9588-5584a1fb6b7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:16.947039 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e21141-c778-45ac-9588-5584a1fb6b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:16.947708 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e21141-c778-45ac-9588-5584a1fb6b7e admin admin] PATH_INFO: `/v3/users/cb0d937969a54bb7bb77e22b1e061096` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:16.949736 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e21141-c778-45ac-9588-5584a1fb6b7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb0d937969a54bb7bb77e22b1e061096)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:16.952050 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e21141-c778-45ac-9588-5584a1fb6b7e admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:16.959851 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc81960b-22ef-4858-9de0-60bd71878355 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:16.976333 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0152ab93-26ca-411c-a348-4cac833a958f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:16.977008 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0152ab93-26ca-411c-a348-4cac833a958f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:16.977294 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0152ab93-26ca-411c-a348-4cac833a958f admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:16.977597 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0152ab93-26ca-411c-a348-4cac833a958f admin admin] PATH_INFO: `/v3/users/1e6538d23c0e46729f30a0c33fd820a2` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:16.979645 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0152ab93-26ca-411c-a348-4cac833a958f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e6538d23c0e46729f30a0c33fd820a2)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:16.982991 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0152ab93-26ca-411c-a348-4cac833a958f admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:17.045309 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-20e21141-c778-45ac-9588-5584a1fb6b7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb0d937969a54bb7bb77e22b1e061096'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:17.053705 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-20e21141-c778-45ac-9588-5584a1fb6b7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb0d937969a54bb7bb77e22b1e061096'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:17.054475 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-20e21141-c778-45ac-9588-5584a1fb6b7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb0d937969a54bb7bb77e22b1e061096'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:17.055200 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-20e21141-c778-45ac-9588-5584a1fb6b7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb0d937969a54bb7bb77e22b1e061096'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:17.060135 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=82,keystone:INSERT=3,keystone:DELETE=15 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:17.064471 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-20e21141-c778-45ac-9588-5584a1fb6b7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb0d937969a54bb7bb77e22b1e061096'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:17.083626 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-0152ab93-26ca-411c-a348-4cac833a958f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e6538d23c0e46729f30a0c33fd820a2'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:17.084773 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-0152ab93-26ca-411c-a348-4cac833a958f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e6538d23c0e46729f30a0c33fd820a2'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:17.085602 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-0152ab93-26ca-411c-a348-4cac833a958f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e6538d23c0e46729f30a0c33fd820a2'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:17.093918 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 875/1751] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:11:16 2022] DELETE /identity/v3/users/cb0d937969a54bb7bb77e22b1e061096 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:17.128266 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-0152ab93-26ca-411c-a348-4cac833a958f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e6538d23c0e46729f30a0c33fd820a2'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:17.154147 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-0152ab93-26ca-411c-a348-4cac833a958f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e6538d23c0e46729f30a0c33fd820a2'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:17.172185 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 877/1752] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:11:16 2022] DELETE /identity/v3/users/1e6538d23c0e46729f30a0c33fd820a2 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:17.176731 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c12e680-53dd-4d20-a70c-ddbe3f98a8e8 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:17.177265 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c12e680-53dd-4d20-a70c-ddbe3f98a8e8 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:17.177643 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c12e680-53dd-4d20-a70c-ddbe3f98a8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:17.202576 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-5c12e680-53dd-4d20-a70c-ddbe3f98a8e8 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:17.203953 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-5c12e680-53dd-4d20-a70c-ddbe3f98a8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:17.360454 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 876/1753] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 11:11:17.380754 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0152ab93-26ca-411c-a348-4cac833a958f admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:17.382264 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-0152ab93-26ca-411c-a348-4cac833a958f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:17.501334 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0152ab93-26ca-411c-a348-4cac833a958f admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:17.513789 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82c2b30-bdaa-4f0a-ad18-0de0c7a3fbac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:17.514927 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c2b30-bdaa-4f0a-ad18-0de0c7a3fbac service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:17.517579 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c2b30-bdaa-4f0a-ad18-0de0c7a3fbac service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:17.517579 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c2b30-bdaa-4f0a-ad18-0de0c7a3fbac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:17.529334 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82c2b30-bdaa-4f0a-ad18-0de0c7a3fbac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:17.531186 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82c2b30-bdaa-4f0a-ad18-0de0c7a3fbac service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:17.547189 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 878/1754] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:11:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:11:17.790205 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c12e680-53dd-4d20-a70c-ddbe3f98a8e8 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:17.793574 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-5c12e680-53dd-4d20-a70c-ddbe3f98a8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:17.815857 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c12e680-53dd-4d20-a70c-ddbe3f98a8e8 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:17.832229 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa3b6ee-23dd-4730-bd84-585c81bd0dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:17.832929 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa3b6ee-23dd-4730-bd84-585c81bd0dee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:17.833442 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa3b6ee-23dd-4730-bd84-585c81bd0dee admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:17.833731 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa3b6ee-23dd-4730-bd84-585c81bd0dee admin admin] PATH_INFO: `/v3/projects/7210659d194b4c9495c449c3a2c62a76` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:17.836791 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa3b6ee-23dd-4730-bd84-585c81bd0dee admin admin] RBAC: Authorizing `identity:delete_project(project_id=7210659d194b4c9495c449c3a2c62a76)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:17.842707 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa3b6ee-23dd-4730-bd84-585c81bd0dee admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:17.967605 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-caa3b6ee-23dd-4730-bd84-585c81bd0dee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7210659d194b4c9495c449c3a2c62a76', 'request_id': 'req-caa3b6ee-23dd-4730-bd84-585c81bd0dee'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:17.977813 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-caa3b6ee-23dd-4730-bd84-585c81bd0dee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7210659d194b4c9495c449c3a2c62a76', 'request_id': 'req-caa3b6ee-23dd-4730-bd84-585c81bd0dee'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:17.984990 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-caa3b6ee-23dd-4730-bd84-585c81bd0dee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7210659d194b4c9495c449c3a2c62a76', 'request_id': 'req-caa3b6ee-23dd-4730-bd84-585c81bd0dee'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:18.018320 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-caa3b6ee-23dd-4730-bd84-585c81bd0dee admin admin] The token cache is being invalidate because project 7210659d194b4c9495c449c3a2c62a76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:11:18.018951 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-caa3b6ee-23dd-4730-bd84-585c81bd0dee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:18.020179 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-caa3b6ee-23dd-4730-bd84-585c81bd0dee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:18.030259 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 877/1755] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:11:17 2022] DELETE /identity/v3/projects/7210659d194b4c9495c449c3a2c62a76 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:18.037997 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a8624-34e5-4bdc-837b-a30aad56f8a9 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:18.037997 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a8624-34e5-4bdc-837b-a30aad56f8a9 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:18.037997 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a8624-34e5-4bdc-837b-a30aad56f8a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:18.041831 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa3b6ee-23dd-4730-bd84-585c81bd0dee admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:18.045107 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-caa3b6ee-23dd-4730-bd84-585c81bd0dee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:18.096915 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-f86a8624-34e5-4bdc-837b-a30aad56f8a9 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:18.099166 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-f86a8624-34e5-4bdc-837b-a30aad56f8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:18.112565 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:18.218307 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa3b6ee-23dd-4730-bd84-585c81bd0dee admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:18.218537 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 879/1756] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:11:18.226316 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046b32b-80df-47ac-ac05-c149d7fdf40d None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:18.226689 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046b32b-80df-47ac-ac05-c149d7fdf40d None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:18.227037 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046b32b-80df-47ac-ac05-c149d7fdf40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:18.229389 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e49738-b576-4584-9936-eec589af0e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:18.230827 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e49738-b576-4584-9936-eec589af0e60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:18.231246 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e49738-b576-4584-9936-eec589af0e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:18.231526 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e49738-b576-4584-9936-eec589af0e60 admin admin] PATH_INFO: `/v3/projects/d38a919ac66b4a95af47c2dac611980b` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:18.232667 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e49738-b576-4584-9936-eec589af0e60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d38a919ac66b4a95af47c2dac611980b)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:18.234839 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e49738-b576-4584-9936-eec589af0e60 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:18.239450 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:18.249228 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-0046b32b-80df-47ac-ac05-c149d7fdf40d None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:18.250506 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-0046b32b-80df-47ac-ac05-c149d7fdf40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:18.259322 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 880/1757] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:11:18.264302 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0046b32b-80df-47ac-ac05-c149d7fdf40d None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:18.283324 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0046b32b-80df-47ac-ac05-c149d7fdf40d None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:18.289061 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedded98-25b9-48be-8263-e6e30291d97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:18.289680 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedded98-25b9-48be-8263-e6e30291d97a admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:18.289985 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedded98-25b9-48be-8263-e6e30291d97a admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:18.290268 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedded98-25b9-48be-8263-e6e30291d97a admin admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:18.290920 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedded98-25b9-48be-8263-e6e30291d97a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:11:18.291229 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedded98-25b9-48be-8263-e6e30291d97a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:18.293387 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedded98-25b9-48be-8263-e6e30291d97a admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:18.304508 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-b7e49738-b576-4584-9936-eec589af0e60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd38a919ac66b4a95af47c2dac611980b', 'request_id': 'req-b7e49738-b576-4584-9936-eec589af0e60'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:18.305306 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 881/1758] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 11:11:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:11:18.310930 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedded98-25b9-48be-8263-e6e30291d97a admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:18.312444 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-b7e49738-b576-4584-9936-eec589af0e60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd38a919ac66b4a95af47c2dac611980b', 'request_id': 'req-b7e49738-b576-4584-9936-eec589af0e60'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:18.318628 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-b7e49738-b576-4584-9936-eec589af0e60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd38a919ac66b4a95af47c2dac611980b', 'request_id': 'req-b7e49738-b576-4584-9936-eec589af0e60'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:18.322937 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedded98-25b9-48be-8263-e6e30291d97a admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:18.334477 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-b7e49738-b576-4584-9936-eec589af0e60 admin admin] The token cache is being invalidate because project d38a919ac66b4a95af47c2dac611980b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:11:18.335016 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-b7e49738-b576-4584-9936-eec589af0e60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:18.335719 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-b7e49738-b576-4584-9936-eec589af0e60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:18.337462 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 878/1759] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:11:18 2022] DELETE /identity/v3/projects/d38a919ac66b4a95af47c2dac611980b => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:18.340994 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e49738-b576-4584-9936-eec589af0e60 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:18.342347 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-b7e49738-b576-4584-9936-eec589af0e60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:18.390059 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7567a32-3eb7-42dc-afe6-c3a5d3944090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:18.390968 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7567a32-3eb7-42dc-afe6-c3a5d3944090 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:18.390968 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7567a32-3eb7-42dc-afe6-c3a5d3944090 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:18.391197 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7567a32-3eb7-42dc-afe6-c3a5d3944090 admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:18.391856 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7567a32-3eb7-42dc-afe6-c3a5d3944090 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:18.393751 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7567a32-3eb7-42dc-afe6-c3a5d3944090 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:18.431926 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 882/1760] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:11:18 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:11:18.432120 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e49738-b576-4584-9936-eec589af0e60 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:18.433422 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7567a32-3eb7-42dc-afe6-c3a5d3944090 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:18.436111 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-d7567a32-3eb7-42dc-afe6-c3a5d3944090 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:18.515285 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2bb7d3-e6c7-41a3-a891-aca1abd1c8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:18.515928 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2bb7d3-e6c7-41a3-a891-aca1abd1c8ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:18.516201 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2bb7d3-e6c7-41a3-a891-aca1abd1c8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:18.516564 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2bb7d3-e6c7-41a3-a891-aca1abd1c8ea admin admin] PATH_INFO: `/v3/users/67c5ea1d65d64782bd232b23c929ba2a` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:18.517601 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2bb7d3-e6c7-41a3-a891-aca1abd1c8ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=67c5ea1d65d64782bd232b23c929ba2a)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:18.521604 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2bb7d3-e6c7-41a3-a891-aca1abd1c8ea admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:18.531769 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7567a32-3eb7-42dc-afe6-c3a5d3944090 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:18.542385 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e962726-045f-4709-9253-fb6b3048ae93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:18.543172 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e962726-045f-4709-9253-fb6b3048ae93 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:18.543606 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e962726-045f-4709-9253-fb6b3048ae93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:18.543979 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e962726-045f-4709-9253-fb6b3048ae93 admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:18.544725 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e962726-045f-4709-9253-fb6b3048ae93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:18.547022 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e962726-045f-4709-9253-fb6b3048ae93 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:18.577431 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 883/1761] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:11:18 2022] POST /identity/v3/users => generated 293 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 11:11:18.578640 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e962726-045f-4709-9253-fb6b3048ae93 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:18.596660 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e962726-045f-4709-9253-fb6b3048ae93 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:18.604851 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:18.606667 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c8e8ee-771b-406e-8fd7-edd5e8764905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:18.607510 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8e8ee-771b-406e-8fd7-edd5e8764905 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:18.607947 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8e8ee-771b-406e-8fd7-edd5e8764905 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:18.608359 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8e8ee-771b-406e-8fd7-edd5e8764905 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:18.610030 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c8e8ee-771b-406e-8fd7-edd5e8764905 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:18.611962 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c8e8ee-771b-406e-8fd7-edd5e8764905 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:18.624478 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-bc2bb7d3-e6c7-41a3-a891-aca1abd1c8ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67c5ea1d65d64782bd232b23c929ba2a'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:18.630537 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:18.646057 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-bc2bb7d3-e6c7-41a3-a891-aca1abd1c8ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67c5ea1d65d64782bd232b23c929ba2a'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:18.647104 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-bc2bb7d3-e6c7-41a3-a891-aca1abd1c8ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67c5ea1d65d64782bd232b23c929ba2a'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:18.648485 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-bc2bb7d3-e6c7-41a3-a891-aca1abd1c8ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67c5ea1d65d64782bd232b23c929ba2a'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:18.649491 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 884/1762] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:11:18 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 13 11:11:18.655228 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c8e8ee-771b-406e-8fd7-edd5e8764905 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:18.657132 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-23c8e8ee-771b-406e-8fd7-edd5e8764905 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:18.672692 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-bc2bb7d3-e6c7-41a3-a891-aca1abd1c8ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67c5ea1d65d64782bd232b23c929ba2a'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:18.674682 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c8e8ee-771b-406e-8fd7-edd5e8764905 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:18.686917 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a43668f-560d-439d-afd0-81c234e396bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:18.687569 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a43668f-560d-439d-afd0-81c234e396bc admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:18.687849 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a43668f-560d-439d-afd0-81c234e396bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:18.688127 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a43668f-560d-439d-afd0-81c234e396bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:18.688876 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a43668f-560d-439d-afd0-81c234e396bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:18.693322 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a43668f-560d-439d-afd0-81c234e396bc admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:18.710918 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 879/1763] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:11:18 2022] DELETE /identity/v3/users/67c5ea1d65d64782bd232b23c929ba2a => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 11:11:18.722525 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 885/1764] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:11:18 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 13 11:11:18.735647 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2bb7d3-e6c7-41a3-a891-aca1abd1c8ea admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:18.827360 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2bb7d3-e6c7-41a3-a891-aca1abd1c8ea admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:18.834924 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec36efea-b2ed-4bae-b984-323a47e48da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:18.835593 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36efea-b2ed-4bae-b984-323a47e48da4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:18.835877 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36efea-b2ed-4bae-b984-323a47e48da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:18.836304 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36efea-b2ed-4bae-b984-323a47e48da4 admin admin] PATH_INFO: `/v3/projects/7ac061f6376d4bc9a09864834ec85736/users/a259d19a61e9489fbde2627ab36c09d0/roles/7c3871c0ab68438b9014489d50b53a22` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:18.854534 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec36efea-b2ed-4bae-b984-323a47e48da4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ac061f6376d4bc9a09864834ec85736, user_id=a259d19a61e9489fbde2627ab36c09d0, role_id=7c3871c0ab68438b9014489d50b53a22)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:18.857690 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec36efea-b2ed-4bae-b984-323a47e48da4 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:18.882955 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 880/1765] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:11:18 2022] PUT /identity/v3/projects/7ac061f6376d4bc9a09864834ec85736/users/a259d19a61e9489fbde2627ab36c09d0/roles/7c3871c0ab68438b9014489d50b53a22 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:18.894387 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510dc9c-49ca-4824-8397-49734b621ed6 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:18.895729 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510dc9c-49ca-4824-8397-49734b621ed6 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:18.895729 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510dc9c-49ca-4824-8397-49734b621ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:18.947710 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-7510dc9c-49ca-4824-8397-49734b621ed6 None None] MFA Rules not processed for user `a259d19a61e9489fbde2627ab36c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:18.949594 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-7510dc9c-49ca-4824-8397-49734b621ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:19.061667 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 886/1766] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:11:19.074145 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec36efea-b2ed-4bae-b984-323a47e48da4 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:19.075806 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-ec36efea-b2ed-4bae-b984-323a47e48da4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:19.178862 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec36efea-b2ed-4bae-b984-323a47e48da4 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:19.183583 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e7b9ef-8e2d-4adb-84be-de4c8bb511c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f4c2fc51f54f0e977648b13efaed1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:19.184447 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7b9ef-8e2d-4adb-84be-de4c8bb511c6 service cinder] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:19.184844 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7b9ef-8e2d-4adb-84be-de4c8bb511c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:19.185221 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7b9ef-8e2d-4adb-84be-de4c8bb511c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:19.201271 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e7b9ef-8e2d-4adb-84be-de4c8bb511c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:19.203630 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e7b9ef-8e2d-4adb-84be-de4c8bb511c6 service cinder] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:19.217167 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 881/1767] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:11:19 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:11:19.393306 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7510dc9c-49ca-4824-8397-49734b621ed6 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:19.395856 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-7510dc9c-49ca-4824-8397-49734b621ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:19.575028 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7510dc9c-49ca-4824-8397-49734b621ed6 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:19.604564 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d475b95-75aa-427a-8731-5428275aef63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:19.604732 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d475b95-75aa-427a-8731-5428275aef63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:19.604913 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d475b95-75aa-427a-8731-5428275aef63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:19.605379 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d475b95-75aa-427a-8731-5428275aef63 admin admin] PATH_INFO: `/v3/projects/0d96046d5c6046d89bbfedb284c2704e` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:19.606748 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d475b95-75aa-427a-8731-5428275aef63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d96046d5c6046d89bbfedb284c2704e)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:19.609070 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d475b95-75aa-427a-8731-5428275aef63 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:19.725015 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-6d475b95-75aa-427a-8731-5428275aef63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d96046d5c6046d89bbfedb284c2704e', 'request_id': 'req-6d475b95-75aa-427a-8731-5428275aef63'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:19.736620 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-6d475b95-75aa-427a-8731-5428275aef63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d96046d5c6046d89bbfedb284c2704e', 'request_id': 'req-6d475b95-75aa-427a-8731-5428275aef63'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:19.755769 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-6d475b95-75aa-427a-8731-5428275aef63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d96046d5c6046d89bbfedb284c2704e', 'request_id': 'req-6d475b95-75aa-427a-8731-5428275aef63'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:19.782698 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-6d475b95-75aa-427a-8731-5428275aef63 admin admin] The token cache is being invalidate because project 0d96046d5c6046d89bbfedb284c2704e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:11:19.782993 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-6d475b95-75aa-427a-8731-5428275aef63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:19.783677 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-6d475b95-75aa-427a-8731-5428275aef63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:19.786471 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 887/1768] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:11:19 2022] DELETE /identity/v3/projects/0d96046d5c6046d89bbfedb284c2704e => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:19.791665 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac4ea6c-c23e-4d1e-8ab6-a36630096440 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:19.791952 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac4ea6c-c23e-4d1e-8ab6-a36630096440 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:19.792597 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac4ea6c-c23e-4d1e-8ab6-a36630096440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:19.833036 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-7ac4ea6c-c23e-4d1e-8ab6-a36630096440 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:19.834910 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-7ac4ea6c-c23e-4d1e-8ab6-a36630096440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:19.892865 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:19.915046 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 882/1769] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:11:19.931056 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06862bc-1d27-4833-8b43-976cb74727df None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:19.931373 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06862bc-1d27-4833-8b43-976cb74727df None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:19.931590 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06862bc-1d27-4833-8b43-976cb74727df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:19.947610 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac4ea6c-c23e-4d1e-8ab6-a36630096440 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:19.949209 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-7ac4ea6c-c23e-4d1e-8ab6-a36630096440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:19.952181 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-e06862bc-1d27-4833-8b43-976cb74727df None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:19.953356 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-e06862bc-1d27-4833-8b43-976cb74727df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:19.961816 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 888/1770] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:11:19.965919 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06862bc-1d27-4833-8b43-976cb74727df None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:19.966059 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac4ea6c-c23e-4d1e-8ab6-a36630096440 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:19.970596 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04905d2-c00c-4526-9c85-55f510931192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:19.971228 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04905d2-c00c-4526-9c85-55f510931192 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:19.971507 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04905d2-c00c-4526-9c85-55f510931192 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:19.971779 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04905d2-c00c-4526-9c85-55f510931192 admin admin] PATH_INFO: `/v3/users/f441da37833c45cb962821d7caed9690` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:19.972108 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:19.973700 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04905d2-c00c-4526-9c85-55f510931192 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f441da37833c45cb962821d7caed9690)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:19.977076 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04905d2-c00c-4526-9c85-55f510931192 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:19.980425 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06862bc-1d27-4833-8b43-976cb74727df None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:19.988375 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ded056e-471c-4c45-bd47-69a03445943d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:19.989570 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded056e-471c-4c45-bd47-69a03445943d admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:19.989987 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded056e-471c-4c45-bd47-69a03445943d admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:19.990354 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded056e-471c-4c45-bd47-69a03445943d admin admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:19.991313 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ded056e-471c-4c45-bd47-69a03445943d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:11:19.992186 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ded056e-471c-4c45-bd47-69a03445943d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:19.993684 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ded056e-471c-4c45-bd47-69a03445943d admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:20.008031 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 889/1771] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 11:11:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 11:11:20.013361 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ded056e-471c-4c45-bd47-69a03445943d admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:20.026916 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ded056e-471c-4c45-bd47-69a03445943d admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:20.034535 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01200cc6-b95d-4bb8-a36a-e262003c1122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:20.035262 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01200cc6-b95d-4bb8-a36a-e262003c1122 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:20.036417 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01200cc6-b95d-4bb8-a36a-e262003c1122 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:20.036625 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-f04905d2-c00c-4526-9c85-55f510931192 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f441da37833c45cb962821d7caed9690'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:20.036792 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01200cc6-b95d-4bb8-a36a-e262003c1122 admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:20.037444 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01200cc6-b95d-4bb8-a36a-e262003c1122 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:20.039509 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01200cc6-b95d-4bb8-a36a-e262003c1122 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:20.047865 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-f04905d2-c00c-4526-9c85-55f510931192 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f441da37833c45cb962821d7caed9690'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:20.049517 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-f04905d2-c00c-4526-9c85-55f510931192 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f441da37833c45cb962821d7caed9690'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:20.051193 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-f04905d2-c00c-4526-9c85-55f510931192 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f441da37833c45cb962821d7caed9690'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:20.062624 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-f04905d2-c00c-4526-9c85-55f510931192 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f441da37833c45cb962821d7caed9690'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:20.079413 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 890/1772] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:11:20 2022] POST /identity/v3/projects => generated 391 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 11:11:20.080650 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01200cc6-b95d-4bb8-a36a-e262003c1122 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:20.083779 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-01200cc6-b95d-4bb8-a36a-e262003c1122 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:20.093373 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 883/1773] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:11:19 2022] DELETE /identity/v3/users/f441da37833c45cb962821d7caed9690 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 11:11:20.176560 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01200cc6-b95d-4bb8-a36a-e262003c1122 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:20.258866 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57176935-cb75-43e7-92dc-b5b4ee470956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:20.259486 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57176935-cb75-43e7-92dc-b5b4ee470956 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:20.259766 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57176935-cb75-43e7-92dc-b5b4ee470956 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:20.260039 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57176935-cb75-43e7-92dc-b5b4ee470956 admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:20.260677 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57176935-cb75-43e7-92dc-b5b4ee470956 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:20.262658 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57176935-cb75-43e7-92dc-b5b4ee470956 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:20.287375 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 891/1774] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:11:20 2022] POST /identity/v3/users => generated 296 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:11:20.291993 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04905d2-c00c-4526-9c85-55f510931192 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:20.302284 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04905d2-c00c-4526-9c85-55f510931192 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:20.311283 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ead3bfe-5c63-4c72-a44a-4a32c3cddd78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:20.311908 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead3bfe-5c63-4c72-a44a-4a32c3cddd78 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:20.312214 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead3bfe-5c63-4c72-a44a-4a32c3cddd78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:20.312485 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead3bfe-5c63-4c72-a44a-4a32c3cddd78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:20.313160 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ead3bfe-5c63-4c72-a44a-4a32c3cddd78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:20.315240 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ead3bfe-5c63-4c72-a44a-4a32c3cddd78 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:20.327640 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 884/1775] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:11:20.331811 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57176935-cb75-43e7-92dc-b5b4ee470956 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:20.343597 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57176935-cb75-43e7-92dc-b5b4ee470956 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:20.348981 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ead3bfe-5c63-4c72-a44a-4a32c3cddd78 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:20.350190 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224852aa-c4a5-47c1-99a1-2a11f608e845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:20.350804 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-9ead3bfe-5c63-4c72-a44a-4a32c3cddd78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:20.350916 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224852aa-c4a5-47c1-99a1-2a11f608e845 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:20.351113 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224852aa-c4a5-47c1-99a1-2a11f608e845 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:20.351616 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224852aa-c4a5-47c1-99a1-2a11f608e845 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:20.352265 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224852aa-c4a5-47c1-99a1-2a11f608e845 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:20.354139 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224852aa-c4a5-47c1-99a1-2a11f608e845 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:20.366368 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ead3bfe-5c63-4c72-a44a-4a32c3cddd78 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:20.373141 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f60a357-16d2-4a07-8af5-4a76844ad9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:20.374416 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f60a357-16d2-4a07-8af5-4a76844ad9eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:20.374844 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 892/1776] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:11:20.375174 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f60a357-16d2-4a07-8af5-4a76844ad9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:20.375465 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f60a357-16d2-4a07-8af5-4a76844ad9eb admin admin] PATH_INFO: `/v3/projects/e4fe457bf3f642c7a7f0a3dafde30ce1` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:20.376909 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f60a357-16d2-4a07-8af5-4a76844ad9eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4fe457bf3f642c7a7f0a3dafde30ce1)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:20.379946 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224852aa-c4a5-47c1-99a1-2a11f608e845 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:20.380501 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f60a357-16d2-4a07-8af5-4a76844ad9eb admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:20.401575 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224852aa-c4a5-47c1-99a1-2a11f608e845 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:20.406376 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947056e9-67a4-41a6-bc6b-f70b5314a664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:20.407106 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947056e9-67a4-41a6-bc6b-f70b5314a664 admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:20.407962 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947056e9-67a4-41a6-bc6b-f70b5314a664 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:20.407962 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947056e9-67a4-41a6-bc6b-f70b5314a664 admin admin] PATH_INFO: `/v3/projects/3465a317bf6c4b35874f2bf5d1829f8f/users/c627f48cbd9647e986e2c9edffd3fdc0/roles/7c3871c0ab68438b9014489d50b53a22` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:20.426021 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947056e9-67a4-41a6-bc6b-f70b5314a664 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3465a317bf6c4b35874f2bf5d1829f8f, user_id=c627f48cbd9647e986e2c9edffd3fdc0, role_id=7c3871c0ab68438b9014489d50b53a22)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:20.429211 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947056e9-67a4-41a6-bc6b-f70b5314a664 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:20.434998 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-7f60a357-16d2-4a07-8af5-4a76844ad9eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4fe457bf3f642c7a7f0a3dafde30ce1', 'request_id': 'req-7f60a357-16d2-4a07-8af5-4a76844ad9eb'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:20.444518 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-7f60a357-16d2-4a07-8af5-4a76844ad9eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4fe457bf3f642c7a7f0a3dafde30ce1', 'request_id': 'req-7f60a357-16d2-4a07-8af5-4a76844ad9eb'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:20.446460 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 893/1777] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:11:20 2022] PUT /identity/v3/projects/3465a317bf6c4b35874f2bf5d1829f8f/users/c627f48cbd9647e986e2c9edffd3fdc0/roles/7c3871c0ab68438b9014489d50b53a22 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:20.456638 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-7f60a357-16d2-4a07-8af5-4a76844ad9eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4fe457bf3f642c7a7f0a3dafde30ce1', 'request_id': 'req-7f60a357-16d2-4a07-8af5-4a76844ad9eb'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:20.458094 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64f1e5-bb34-485e-adfb-8144e3007763 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:20.458383 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64f1e5-bb34-485e-adfb-8144e3007763 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:20.458653 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64f1e5-bb34-485e-adfb-8144e3007763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:20.478905 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-7f60a357-16d2-4a07-8af5-4a76844ad9eb admin admin] The token cache is being invalidate because project e4fe457bf3f642c7a7f0a3dafde30ce1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:11:20.479509 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-7f60a357-16d2-4a07-8af5-4a76844ad9eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:20.482778 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-7f60a357-16d2-4a07-8af5-4a76844ad9eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:20.488033 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 885/1778] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:11:20 2022] DELETE /identity/v3/projects/e4fe457bf3f642c7a7f0a3dafde30ce1 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 11:11:20.489961 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-ed64f1e5-bb34-485e-adfb-8144e3007763 None None] MFA Rules not processed for user `c627f48cbd9647e986e2c9edffd3fdc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:20.490264 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58486c-fed9-4fe9-94a8-082707399f0b None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:20.490536 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58486c-fed9-4fe9-94a8-082707399f0b None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:20.490832 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58486c-fed9-4fe9-94a8-082707399f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:20.491481 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-ed64f1e5-bb34-485e-adfb-8144e3007763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:20.515892 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:20.529610 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-ed58486c-fed9-4fe9-94a8-082707399f0b None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:20.531316 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-ed58486c-fed9-4fe9-94a8-082707399f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:20.560977 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:20.580244 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 894/1779] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:20 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 11:11:20.584977 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed64f1e5-bb34-485e-adfb-8144e3007763 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:20.586367 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-ed64f1e5-bb34-485e-adfb-8144e3007763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:20.606493 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 886/1780] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 11:11:20.614376 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc583cf-7810-474f-99c9-1b2b63551c1f None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:20.614666 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc583cf-7810-474f-99c9-1b2b63551c1f None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:20.614944 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc583cf-7810-474f-99c9-1b2b63551c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:20.639159 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-fbc583cf-7810-474f-99c9-1b2b63551c1f None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:20.640401 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-fbc583cf-7810-474f-99c9-1b2b63551c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:20.649050 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 887/1781] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 11:11:20.653257 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc583cf-7810-474f-99c9-1b2b63551c1f None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:20.658735 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed64f1e5-bb34-485e-adfb-8144e3007763 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:20.662211 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc583cf-7810-474f-99c9-1b2b63551c1f None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:20.663397 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14fd077-f17a-443c-a8cc-ee9529f6e667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:20.664091 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14fd077-f17a-443c-a8cc-ee9529f6e667 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:20.664373 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14fd077-f17a-443c-a8cc-ee9529f6e667 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:20.664647 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14fd077-f17a-443c-a8cc-ee9529f6e667 admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:20.665307 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14fd077-f17a-443c-a8cc-ee9529f6e667 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:20.667199 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14fd077-f17a-443c-a8cc-ee9529f6e667 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:20.667324 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdef8aa-9da6-4ad1-a7f1-abe8e3d42b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:20.667829 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdef8aa-9da6-4ad1-a7f1-abe8e3d42b7a admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:20.668109 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdef8aa-9da6-4ad1-a7f1-abe8e3d42b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:20.668381 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdef8aa-9da6-4ad1-a7f1-abe8e3d42b7a admin admin] PATH_INFO: `/v3/domains` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:20.669025 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdef8aa-9da6-4ad1-a7f1-abe8e3d42b7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:11:20.669329 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdef8aa-9da6-4ad1-a7f1-abe8e3d42b7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:20.670922 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdef8aa-9da6-4ad1-a7f1-abe8e3d42b7a admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:20.686745 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 888/1782] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 11:11:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 11:11:20.687936 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdef8aa-9da6-4ad1-a7f1-abe8e3d42b7a admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:20.700517 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 895/1783] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:11:20 2022] POST /identity/v3/projects => generated 391 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 11:11:20.700703 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdef8aa-9da6-4ad1-a7f1-abe8e3d42b7a admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:20.701650 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14fd077-f17a-443c-a8cc-ee9529f6e667 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:20.785405 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4372315-5360-46eb-ab3f-6f68c17be6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:20.786503 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4372315-5360-46eb-ab3f-6f68c17be6b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:20.787169 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4372315-5360-46eb-ab3f-6f68c17be6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:20.787528 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4372315-5360-46eb-ab3f-6f68c17be6b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:20.788356 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4372315-5360-46eb-ab3f-6f68c17be6b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:20.790372 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4372315-5360-46eb-ab3f-6f68c17be6b6 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:20.804163 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14fd077-f17a-443c-a8cc-ee9529f6e667 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:20.809782 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad143d2-3b5e-40ba-901e-55512474bead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:20.810644 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad143d2-3b5e-40ba-901e-55512474bead admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:20.811060 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad143d2-3b5e-40ba-901e-55512474bead admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:20.812026 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad143d2-3b5e-40ba-901e-55512474bead admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:20.812975 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad143d2-3b5e-40ba-901e-55512474bead admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:20.816025 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad143d2-3b5e-40ba-901e-55512474bead admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:20.841799 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 889/1784] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:11:20 2022] POST /identity/v3/projects => generated 377 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:11:20.843055 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4372315-5360-46eb-ab3f-6f68c17be6b6 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:20.852732 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 896/1785] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:11:20 2022] POST /identity/v3/users => generated 302 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:11:20.856482 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad143d2-3b5e-40ba-901e-55512474bead admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:20.875422 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad143d2-3b5e-40ba-901e-55512474bead admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:20.956107 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:20.973375 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4372315-5360-46eb-ab3f-6f68c17be6b6 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:20.979928 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7872c26b-cc21-4491-b5c6-272b1853370d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:20.980544 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872c26b-cc21-4491-b5c6-272b1853370d admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:20.980890 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872c26b-cc21-4491-b5c6-272b1853370d admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:20.981055 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872c26b-cc21-4491-b5c6-272b1853370d admin admin] PATH_INFO: `/v3/users` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:20.981722 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7872c26b-cc21-4491-b5c6-272b1853370d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:20.986148 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7872c26b-cc21-4491-b5c6-272b1853370d admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:20.998176 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536e58d-6c96-417f-8656-00e6a0df6a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:20.999073 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536e58d-6c96-417f-8656-00e6a0df6a8f admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:20.999365 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536e58d-6c96-417f-8656-00e6a0df6a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:20.999760 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536e58d-6c96-417f-8656-00e6a0df6a8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:21.000842 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1536e58d-6c96-417f-8656-00e6a0df6a8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:21.003023 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1536e58d-6c96-417f-8656-00e6a0df6a8f admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:21.013072 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 890/1786] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:11:20 2022] POST /identity/v3/users => generated 289 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:11:21.022186 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7872c26b-cc21-4491-b5c6-272b1853370d admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:21.022365 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 897/1787] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:11:21.023222 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536e58d-6c96-417f-8656-00e6a0df6a8f admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:21.030184 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7872c26b-cc21-4491-b5c6-272b1853370d admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:21.036012 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536e58d-6c96-417f-8656-00e6a0df6a8f admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:21.036501 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bfdfe7-9b51-4ab9-b5ba-bd5e64368e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:21.037298 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bfdfe7-9b51-4ab9-b5ba-bd5e64368e04 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:21.037584 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bfdfe7-9b51-4ab9-b5ba-bd5e64368e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:21.037862 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bfdfe7-9b51-4ab9-b5ba-bd5e64368e04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:21.038805 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bfdfe7-9b51-4ab9-b5ba-bd5e64368e04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:21.040560 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bfdfe7-9b51-4ab9-b5ba-bd5e64368e04 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:21.044086 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb558f24-9d92-429d-a9fb-ad4c07eb1c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:21.045447 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb558f24-9d92-429d-a9fb-ad4c07eb1c10 admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:21.045728 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb558f24-9d92-429d-a9fb-ad4c07eb1c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:21.046530 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb558f24-9d92-429d-a9fb-ad4c07eb1c10 admin admin] PATH_INFO: `/v3/projects/f91464d4016047199f039982254a345d/users/d4c55f335ad5455ab3d6a7a367bf8637/roles/ea564961b1db4eb4a1d4d880964611b2` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:21.053079 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 891/1788] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:11:21 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:11:21.057822 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bfdfe7-9b51-4ab9-b5ba-bd5e64368e04 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:21.066883 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb558f24-9d92-429d-a9fb-ad4c07eb1c10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f91464d4016047199f039982254a345d, user_id=d4c55f335ad5455ab3d6a7a367bf8637, role_id=ea564961b1db4eb4a1d4d880964611b2)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:21.070323 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb558f24-9d92-429d-a9fb-ad4c07eb1c10 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:21.072548 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bfdfe7-9b51-4ab9-b5ba-bd5e64368e04 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:21.079108 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b2fa72-6a0c-4e0f-9483-00ca78fa5a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:21.079739 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b2fa72-6a0c-4e0f-9483-00ca78fa5a6a admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:21.080067 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b2fa72-6a0c-4e0f-9483-00ca78fa5a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:21.080362 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b2fa72-6a0c-4e0f-9483-00ca78fa5a6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:21.081219 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b2fa72-6a0c-4e0f-9483-00ca78fa5a6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:21.083579 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b2fa72-6a0c-4e0f-9483-00ca78fa5a6a admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:21.089805 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 898/1789] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:11:21 2022] PUT /identity/v3/projects/f91464d4016047199f039982254a345d/users/d4c55f335ad5455ab3d6a7a367bf8637/roles/ea564961b1db4eb4a1d4d880964611b2 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:21.091338 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb558f24-9d92-429d-a9fb-ad4c07eb1c10 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:21.099166 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 892/1790] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:11:21 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:11:21.103886 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b2fa72-6a0c-4e0f-9483-00ca78fa5a6a admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:21.116004 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:21.128721 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b2fa72-6a0c-4e0f-9483-00ca78fa5a6a admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:21.179655 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb558f24-9d92-429d-a9fb-ad4c07eb1c10 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:21.205798 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f422cf-e6a5-40dd-a58a-048e9b3cb3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:21.206645 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f422cf-e6a5-40dd-a58a-048e9b3cb3e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:21.208001 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f422cf-e6a5-40dd-a58a-048e9b3cb3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:21.208341 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f422cf-e6a5-40dd-a58a-048e9b3cb3e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:21.209320 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f422cf-e6a5-40dd-a58a-048e9b3cb3e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:21.212273 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f422cf-e6a5-40dd-a58a-048e9b3cb3e7 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:21.227588 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 899/1791] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:11:21 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:11:21.231969 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f422cf-e6a5-40dd-a58a-048e9b3cb3e7 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:21.233851 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ccc45-2cd2-41b4-b3cc-1ae04a3ab325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:21.234805 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ccc45-2cd2-41b4-b3cc-1ae04a3ab325 admin admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:21.235293 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ccc45-2cd2-41b4-b3cc-1ae04a3ab325 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:21.235639 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ccc45-2cd2-41b4-b3cc-1ae04a3ab325 admin admin] PATH_INFO: `/v3/projects/096e5701d0f14029a62690f9cdbba37f/users/d58260446c094b589b6500195c29f05f/roles/7c3871c0ab68438b9014489d50b53a22` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:21.243295 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f422cf-e6a5-40dd-a58a-048e9b3cb3e7 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:21.249446 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0742532-7a10-429e-8919-25990fa8c175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:21.253200 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0742532-7a10-429e-8919-25990fa8c175 admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:21.253484 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0742532-7a10-429e-8919-25990fa8c175 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:21.253764 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0742532-7a10-429e-8919-25990fa8c175 admin admin] PATH_INFO: `/v3/projects/f91464d4016047199f039982254a345d/users/d4c55f335ad5455ab3d6a7a367bf8637/roles/ea564961b1db4eb4a1d4d880964611b2` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:21.256209 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0742532-7a10-429e-8919-25990fa8c175 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f91464d4016047199f039982254a345d, user_id=d4c55f335ad5455ab3d6a7a367bf8637, role_id=ea564961b1db4eb4a1d4d880964611b2)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:21.259244 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0742532-7a10-429e-8919-25990fa8c175 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:21.273682 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 900/1792] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:11:21 2022] PUT /identity/v3/projects/f91464d4016047199f039982254a345d/users/d4c55f335ad5455ab3d6a7a367bf8637/roles/ea564961b1db4eb4a1d4d880964611b2 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:21.281774 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284ccc45-2cd2-41b4-b3cc-1ae04a3ab325 admin admin] RBAC: Authorizing `identity:create_grant(project_id=096e5701d0f14029a62690f9cdbba37f, user_id=d58260446c094b589b6500195c29f05f, role_id=7c3871c0ab68438b9014489d50b53a22)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:21.284221 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae04e151-a834-4bff-8ccd-ae12cf216d07 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:21.284515 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae04e151-a834-4bff-8ccd-ae12cf216d07 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:21.284793 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae04e151-a834-4bff-8ccd-ae12cf216d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:21.288340 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284ccc45-2cd2-41b4-b3cc-1ae04a3ab325 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:21.322030 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 893/1793] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:11:21 2022] PUT /identity/v3/projects/096e5701d0f14029a62690f9cdbba37f/users/d58260446c094b589b6500195c29f05f/roles/7c3871c0ab68438b9014489d50b53a22 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:21.324377 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66644d3-853f-459f-8412-f16a47aa3b8d None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:21.324377 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66644d3-853f-459f-8412-f16a47aa3b8d None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:21.324611 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66644d3-853f-459f-8412-f16a47aa3b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:21.350903 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-ae04e151-a834-4bff-8ccd-ae12cf216d07 None None] MFA Rules not processed for user `d4c55f335ad5455ab3d6a7a367bf8637`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:21.352151 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-ae04e151-a834-4bff-8ccd-ae12cf216d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:21.358950 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-a66644d3-853f-459f-8412-f16a47aa3b8d None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:21.360109 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-a66644d3-853f-459f-8412-f16a47aa3b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:21.453227 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 894/1794] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:11:21.463840 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 901/1795] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:21 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:11:21.471078 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66644d3-853f-459f-8412-f16a47aa3b8d None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:21.471078 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-a66644d3-853f-459f-8412-f16a47aa3b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:21.490158 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae04e151-a834-4bff-8ccd-ae12cf216d07 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:21.493078 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-ae04e151-a834-4bff-8ccd-ae12cf216d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:21.517248 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:21.562086 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66644d3-853f-459f-8412-f16a47aa3b8d None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:21.572286 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7006e2-f489-462a-8413-4ec5f5f49bde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:21.573095 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7006e2-f489-462a-8413-4ec5f5f49bde service neutron] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:21.573518 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7006e2-f489-462a-8413-4ec5f5f49bde service neutron] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:21.584712 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7006e2-f489-462a-8413-4ec5f5f49bde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:21.591679 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae04e151-a834-4bff-8ccd-ae12cf216d07 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:21.597595 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7006e2-f489-462a-8413-4ec5f5f49bde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:21.599992 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7006e2-f489-462a-8413-4ec5f5f49bde service neutron] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:21.600233 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311cfd3d-7bce-4ead-a5ef-b11f6503bfc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f4c2fc51f54f0e977648b13efaed1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:21.600870 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311cfd3d-7bce-4ead-a5ef-b11f6503bfc1 service cinder] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:21.601149 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311cfd3d-7bce-4ead-a5ef-b11f6503bfc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:21.601497 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311cfd3d-7bce-4ead-a5ef-b11f6503bfc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:21.612889 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311cfd3d-7bce-4ead-a5ef-b11f6503bfc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:21.614918 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311cfd3d-7bce-4ead-a5ef-b11f6503bfc1 service cinder] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:21.621414 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 895/1796] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:11:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:11:21.625832 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 902/1797] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:11:21 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:11:21.680808 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7006e2-f489-462a-8413-4ec5f5f49bde service neutron] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:21.682611 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-0d7006e2-f489-462a-8413-4ec5f5f49bde service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:21.695189 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7006e2-f489-462a-8413-4ec5f5f49bde service neutron] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:21.699076 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e817e4-b04f-480d-abff-f766f3b0499b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f4c2fc51f54f0e977648b13efaed1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:21.699653 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e817e4-b04f-480d-abff-f766f3b0499b service cinder] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:21.699933 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e817e4-b04f-480d-abff-f766f3b0499b service cinder] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:21.700200 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e817e4-b04f-480d-abff-f766f3b0499b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:21.728420 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:21.772111 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e817e4-b04f-480d-abff-f766f3b0499b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:21.773371 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e817e4-b04f-480d-abff-f766f3b0499b service cinder] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:21.783475 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 896/1798] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:11:21 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:11:22.026947 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311cfd3d-7bce-4ead-a5ef-b11f6503bfc1 service cinder] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:22.029216 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-311cfd3d-7bce-4ead-a5ef-b11f6503bfc1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:22.052703 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311cfd3d-7bce-4ead-a5ef-b11f6503bfc1 service cinder] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:22.059477 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5457566f-8a98-41bf-8b69-a7c9c3976220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:22.060182 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5457566f-8a98-41bf-8b69-a7c9c3976220 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:22.060477 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5457566f-8a98-41bf-8b69-a7c9c3976220 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:22.060746 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5457566f-8a98-41bf-8b69-a7c9c3976220 admin admin] PATH_INFO: `/v3/users/a259d19a61e9489fbde2627ab36c09d0` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:22.062029 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5457566f-8a98-41bf-8b69-a7c9c3976220 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a259d19a61e9489fbde2627ab36c09d0)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:22.064091 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5457566f-8a98-41bf-8b69-a7c9c3976220 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:22.128179 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-5457566f-8a98-41bf-8b69-a7c9c3976220 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a259d19a61e9489fbde2627ab36c09d0'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:22.129094 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-5457566f-8a98-41bf-8b69-a7c9c3976220 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a259d19a61e9489fbde2627ab36c09d0'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:22.130198 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-5457566f-8a98-41bf-8b69-a7c9c3976220 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a259d19a61e9489fbde2627ab36c09d0'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:22.150699 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-5457566f-8a98-41bf-8b69-a7c9c3976220 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a259d19a61e9489fbde2627ab36c09d0'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:22.165727 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-5457566f-8a98-41bf-8b69-a7c9c3976220 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a259d19a61e9489fbde2627ab36c09d0'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:22.204413 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 903/1799] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:11:22 2022] DELETE /identity/v3/users/a259d19a61e9489fbde2627ab36c09d0 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:22.209457 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69befec5-bf31-445c-adb2-35132c364286 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:22.210009 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69befec5-bf31-445c-adb2-35132c364286 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:22.210009 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69befec5-bf31-445c-adb2-35132c364286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:22.231718 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-69befec5-bf31-445c-adb2-35132c364286 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:22.233671 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-69befec5-bf31-445c-adb2-35132c364286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:22.309779 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 897/1800] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:11:22.317511 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5457566f-8a98-41bf-8b69-a7c9c3976220 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:22.319121 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-5457566f-8a98-41bf-8b69-a7c9c3976220 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:22.415574 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5457566f-8a98-41bf-8b69-a7c9c3976220 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:22.421182 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c3b361-f94c-48c9-a2c0-2aea6b0fa8dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:22.421813 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c3b361-f94c-48c9-a2c0-2aea6b0fa8dd service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:22.422118 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c3b361-f94c-48c9-a2c0-2aea6b0fa8dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:22.422393 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c3b361-f94c-48c9-a2c0-2aea6b0fa8dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:22.433579 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c3b361-f94c-48c9-a2c0-2aea6b0fa8dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:22.435035 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c3b361-f94c-48c9-a2c0-2aea6b0fa8dd service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:22.445330 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 904/1801] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:11:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 13 11:11:23.283612 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69befec5-bf31-445c-adb2-35132c364286 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:23.287629 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-69befec5-bf31-445c-adb2-35132c364286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:23.350041 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69befec5-bf31-445c-adb2-35132c364286 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:23.357814 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d9ca56-6556-4a46-be76-9a7a5313f084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:23.358646 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9ca56-6556-4a46-be76-9a7a5313f084 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:23.358905 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9ca56-6556-4a46-be76-9a7a5313f084 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:23.359583 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9ca56-6556-4a46-be76-9a7a5313f084 admin admin] PATH_INFO: `/v3/projects/7ac061f6376d4bc9a09864834ec85736` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:23.360766 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d9ca56-6556-4a46-be76-9a7a5313f084 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ac061f6376d4bc9a09864834ec85736)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:23.363073 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d9ca56-6556-4a46-be76-9a7a5313f084 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:23.466983 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-a4d9ca56-6556-4a46-be76-9a7a5313f084 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ac061f6376d4bc9a09864834ec85736', 'request_id': 'req-a4d9ca56-6556-4a46-be76-9a7a5313f084'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:23.474722 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-a4d9ca56-6556-4a46-be76-9a7a5313f084 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ac061f6376d4bc9a09864834ec85736', 'request_id': 'req-a4d9ca56-6556-4a46-be76-9a7a5313f084'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:23.481780 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-a4d9ca56-6556-4a46-be76-9a7a5313f084 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ac061f6376d4bc9a09864834ec85736', 'request_id': 'req-a4d9ca56-6556-4a46-be76-9a7a5313f084'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:23.512381 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-a4d9ca56-6556-4a46-be76-9a7a5313f084 admin admin] The token cache is being invalidate because project 7ac061f6376d4bc9a09864834ec85736 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:11:23.512678 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-a4d9ca56-6556-4a46-be76-9a7a5313f084 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:23.513408 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-a4d9ca56-6556-4a46-be76-9a7a5313f084 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:23.519453 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 898/1802] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:11:23 2022] DELETE /identity/v3/projects/7ac061f6376d4bc9a09864834ec85736 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:23.520460 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3e21a-9e98-4996-979a-ff454fadd3ff None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:23.520912 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3e21a-9e98-4996-979a-ff454fadd3ff None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:23.521022 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3e21a-9e98-4996-979a-ff454fadd3ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:23.552088 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-e6c3e21a-9e98-4996-979a-ff454fadd3ff None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:23.553318 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-e6c3e21a-9e98-4996-979a-ff454fadd3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:23.617036 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:23.673979 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 905/1803] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 11:11:23.683055 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3bd17e-e05b-423b-ad2e-3352df3d2a8a None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:23.683339 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3bd17e-e05b-423b-ad2e-3352df3d2a8a None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:23.683655 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3bd17e-e05b-423b-ad2e-3352df3d2a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:23.705592 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-2a3bd17e-e05b-423b-ad2e-3352df3d2a8a None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:23.707847 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-2a3bd17e-e05b-423b-ad2e-3352df3d2a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:23.717604 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 899/1804] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 11:11:23.722765 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c3e21a-9e98-4996-979a-ff454fadd3ff None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:23.736703 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c3e21a-9e98-4996-979a-ff454fadd3ff None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:23.743656 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fadc190-d4ea-4ccc-b4ba-6991a0aae001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:23.744286 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fadc190-d4ea-4ccc-b4ba-6991a0aae001 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:23.744805 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fadc190-d4ea-4ccc-b4ba-6991a0aae001 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:23.744928 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fadc190-d4ea-4ccc-b4ba-6991a0aae001 admin admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:23.745483 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fadc190-d4ea-4ccc-b4ba-6991a0aae001 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:11:23.745968 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fadc190-d4ea-4ccc-b4ba-6991a0aae001 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:23.747846 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fadc190-d4ea-4ccc-b4ba-6991a0aae001 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:23.761440 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 906/1805] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 11:11:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:11:23.768098 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3bd17e-e05b-423b-ad2e-3352df3d2a8a None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:23.780036 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3bd17e-e05b-423b-ad2e-3352df3d2a8a None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:23.787054 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9854ecc0-14fc-4e8e-b067-4c00d3095c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:23.787661 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854ecc0-14fc-4e8e-b067-4c00d3095c0d admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:23.787948 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854ecc0-14fc-4e8e-b067-4c00d3095c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:23.788217 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854ecc0-14fc-4e8e-b067-4c00d3095c0d admin admin] PATH_INFO: `/v3/projects` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:23.788859 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9854ecc0-14fc-4e8e-b067-4c00d3095c0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:23.790775 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9854ecc0-14fc-4e8e-b067-4c00d3095c0d admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:23.830059 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 900/1806] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:11:23 2022] POST /identity/v3/projects => generated 375 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:11:23.831191 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fadc190-d4ea-4ccc-b4ba-6991a0aae001 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:23.842577 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fadc190-d4ea-4ccc-b4ba-6991a0aae001 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:23.933910 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e54fb1-2d9d-4ed0-8408-80b5dca9be5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:23.934898 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e54fb1-2d9d-4ed0-8408-80b5dca9be5b admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:23.935182 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e54fb1-2d9d-4ed0-8408-80b5dca9be5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:23.935458 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e54fb1-2d9d-4ed0-8408-80b5dca9be5b admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:23.936468 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e54fb1-2d9d-4ed0-8408-80b5dca9be5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:23.940376 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e54fb1-2d9d-4ed0-8408-80b5dca9be5b admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:23.976024 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 907/1807] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:11:23 2022] POST /identity/v3/users => generated 288 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 11:11:23.977679 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9854ecc0-14fc-4e8e-b067-4c00d3095c0d admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:24.000229 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9854ecc0-14fc-4e8e-b067-4c00d3095c0d admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:24.005864 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045a45c5-680f-4194-acfc-1f498e1a5e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:24.006584 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a45c5-680f-4194-acfc-1f498e1a5e9e admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:24.006870 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a45c5-680f-4194-acfc-1f498e1a5e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:24.007169 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a45c5-680f-4194-acfc-1f498e1a5e9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:24.007970 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045a45c5-680f-4194-acfc-1f498e1a5e9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:24.009759 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045a45c5-680f-4194-acfc-1f498e1a5e9e admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:24.042264 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 901/1808] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:11:24.043177 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e54fb1-2d9d-4ed0-8408-80b5dca9be5b admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:24.058231 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e54fb1-2d9d-4ed0-8408-80b5dca9be5b admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:24.072127 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d8a158-2b6f-4669-8498-6ff818cfb26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:24.075125 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8a158-2b6f-4669-8498-6ff818cfb26d admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:24.075493 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8a158-2b6f-4669-8498-6ff818cfb26d admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:24.076777 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8a158-2b6f-4669-8498-6ff818cfb26d admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:24.077532 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d8a158-2b6f-4669-8498-6ff818cfb26d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:24.079202 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d8a158-2b6f-4669-8498-6ff818cfb26d admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:24.092192 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 908/1809] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 13 11:11:24.096855 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045a45c5-680f-4194-acfc-1f498e1a5e9e admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:24.108429 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045a45c5-680f-4194-acfc-1f498e1a5e9e admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:24.117822 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b34e5-0327-4edf-adb5-0ba6f9cdebbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:24.119002 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b34e5-0327-4edf-adb5-0ba6f9cdebbe admin admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:24.119728 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b34e5-0327-4edf-adb5-0ba6f9cdebbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:24.120160 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b34e5-0327-4edf-adb5-0ba6f9cdebbe admin admin] PATH_INFO: `/v3/projects/5dd14725c7c04548ad29caf9c71afb73/users/56d032f318a44a33b87841975328899f/roles/7c3871c0ab68438b9014489d50b53a22` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:24.139417 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:24.150634 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2b34e5-0327-4edf-adb5-0ba6f9cdebbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dd14725c7c04548ad29caf9c71afb73, user_id=56d032f318a44a33b87841975328899f, role_id=7c3871c0ab68438b9014489d50b53a22)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:24.155166 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2b34e5-0327-4edf-adb5-0ba6f9cdebbe admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:24.187393 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 902/1810] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:11:24 2022] PUT /identity/v3/projects/5dd14725c7c04548ad29caf9c71afb73/users/56d032f318a44a33b87841975328899f/roles/7c3871c0ab68438b9014489d50b53a22 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:24.198796 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c236c4c1-cc76-4c5a-8974-e7f9fd2a2a90 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:24.199366 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c236c4c1-cc76-4c5a-8974-e7f9fd2a2a90 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:24.199868 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c236c4c1-cc76-4c5a-8974-e7f9fd2a2a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:24.261402 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-c236c4c1-cc76-4c5a-8974-e7f9fd2a2a90 None None] MFA Rules not processed for user `56d032f318a44a33b87841975328899f`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:24.262722 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-c236c4c1-cc76-4c5a-8974-e7f9fd2a2a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:24.352371 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 909/1811] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:11:24.363218 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b34e5-0327-4edf-adb5-0ba6f9cdebbe admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:24.365260 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-8a2b34e5-0327-4edf-adb5-0ba6f9cdebbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:24.465386 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b34e5-0327-4edf-adb5-0ba6f9cdebbe admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:24.470947 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ba2bf8-6dd4-4210-ace0-aa2522919f1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f4c2fc51f54f0e977648b13efaed1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:24.472694 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba2bf8-6dd4-4210-ace0-aa2522919f1f service cinder] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:24.473513 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba2bf8-6dd4-4210-ace0-aa2522919f1f service cinder] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:24.474934 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba2bf8-6dd4-4210-ace0-aa2522919f1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:24.489140 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ba2bf8-6dd4-4210-ace0-aa2522919f1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:24.494173 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ba2bf8-6dd4-4210-ace0-aa2522919f1f service cinder] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:24.527985 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 903/1812] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:11:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:11:25.774087 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c236c4c1-cc76-4c5a-8974-e7f9fd2a2a90 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:25.776174 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-c236c4c1-cc76-4c5a-8974-e7f9fd2a2a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:25.834785 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:25.878153 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c236c4c1-cc76-4c5a-8974-e7f9fd2a2a90 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:25.884384 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc825c3-b1c3-429b-b1e7-9d19289c4f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:25.885039 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc825c3-b1c3-429b-b1e7-9d19289c4f2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:25.885446 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc825c3-b1c3-429b-b1e7-9d19289c4f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:25.886135 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc825c3-b1c3-429b-b1e7-9d19289c4f2e admin admin] PATH_INFO: `/v3/users/c627f48cbd9647e986e2c9edffd3fdc0` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:25.894081 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc825c3-b1c3-429b-b1e7-9d19289c4f2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c627f48cbd9647e986e2c9edffd3fdc0)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:25.897404 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc825c3-b1c3-429b-b1e7-9d19289c4f2e admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:25.958267 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-9cc825c3-b1c3-429b-b1e7-9d19289c4f2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c627f48cbd9647e986e2c9edffd3fdc0'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:25.958895 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-9cc825c3-b1c3-429b-b1e7-9d19289c4f2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c627f48cbd9647e986e2c9edffd3fdc0'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:25.961187 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-9cc825c3-b1c3-429b-b1e7-9d19289c4f2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c627f48cbd9647e986e2c9edffd3fdc0'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:25.974860 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-9cc825c3-b1c3-429b-b1e7-9d19289c4f2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c627f48cbd9647e986e2c9edffd3fdc0'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:25.984820 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-9cc825c3-b1c3-429b-b1e7-9d19289c4f2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c627f48cbd9647e986e2c9edffd3fdc0'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:26.002012 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 910/1813] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:11:25 2022] DELETE /identity/v3/users/c627f48cbd9647e986e2c9edffd3fdc0 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:26.003639 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701cc4a9-5aef-4b23-b90d-67f5136e8022 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:26.004746 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701cc4a9-5aef-4b23-b90d-67f5136e8022 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:26.004922 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701cc4a9-5aef-4b23-b90d-67f5136e8022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:26.026467 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-701cc4a9-5aef-4b23-b90d-67f5136e8022 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:26.027857 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-701cc4a9-5aef-4b23-b90d-67f5136e8022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:26.104951 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 904/1814] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:11:26.117005 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc825c3-b1c3-429b-b1e7-9d19289c4f2e admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:26.120643 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-9cc825c3-b1c3-429b-b1e7-9d19289c4f2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:26.262393 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc825c3-b1c3-429b-b1e7-9d19289c4f2e admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:26.266586 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07be24e-8d77-446d-838d-7608ec298864 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:26.267348 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07be24e-8d77-446d-838d-7608ec298864 service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:26.267644 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07be24e-8d77-446d-838d-7608ec298864 service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:26.267948 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07be24e-8d77-446d-838d-7608ec298864 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:26.281772 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07be24e-8d77-446d-838d-7608ec298864 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:26.283356 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07be24e-8d77-446d-838d-7608ec298864 service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:26.299077 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 911/1815] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:11:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:11:26.797387 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701cc4a9-5aef-4b23-b90d-67f5136e8022 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:26.804225 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-701cc4a9-5aef-4b23-b90d-67f5136e8022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:26.820811 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701cc4a9-5aef-4b23-b90d-67f5136e8022 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:26.828108 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6056e0-a5a4-4de9-9404-0c7464e07c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:26.829302 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6056e0-a5a4-4de9-9404-0c7464e07c21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:26.829870 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6056e0-a5a4-4de9-9404-0c7464e07c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:26.830460 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6056e0-a5a4-4de9-9404-0c7464e07c21 admin admin] PATH_INFO: `/v3/projects/3465a317bf6c4b35874f2bf5d1829f8f` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:26.831837 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6056e0-a5a4-4de9-9404-0c7464e07c21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3465a317bf6c4b35874f2bf5d1829f8f)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:26.833811 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6056e0-a5a4-4de9-9404-0c7464e07c21 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:26.946008 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-4b6056e0-a5a4-4de9-9404-0c7464e07c21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3465a317bf6c4b35874f2bf5d1829f8f', 'request_id': 'req-4b6056e0-a5a4-4de9-9404-0c7464e07c21'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:26.955241 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-4b6056e0-a5a4-4de9-9404-0c7464e07c21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3465a317bf6c4b35874f2bf5d1829f8f', 'request_id': 'req-4b6056e0-a5a4-4de9-9404-0c7464e07c21'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:26.963702 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-4b6056e0-a5a4-4de9-9404-0c7464e07c21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3465a317bf6c4b35874f2bf5d1829f8f', 'request_id': 'req-4b6056e0-a5a4-4de9-9404-0c7464e07c21'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:26.991307 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-4b6056e0-a5a4-4de9-9404-0c7464e07c21 admin admin] The token cache is being invalidate because project 3465a317bf6c4b35874f2bf5d1829f8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:11:26.991601 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-4b6056e0-a5a4-4de9-9404-0c7464e07c21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:26.992730 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-4b6056e0-a5a4-4de9-9404-0c7464e07c21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:26.994835 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 905/1816] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:11:26 2022] DELETE /identity/v3/projects/3465a317bf6c4b35874f2bf5d1829f8f => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:26.999292 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07be24e-8d77-446d-838d-7608ec298864 service neutron] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:27.013141 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07be24e-8d77-446d-838d-7608ec298864 service neutron] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:27.075634 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:27.083716 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a4669-3667-41a0-b749-a5a9d0ac4243 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:27.084216 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a4669-3667-41a0-b749-a5a9d0ac4243 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:27.084297 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a4669-3667-41a0-b749-a5a9d0ac4243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:27.113267 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fa8325-0aa6-42cc-b1c8-842351f35f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:27.116525 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa8325-0aa6-42cc-b1c8-842351f35f90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:27.117536 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa8325-0aa6-42cc-b1c8-842351f35f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:27.118030 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa8325-0aa6-42cc-b1c8-842351f35f90 admin admin] PATH_INFO: `/v3/users/d4c55f335ad5455ab3d6a7a367bf8637` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:27.122126 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fa8325-0aa6-42cc-b1c8-842351f35f90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4c55f335ad5455ab3d6a7a367bf8637)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:27.124818 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fa8325-0aa6-42cc-b1c8-842351f35f90 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:27.127572 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:27.131656 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-3a1a4669-3667-41a0-b749-a5a9d0ac4243 None None] MFA Rules not processed for user `d58260446c094b589b6500195c29f05f`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:27.139339 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-3a1a4669-3667-41a0-b749-a5a9d0ac4243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:27.246707 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-79fa8325-0aa6-42cc-b1c8-842351f35f90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4c55f335ad5455ab3d6a7a367bf8637'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:27.247394 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-79fa8325-0aa6-42cc-b1c8-842351f35f90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4c55f335ad5455ab3d6a7a367bf8637'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:27.248275 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-79fa8325-0aa6-42cc-b1c8-842351f35f90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4c55f335ad5455ab3d6a7a367bf8637'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:27.272709 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-79fa8325-0aa6-42cc-b1c8-842351f35f90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4c55f335ad5455ab3d6a7a367bf8637'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:27.286205 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-79fa8325-0aa6-42cc-b1c8-842351f35f90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4c55f335ad5455ab3d6a7a367bf8637'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:27.288569 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 906/1817] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:11:27.304861 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 912/1818] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:11:26 2022] DELETE /identity/v3/users/d4c55f335ad5455ab3d6a7a367bf8637 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:27.307827 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1a4669-3667-41a0-b749-a5a9d0ac4243 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:27.309490 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-3a1a4669-3667-41a0-b749-a5a9d0ac4243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:27.413265 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1a4669-3667-41a0-b749-a5a9d0ac4243 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:27.490033 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ac55b8-8878-4ed8-a9bc-e7edc23819fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78384fbffdd346578855e7214b335d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:27.490335 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac55b8-8878-4ed8-a9bc-e7edc23819fa service nova] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:27.491947 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac55b8-8878-4ed8-a9bc-e7edc23819fa service nova] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:27.491947 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac55b8-8878-4ed8-a9bc-e7edc23819fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:27.563643 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:27.588669 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ac55b8-8878-4ed8-a9bc-e7edc23819fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:27.590434 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ac55b8-8878-4ed8-a9bc-e7edc23819fa service nova] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:27.611345 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 907/1819] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:11:27 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:11:27.752196 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fa8325-0aa6-42cc-b1c8-842351f35f90 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:27.754179 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-79fa8325-0aa6-42cc-b1c8-842351f35f90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:27.949207 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fa8325-0aa6-42cc-b1c8-842351f35f90 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:27.971417 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f1f3e9-74b9-414c-be53-78586d0fae30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:27.972177 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1f3e9-74b9-414c-be53-78586d0fae30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:27.972463 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1f3e9-74b9-414c-be53-78586d0fae30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:27.972742 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1f3e9-74b9-414c-be53-78586d0fae30 admin admin] PATH_INFO: `/v3/projects/f91464d4016047199f039982254a345d` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:27.974132 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f1f3e9-74b9-414c-be53-78586d0fae30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f91464d4016047199f039982254a345d)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:27.976392 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f1f3e9-74b9-414c-be53-78586d0fae30 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:28.063481 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-51f1f3e9-74b9-414c-be53-78586d0fae30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f91464d4016047199f039982254a345d', 'request_id': 'req-51f1f3e9-74b9-414c-be53-78586d0fae30'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:28.076245 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-51f1f3e9-74b9-414c-be53-78586d0fae30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f91464d4016047199f039982254a345d', 'request_id': 'req-51f1f3e9-74b9-414c-be53-78586d0fae30'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:28.110232 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-51f1f3e9-74b9-414c-be53-78586d0fae30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f91464d4016047199f039982254a345d', 'request_id': 'req-51f1f3e9-74b9-414c-be53-78586d0fae30'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:28.120905 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:28.128423 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-51f1f3e9-74b9-414c-be53-78586d0fae30 admin admin] The token cache is being invalidate because project f91464d4016047199f039982254a345d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:11:28.129634 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-51f1f3e9-74b9-414c-be53-78586d0fae30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:28.131024 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-51f1f3e9-74b9-414c-be53-78586d0fae30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:28.133693 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 913/1820] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:11:27 2022] DELETE /identity/v3/projects/f91464d4016047199f039982254a345d => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:28.138569 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b87eaf9-2e09-4d97-9fa7-8d3c3cdc0b0a None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:28.139074 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b87eaf9-2e09-4d97-9fa7-8d3c3cdc0b0a None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:28.139155 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b87eaf9-2e09-4d97-9fa7-8d3c3cdc0b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:28.181666 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-3b87eaf9-2e09-4d97-9fa7-8d3c3cdc0b0a None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:28.182960 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-3b87eaf9-2e09-4d97-9fa7-8d3c3cdc0b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:28.285988 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 908/1821] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:11:28.300113 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab95de8-5c2c-45f0-b216-645f6a19641a None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:28.300399 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab95de8-5c2c-45f0-b216-645f6a19641a None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:28.300675 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab95de8-5c2c-45f0-b216-645f6a19641a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:28.346545 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-9ab95de8-5c2c-45f0-b216-645f6a19641a None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:28.347912 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-9ab95de8-5c2c-45f0-b216-645f6a19641a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:28.367008 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 914/1822] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:11:28.367865 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b87eaf9-2e09-4d97-9fa7-8d3c3cdc0b0a None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:28.383269 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b87eaf9-2e09-4d97-9fa7-8d3c3cdc0b0a None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:28.390261 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca485ce3-bbd0-4a14-a0ba-d8cfd68c0140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:28.392432 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca485ce3-bbd0-4a14-a0ba-d8cfd68c0140 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:28.392721 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca485ce3-bbd0-4a14-a0ba-d8cfd68c0140 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:28.393032 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca485ce3-bbd0-4a14-a0ba-d8cfd68c0140 admin admin] PATH_INFO: `/v3/domains` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:28.394844 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca485ce3-bbd0-4a14-a0ba-d8cfd68c0140 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:11:28.395199 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca485ce3-bbd0-4a14-a0ba-d8cfd68c0140 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:28.397070 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca485ce3-bbd0-4a14-a0ba-d8cfd68c0140 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:28.414835 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 909/1823] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 11:11:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 11:11:28.419676 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab95de8-5c2c-45f0-b216-645f6a19641a None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:28.430692 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab95de8-5c2c-45f0-b216-645f6a19641a None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:28.436889 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21feca31-6ea1-4258-a89b-c99eda1176d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:28.437562 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21feca31-6ea1-4258-a89b-c99eda1176d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:28.437865 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21feca31-6ea1-4258-a89b-c99eda1176d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:28.438400 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21feca31-6ea1-4258-a89b-c99eda1176d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:28.439100 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21feca31-6ea1-4258-a89b-c99eda1176d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:28.441357 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21feca31-6ea1-4258-a89b-c99eda1176d8 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:28.481507 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 915/1824] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:11:28 2022] POST /identity/v3/projects => generated 383 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:11:28.482378 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca485ce3-bbd0-4a14-a0ba-d8cfd68c0140 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:28.495968 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca485ce3-bbd0-4a14-a0ba-d8cfd68c0140 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:28.602317 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62a3554-2352-4e59-a126-fb6026289354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:28.603006 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a3554-2352-4e59-a126-fb6026289354 admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:28.603333 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a3554-2352-4e59-a126-fb6026289354 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:28.603588 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a3554-2352-4e59-a126-fb6026289354 admin admin] PATH_INFO: `/v3/users` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:28.604230 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62a3554-2352-4e59-a126-fb6026289354 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:28.606205 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62a3554-2352-4e59-a126-fb6026289354 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:28.633983 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 910/1825] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:11:28 2022] POST /identity/v3/users => generated 292 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 11:11:28.635586 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21feca31-6ea1-4258-a89b-c99eda1176d8 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:28.649514 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21feca31-6ea1-4258-a89b-c99eda1176d8 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:28.656319 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3afdb3-6882-4e26-a445-fb659d2366b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:28.656942 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3afdb3-6882-4e26-a445-fb659d2366b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:28.657219 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3afdb3-6882-4e26-a445-fb659d2366b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:28.657489 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3afdb3-6882-4e26-a445-fb659d2366b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:28.658182 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3afdb3-6882-4e26-a445-fb659d2366b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:28.659778 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3afdb3-6882-4e26-a445-fb659d2366b5 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:28.673983 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 916/1826] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:11:28.675615 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62a3554-2352-4e59-a126-fb6026289354 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:28.686185 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62a3554-2352-4e59-a126-fb6026289354 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:28.690923 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa578dd2-4fd8-4f27-bea2-da4884cc1752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:28.691562 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa578dd2-4fd8-4f27-bea2-da4884cc1752 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:28.691840 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa578dd2-4fd8-4f27-bea2-da4884cc1752 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:28.692109 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa578dd2-4fd8-4f27-bea2-da4884cc1752 admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:28.692762 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa578dd2-4fd8-4f27-bea2-da4884cc1752 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:28.694872 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa578dd2-4fd8-4f27-bea2-da4884cc1752 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:28.705753 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 911/1827] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:11:28.712656 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3afdb3-6882-4e26-a445-fb659d2366b5 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:28.727045 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3afdb3-6882-4e26-a445-fb659d2366b5 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:28.734533 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab716cb-0679-4870-8020-a5ce859cacc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:28.735228 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab716cb-0679-4870-8020-a5ce859cacc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:28.736974 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab716cb-0679-4870-8020-a5ce859cacc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:28.737281 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab716cb-0679-4870-8020-a5ce859cacc9 admin admin] PATH_INFO: `/v3/projects/23febbebe6084d34af47f8acad187a78/users/2b79e0d4452b440381a019dcdf30ba54/roles/7c3871c0ab68438b9014489d50b53a22` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:28.755813 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab716cb-0679-4870-8020-a5ce859cacc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23febbebe6084d34af47f8acad187a78, user_id=2b79e0d4452b440381a019dcdf30ba54, role_id=7c3871c0ab68438b9014489d50b53a22)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:28.758547 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab716cb-0679-4870-8020-a5ce859cacc9 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:28.772142 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 917/1828] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:11:28 2022] PUT /identity/v3/projects/23febbebe6084d34af47f8acad187a78/users/2b79e0d4452b440381a019dcdf30ba54/roles/7c3871c0ab68438b9014489d50b53a22 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:28.782328 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea67dd7-80a3-4c64-89de-030efe9f173a None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:28.782619 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea67dd7-80a3-4c64-89de-030efe9f173a None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:28.782898 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea67dd7-80a3-4c64-89de-030efe9f173a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:28.818301 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-1ea67dd7-80a3-4c64-89de-030efe9f173a None None] MFA Rules not processed for user `2b79e0d4452b440381a019dcdf30ba54`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:28.819524 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-1ea67dd7-80a3-4c64-89de-030efe9f173a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:28.872382 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:28.922556 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 912/1829] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:11:28.941510 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab716cb-0679-4870-8020-a5ce859cacc9 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:28.945103 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-3ab716cb-0679-4870-8020-a5ce859cacc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:29.028497 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab716cb-0679-4870-8020-a5ce859cacc9 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:29.033767 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c015ad0a-7bd5-430f-88fb-22305d24e4a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f4c2fc51f54f0e977648b13efaed1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:29.035192 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c015ad0a-7bd5-430f-88fb-22305d24e4a3 service cinder] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:29.035911 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c015ad0a-7bd5-430f-88fb-22305d24e4a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:29.036215 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c015ad0a-7bd5-430f-88fb-22305d24e4a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:29.047787 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c015ad0a-7bd5-430f-88fb-22305d24e4a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:29.049238 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c015ad0a-7bd5-430f-88fb-22305d24e4a3 service cinder] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:29.064592 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 918/1830] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:11:28 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:11:29.067597 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea67dd7-80a3-4c64-89de-030efe9f173a None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:29.069603 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-1ea67dd7-80a3-4c64-89de-030efe9f173a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:29.089173 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c015ad0a-7bd5-430f-88fb-22305d24e4a3 service cinder] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:29.183217 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea67dd7-80a3-4c64-89de-030efe9f173a None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:29.189717 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33fdd67-f2ce-44ee-b394-668edb099781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:29.190338 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33fdd67-f2ce-44ee-b394-668edb099781 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:29.190619 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33fdd67-f2ce-44ee-b394-668edb099781 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:29.190893 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33fdd67-f2ce-44ee-b394-668edb099781 admin admin] PATH_INFO: `/v3/users/19ac7e4ca71046bfae030d7a239bdc5c` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:29.192731 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33fdd67-f2ce-44ee-b394-668edb099781 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19ac7e4ca71046bfae030d7a239bdc5c)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:29.194681 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33fdd67-f2ce-44ee-b394-668edb099781 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:29.203118 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c015ad0a-7bd5-430f-88fb-22305d24e4a3 service cinder] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:29.217571 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d037f8-48d5-4763-b34b-c469b4a0121d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:29.218644 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d037f8-48d5-4763-b34b-c469b4a0121d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:29.218644 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d037f8-48d5-4763-b34b-c469b4a0121d admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:29.218919 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d037f8-48d5-4763-b34b-c469b4a0121d admin admin] PATH_INFO: `/v3/users/2b79e0d4452b440381a019dcdf30ba54` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:29.220255 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d037f8-48d5-4763-b34b-c469b4a0121d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b79e0d4452b440381a019dcdf30ba54)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:29.222375 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d037f8-48d5-4763-b34b-c469b4a0121d admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:29.269652 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-c33fdd67-f2ce-44ee-b394-668edb099781 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19ac7e4ca71046bfae030d7a239bdc5c'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:29.282198 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-c33fdd67-f2ce-44ee-b394-668edb099781 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19ac7e4ca71046bfae030d7a239bdc5c'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:29.282985 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-c33fdd67-f2ce-44ee-b394-668edb099781 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19ac7e4ca71046bfae030d7a239bdc5c'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:29.283918 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-c33fdd67-f2ce-44ee-b394-668edb099781 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19ac7e4ca71046bfae030d7a239bdc5c'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:29.286118 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:29.294122 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-82d037f8-48d5-4763-b34b-c469b4a0121d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b79e0d4452b440381a019dcdf30ba54'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:29.294978 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-82d037f8-48d5-4763-b34b-c469b4a0121d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b79e0d4452b440381a019dcdf30ba54'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:29.295597 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-c33fdd67-f2ce-44ee-b394-668edb099781 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19ac7e4ca71046bfae030d7a239bdc5c'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:29.295945 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-82d037f8-48d5-4763-b34b-c469b4a0121d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b79e0d4452b440381a019dcdf30ba54'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:29.315584 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-82d037f8-48d5-4763-b34b-c469b4a0121d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b79e0d4452b440381a019dcdf30ba54'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:29.318397 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 913/1831] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:11:29 2022] DELETE /identity/v3/users/19ac7e4ca71046bfae030d7a239bdc5c => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:29.322939 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35146057-4e2e-47d8-806e-4dfe7ec29758 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:29.323220 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35146057-4e2e-47d8-806e-4dfe7ec29758 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:29.323625 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35146057-4e2e-47d8-806e-4dfe7ec29758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:29.330386 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-82d037f8-48d5-4763-b34b-c469b4a0121d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b79e0d4452b440381a019dcdf30ba54'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:29.345310 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-35146057-4e2e-47d8-806e-4dfe7ec29758 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:29.346987 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-35146057-4e2e-47d8-806e-4dfe7ec29758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:29.355036 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 919/1832] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:11:29 2022] DELETE /identity/v3/users/2b79e0d4452b440381a019dcdf30ba54 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:29.357009 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc0e3e-3464-4514-8ed7-98ca0701deb0 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:29.357303 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc0e3e-3464-4514-8ed7-98ca0701deb0 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:29.357761 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc0e3e-3464-4514-8ed7-98ca0701deb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:29.387348 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-46cc0e3e-3464-4514-8ed7-98ca0701deb0 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:29.388880 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-46cc0e3e-3464-4514-8ed7-98ca0701deb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:29.413861 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:29.438041 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 914/1833] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 11:11:29.446981 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35146057-4e2e-47d8-806e-4dfe7ec29758 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:29.449498 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-35146057-4e2e-47d8-806e-4dfe7ec29758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:29.495568 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 920/1834] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:11:29.505733 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc0e3e-3464-4514-8ed7-98ca0701deb0 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:29.509125 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-46cc0e3e-3464-4514-8ed7-98ca0701deb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:29.536576 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35146057-4e2e-47d8-806e-4dfe7ec29758 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:29.540907 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e16aac-0b0f-4be5-a3ea-9765c09ce6d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:29.541628 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e16aac-0b0f-4be5-a3ea-9765c09ce6d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:29.542026 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e16aac-0b0f-4be5-a3ea-9765c09ce6d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:29.542399 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e16aac-0b0f-4be5-a3ea-9765c09ce6d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:29.558451 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e16aac-0b0f-4be5-a3ea-9765c09ce6d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:29.561042 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e16aac-0b0f-4be5-a3ea-9765c09ce6d6 service neutron] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:29.585735 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 915/1835] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:11:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:11:29.587235 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e3683-7c5d-4736-b323-1b69b025ea59 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:29.589333 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e3683-7c5d-4736-b323-1b69b025ea59 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:29.590440 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e3683-7c5d-4736-b323-1b69b025ea59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:29.615097 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-a00e3683-7c5d-4736-b323-1b69b025ea59 None None] MFA Rules not processed for user `d58260446c094b589b6500195c29f05f`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:29.616963 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-a00e3683-7c5d-4736-b323-1b69b025ea59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:29.638163 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc0e3e-3464-4514-8ed7-98ca0701deb0 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:29.645279 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a69d0-a559-411c-845e-858ac0a2222b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:29.646100 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a69d0-a559-411c-845e-858ac0a2222b service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:29.647077 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a69d0-a559-411c-845e-858ac0a2222b service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:29.647524 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a69d0-a559-411c-845e-858ac0a2222b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:29.671208 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3a69d0-a559-411c-845e-858ac0a2222b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:29.673652 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3a69d0-a559-411c-845e-858ac0a2222b service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:29.688838 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 921/1836] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:11:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:11:29.690198 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a69d0-a559-411c-845e-858ac0a2222b service neutron] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:29.691988 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-ed3a69d0-a559-411c-845e-858ac0a2222b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:29.693552 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 916/1837] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:11:29.714291 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a69d0-a559-411c-845e-858ac0a2222b service neutron] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:29.728002 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a14eb-39aa-49fd-8c2b-d5df70725404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:29.728699 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a14eb-39aa-49fd-8c2b-d5df70725404 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:29.728978 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a14eb-39aa-49fd-8c2b-d5df70725404 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:29.729251 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a14eb-39aa-49fd-8c2b-d5df70725404 admin admin] PATH_INFO: `/v3/users/f7dea86fcfdc41a4ac67bcd6e97e9535` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:29.730527 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4a14eb-39aa-49fd-8c2b-d5df70725404 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7dea86fcfdc41a4ac67bcd6e97e9535)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:29.732831 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4a14eb-39aa-49fd-8c2b-d5df70725404 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:29.796140 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-7b4a14eb-39aa-49fd-8c2b-d5df70725404 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7dea86fcfdc41a4ac67bcd6e97e9535'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:29.797451 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-7b4a14eb-39aa-49fd-8c2b-d5df70725404 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7dea86fcfdc41a4ac67bcd6e97e9535'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:29.798175 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-7b4a14eb-39aa-49fd-8c2b-d5df70725404 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7dea86fcfdc41a4ac67bcd6e97e9535'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:29.806387 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:29.819229 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-7b4a14eb-39aa-49fd-8c2b-d5df70725404 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7dea86fcfdc41a4ac67bcd6e97e9535'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:29.837080 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-7b4a14eb-39aa-49fd-8c2b-d5df70725404 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7dea86fcfdc41a4ac67bcd6e97e9535'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:29.865622 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 922/1838] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:11:29 2022] DELETE /identity/v3/users/f7dea86fcfdc41a4ac67bcd6e97e9535 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:29.869316 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523dd4b8-a33c-47e6-a4c3-b1aa211c554f None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:29.869676 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523dd4b8-a33c-47e6-a4c3-b1aa211c554f None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:29.870035 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523dd4b8-a33c-47e6-a4c3-b1aa211c554f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:29.918240 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-523dd4b8-a33c-47e6-a4c3-b1aa211c554f None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:29.919814 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-523dd4b8-a33c-47e6-a4c3-b1aa211c554f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:30.058963 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 917/1839] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:11:30.070284 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a14eb-39aa-49fd-8c2b-d5df70725404 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:30.071795 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-7b4a14eb-39aa-49fd-8c2b-d5df70725404 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:30.178147 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a14eb-39aa-49fd-8c2b-d5df70725404 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:30.182148 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4be877-f186-4e94-b563-eaed0da1b6ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:30.182944 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4be877-f186-4e94-b563-eaed0da1b6ba service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:30.183378 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4be877-f186-4e94-b563-eaed0da1b6ba service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:30.183836 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4be877-f186-4e94-b563-eaed0da1b6ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:30.195128 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4be877-f186-4e94-b563-eaed0da1b6ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:30.197024 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4be877-f186-4e94-b563-eaed0da1b6ba service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:30.209066 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 923/1840] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:11:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:11:30.389213 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523dd4b8-a33c-47e6-a4c3-b1aa211c554f None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:30.393809 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-523dd4b8-a33c-47e6-a4c3-b1aa211c554f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:30.421991 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4be877-f186-4e94-b563-eaed0da1b6ba service neutron] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:30.424360 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523dd4b8-a33c-47e6-a4c3-b1aa211c554f None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:30.427974 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-cd4be877-f186-4e94-b563-eaed0da1b6ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:30.440720 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dd7676-185d-4aeb-916f-2afc743b60dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:30.440720 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd7676-185d-4aeb-916f-2afc743b60dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:30.440720 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd7676-185d-4aeb-916f-2afc743b60dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:30.440720 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd7676-185d-4aeb-916f-2afc743b60dc admin admin] PATH_INFO: `/v3/projects/5977413e769b486e8542c54abb8c31ce` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:30.443659 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dd7676-185d-4aeb-916f-2afc743b60dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=5977413e769b486e8542c54abb8c31ce)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:30.448094 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dd7676-185d-4aeb-916f-2afc743b60dc admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:30.477452 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4be877-f186-4e94-b563-eaed0da1b6ba service neutron] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:30.492367 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4193e7a-930f-448a-a239-0130633dfa6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:30.492978 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4193e7a-930f-448a-a239-0130633dfa6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:30.493183 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4193e7a-930f-448a-a239-0130633dfa6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:30.493466 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4193e7a-930f-448a-a239-0130633dfa6a admin admin] PATH_INFO: `/v3/projects/23febbebe6084d34af47f8acad187a78` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:30.501738 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4193e7a-930f-448a-a239-0130633dfa6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=23febbebe6084d34af47f8acad187a78)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:30.504834 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4193e7a-930f-448a-a239-0130633dfa6a admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:30.529326 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:30.550087 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-60dd7676-185d-4aeb-916f-2afc743b60dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5977413e769b486e8542c54abb8c31ce', 'request_id': 'req-60dd7676-185d-4aeb-916f-2afc743b60dc'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:30.559702 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-60dd7676-185d-4aeb-916f-2afc743b60dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5977413e769b486e8542c54abb8c31ce', 'request_id': 'req-60dd7676-185d-4aeb-916f-2afc743b60dc'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:30.571554 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-60dd7676-185d-4aeb-916f-2afc743b60dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5977413e769b486e8542c54abb8c31ce', 'request_id': 'req-60dd7676-185d-4aeb-916f-2afc743b60dc'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:30.588679 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-60dd7676-185d-4aeb-916f-2afc743b60dc admin admin] The token cache is being invalidate because project 5977413e769b486e8542c54abb8c31ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:11:30.588885 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-60dd7676-185d-4aeb-916f-2afc743b60dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:30.589728 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-60dd7676-185d-4aeb-916f-2afc743b60dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:30.592305 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 918/1841] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:11:30 2022] DELETE /identity/v3/projects/5977413e769b486e8542c54abb8c31ce => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:30.597806 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c1dfe2-940b-4c48-881e-018007ef4a1e None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:30.598472 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c1dfe2-940b-4c48-881e-018007ef4a1e None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:30.598964 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c1dfe2-940b-4c48-881e-018007ef4a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:30.623555 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-b4193e7a-930f-448a-a239-0130633dfa6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23febbebe6084d34af47f8acad187a78', 'request_id': 'req-b4193e7a-930f-448a-a239-0130633dfa6a'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:30.625172 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-b1c1dfe2-940b-4c48-881e-018007ef4a1e None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:30.626864 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-b1c1dfe2-940b-4c48-881e-018007ef4a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:30.642366 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-b4193e7a-930f-448a-a239-0130633dfa6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23febbebe6084d34af47f8acad187a78', 'request_id': 'req-b4193e7a-930f-448a-a239-0130633dfa6a'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:30.651958 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-b4193e7a-930f-448a-a239-0130633dfa6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23febbebe6084d34af47f8acad187a78', 'request_id': 'req-b4193e7a-930f-448a-a239-0130633dfa6a'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:30.678279 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-b4193e7a-930f-448a-a239-0130633dfa6a admin admin] The token cache is being invalidate because project 23febbebe6084d34af47f8acad187a78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:11:30.678279 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-b4193e7a-930f-448a-a239-0130633dfa6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:30.678279 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-b4193e7a-930f-448a-a239-0130633dfa6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:30.681319 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 924/1842] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:11:30 2022] DELETE /identity/v3/projects/23febbebe6084d34af47f8acad187a78 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:30.687230 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdcf4ca-c375-4fb0-aaf0-82952cdea8a2 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:30.687567 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdcf4ca-c375-4fb0-aaf0-82952cdea8a2 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:30.688061 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdcf4ca-c375-4fb0-aaf0-82952cdea8a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:30.713118 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-afdcf4ca-c375-4fb0-aaf0-82952cdea8a2 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:30.714495 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-afdcf4ca-c375-4fb0-aaf0-82952cdea8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:30.767016 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 919/1843] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:11:30.770374 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e767ef89-787d-4dab-89c0-4b6595b6b5ab None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:30.771464 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e767ef89-787d-4dab-89c0-4b6595b6b5ab None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:30.771464 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e767ef89-787d-4dab-89c0-4b6595b6b5ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:30.815423 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-e767ef89-787d-4dab-89c0-4b6595b6b5ab None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:30.817205 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-e767ef89-787d-4dab-89c0-4b6595b6b5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:30.822578 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:30.844024 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 920/1844] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:11:30.848691 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e767ef89-787d-4dab-89c0-4b6595b6b5ab None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:30.851366 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 925/1845] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:11:30.864129 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e767ef89-787d-4dab-89c0-4b6595b6b5ab None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:30.867931 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d11657-1052-44e8-b94c-9e65652da350 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:30.869473 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d11657-1052-44e8-b94c-9e65652da350 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:30.869891 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d11657-1052-44e8-b94c-9e65652da350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:30.874678 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b1042-daa9-4980-ac85-274e012583e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:30.875303 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b1042-daa9-4980-ac85-274e012583e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:30.875584 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b1042-daa9-4980-ac85-274e012583e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:30.875874 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b1042-daa9-4980-ac85-274e012583e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:30.877041 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273b1042-daa9-4980-ac85-274e012583e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:11:30.878263 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273b1042-daa9-4980-ac85-274e012583e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:30.880415 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273b1042-daa9-4980-ac85-274e012583e8 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:30.934109 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 921/1846] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 11:11:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 11:11:30.935208 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b1042-daa9-4980-ac85-274e012583e8 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:30.940698 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-35d11657-1052-44e8-b94c-9e65652da350 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:30.942597 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-35d11657-1052-44e8-b94c-9e65652da350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:30.969623 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 926/1847] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:11:30.970721 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d11657-1052-44e8-b94c-9e65652da350 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:30.984715 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b1042-daa9-4980-ac85-274e012583e8 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:30.985741 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d11657-1052-44e8-b94c-9e65652da350 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:30.994684 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0582550b-d964-4404-892d-4aef8814996e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:30.995879 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0582550b-d964-4404-892d-4aef8814996e admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:30.996949 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0582550b-d964-4404-892d-4aef8814996e admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:30.998885 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0582550b-d964-4404-892d-4aef8814996e admin admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:31.000353 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0582550b-d964-4404-892d-4aef8814996e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:11:31.000733 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0582550b-d964-4404-892d-4aef8814996e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:31.002227 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a61aa2-daab-4c55-af94-d477e858b4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:31.002919 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0582550b-d964-4404-892d-4aef8814996e admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:31.003041 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a61aa2-daab-4c55-af94-d477e858b4c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:31.003323 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a61aa2-daab-4c55-af94-d477e858b4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:31.003599 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a61aa2-daab-4c55-af94-d477e858b4c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:31.004765 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a61aa2-daab-4c55-af94-d477e858b4c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:31.006692 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a61aa2-daab-4c55-af94-d477e858b4c1 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:31.023993 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 927/1848] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 11:11:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:11:31.028582 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0582550b-d964-4404-892d-4aef8814996e admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:31.032456 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-0582550b-d964-4404-892d-4aef8814996e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:31.073084 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 922/1849] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:11:30 2022] POST /identity/v3/projects => generated 375 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:11:31.074449 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a61aa2-daab-4c55-af94-d477e858b4c1 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:31.074961 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0582550b-d964-4404-892d-4aef8814996e admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:31.218654 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a61aa2-daab-4c55-af94-d477e858b4c1 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:31.245725 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9afd93-09bc-44e3-8416-5fda5563f808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:31.246399 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9afd93-09bc-44e3-8416-5fda5563f808 admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:31.246678 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9afd93-09bc-44e3-8416-5fda5563f808 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:31.246951 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9afd93-09bc-44e3-8416-5fda5563f808 admin admin] PATH_INFO: `/v3/projects` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:31.247850 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9afd93-09bc-44e3-8416-5fda5563f808 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:31.250039 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9afd93-09bc-44e3-8416-5fda5563f808 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:31.251244 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2502e9-5e9d-426b-a23d-4ab7705586d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:31.251868 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2502e9-5e9d-426b-a23d-4ab7705586d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:31.252146 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2502e9-5e9d-426b-a23d-4ab7705586d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:31.252418 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2502e9-5e9d-426b-a23d-4ab7705586d7 admin admin] PATH_INFO: `/v3/projects/e85f201ee5264a83a783d1553819de58` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:31.254714 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2502e9-5e9d-426b-a23d-4ab7705586d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e85f201ee5264a83a783d1553819de58)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:31.259082 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2502e9-5e9d-426b-a23d-4ab7705586d7 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:31.308852 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 923/1850] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:11:31 2022] POST /identity/v3/projects => generated 367 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:11:31.309996 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9afd93-09bc-44e3-8416-5fda5563f808 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:31.327744 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:31.351312 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-bb2502e9-5e9d-426b-a23d-4ab7705586d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e85f201ee5264a83a783d1553819de58', 'request_id': 'req-bb2502e9-5e9d-426b-a23d-4ab7705586d7'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:31.365642 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-bb2502e9-5e9d-426b-a23d-4ab7705586d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e85f201ee5264a83a783d1553819de58', 'request_id': 'req-bb2502e9-5e9d-426b-a23d-4ab7705586d7'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:31.377660 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-bb2502e9-5e9d-426b-a23d-4ab7705586d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e85f201ee5264a83a783d1553819de58', 'request_id': 'req-bb2502e9-5e9d-426b-a23d-4ab7705586d7'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:31.402739 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-bb2502e9-5e9d-426b-a23d-4ab7705586d7 admin admin] The token cache is being invalidate because project e85f201ee5264a83a783d1553819de58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:11:31.403034 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-bb2502e9-5e9d-426b-a23d-4ab7705586d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:31.406278 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-bb2502e9-5e9d-426b-a23d-4ab7705586d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:31.408044 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 928/1851] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:11:31 2022] DELETE /identity/v3/projects/e85f201ee5264a83a783d1553819de58 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:31.408779 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2502e9-5e9d-426b-a23d-4ab7705586d7 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:31.411930 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-bb2502e9-5e9d-426b-a23d-4ab7705586d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:31.417543 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9afd93-09bc-44e3-8416-5fda5563f808 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:31.523103 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2502e9-5e9d-426b-a23d-4ab7705586d7 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:31.533303 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc72d97-a29b-4f81-9452-cac30f719bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:31.533878 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50839a02-9f02-4532-9177-3a268c2e5c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:31.534685 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc72d97-a29b-4f81-9452-cac30f719bc8 admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:31.534965 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc72d97-a29b-4f81-9452-cac30f719bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:31.535796 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc72d97-a29b-4f81-9452-cac30f719bc8 admin admin] PATH_INFO: `/v3/users` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:31.536449 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc72d97-a29b-4f81-9452-cac30f719bc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:31.537058 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50839a02-9f02-4532-9177-3a268c2e5c86 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:31.537382 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50839a02-9f02-4532-9177-3a268c2e5c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:31.537655 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50839a02-9f02-4532-9177-3a268c2e5c86 admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:31.538314 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50839a02-9f02-4532-9177-3a268c2e5c86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:31.540286 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50839a02-9f02-4532-9177-3a268c2e5c86 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:31.544989 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc72d97-a29b-4f81-9452-cac30f719bc8 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:31.574188 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:31.584598 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 929/1852] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:11:31 2022] POST /identity/v3/users => generated 284 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:11:31.586017 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50839a02-9f02-4532-9177-3a268c2e5c86 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:31.588878 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-50839a02-9f02-4532-9177-3a268c2e5c86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:31.597265 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 924/1853] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:11:31 2022] POST /identity/v3/users => generated 288 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:11:31.598903 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc72d97-a29b-4f81-9452-cac30f719bc8 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:31.609129 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50839a02-9f02-4532-9177-3a268c2e5c86 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:31.616818 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb6eadc-7cd6-47de-aefe-a4ba1e4a23ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:31.622154 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb6eadc-7cd6-47de-aefe-a4ba1e4a23ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:31.622449 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb6eadc-7cd6-47de-aefe-a4ba1e4a23ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:31.623289 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb6eadc-7cd6-47de-aefe-a4ba1e4a23ee admin admin] PATH_INFO: `/v3/users/d4dd04f91197468d9f187844dbe092b4` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:31.625075 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc72d97-a29b-4f81-9452-cac30f719bc8 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:31.625204 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb6eadc-7cd6-47de-aefe-a4ba1e4a23ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4dd04f91197468d9f187844dbe092b4)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:31.627132 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb6eadc-7cd6-47de-aefe-a4ba1e4a23ee admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:31.639819 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a24d838-1339-47dc-8fb1-ae673ccc71ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:31.640519 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a24d838-1339-47dc-8fb1-ae673ccc71ff admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:31.640866 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a24d838-1339-47dc-8fb1-ae673ccc71ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:31.641137 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a24d838-1339-47dc-8fb1-ae673ccc71ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:31.641803 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a24d838-1339-47dc-8fb1-ae673ccc71ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:31.643585 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a24d838-1339-47dc-8fb1-ae673ccc71ff admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:31.663108 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 925/1854] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:11:31 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:11:31.668093 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a24d838-1339-47dc-8fb1-ae673ccc71ff admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:31.670241 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-1a24d838-1339-47dc-8fb1-ae673ccc71ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:31.697683 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a24d838-1339-47dc-8fb1-ae673ccc71ff admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:31.708464 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25995f0f-9858-40d6-b7c9-b744d01bb838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:31.709609 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25995f0f-9858-40d6-b7c9-b744d01bb838 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:31.710327 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25995f0f-9858-40d6-b7c9-b744d01bb838 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:31.714371 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25995f0f-9858-40d6-b7c9-b744d01bb838 admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:31.716272 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25995f0f-9858-40d6-b7c9-b744d01bb838 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:31.720046 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25995f0f-9858-40d6-b7c9-b744d01bb838 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:31.746563 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-1bb6eadc-7cd6-47de-aefe-a4ba1e4a23ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4dd04f91197468d9f187844dbe092b4'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:31.747440 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-1bb6eadc-7cd6-47de-aefe-a4ba1e4a23ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4dd04f91197468d9f187844dbe092b4'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:31.748913 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-1bb6eadc-7cd6-47de-aefe-a4ba1e4a23ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4dd04f91197468d9f187844dbe092b4'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:31.749470 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 926/1855] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:11:31 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:11:31.750582 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25995f0f-9858-40d6-b7c9-b744d01bb838 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:31.753379 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-25995f0f-9858-40d6-b7c9-b744d01bb838 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:31.778588 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-1bb6eadc-7cd6-47de-aefe-a4ba1e4a23ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4dd04f91197468d9f187844dbe092b4'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:31.788413 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25995f0f-9858-40d6-b7c9-b744d01bb838 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:31.791000 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-1bb6eadc-7cd6-47de-aefe-a4ba1e4a23ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4dd04f91197468d9f187844dbe092b4'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:31.794372 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f97e076-296f-48f4-8bb7-2eba0f16dfa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:31.795035 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f97e076-296f-48f4-8bb7-2eba0f16dfa9 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:31.795316 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f97e076-296f-48f4-8bb7-2eba0f16dfa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:31.795587 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f97e076-296f-48f4-8bb7-2eba0f16dfa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:31.796238 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f97e076-296f-48f4-8bb7-2eba0f16dfa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:31.798376 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f97e076-296f-48f4-8bb7-2eba0f16dfa9 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:31.810696 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 930/1856] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:11:31 2022] DELETE /identity/v3/users/d4dd04f91197468d9f187844dbe092b4 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:31.811600 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb6eadc-7cd6-47de-aefe-a4ba1e4a23ee admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:31.812461 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 927/1857] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:11:31 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:11:31.813313 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f97e076-296f-48f4-8bb7-2eba0f16dfa9 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:31.813470 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-1bb6eadc-7cd6-47de-aefe-a4ba1e4a23ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:31.838743 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f97e076-296f-48f4-8bb7-2eba0f16dfa9 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:31.935187 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb6eadc-7cd6-47de-aefe-a4ba1e4a23ee admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:31.948994 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf3f6ef-a849-470a-a4e5-e4a19c8bcff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:31.949760 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3f6ef-a849-470a-a4e5-e4a19c8bcff3 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:31.949927 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3f6ef-a849-470a-a4e5-e4a19c8bcff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:31.952288 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3f6ef-a849-470a-a4e5-e4a19c8bcff3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:31.953334 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf3f6ef-a849-470a-a4e5-e4a19c8bcff3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:31.956010 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5103d327-2153-4fb0-b7c2-736d89f03639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:31.957531 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5103d327-2153-4fb0-b7c2-736d89f03639 admin admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:31.958868 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5103d327-2153-4fb0-b7c2-736d89f03639 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:31.962347 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf3f6ef-a849-470a-a4e5-e4a19c8bcff3 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:31.965794 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5103d327-2153-4fb0-b7c2-736d89f03639 admin admin] PATH_INFO: `/v3/projects/876fe1ce99894974b12ca34987eb7bcb/users/4d7b7cdc8a0c4ebc81fee23a04702664/roles/7c3871c0ab68438b9014489d50b53a22` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:31.983689 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 931/1858] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:11:31 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:11:31.989517 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf3f6ef-a849-470a-a4e5-e4a19c8bcff3 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:32.005052 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf3f6ef-a849-470a-a4e5-e4a19c8bcff3 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:32.010902 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de1e7c9-8c24-4bd9-9b19-6362800c1654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:32.011645 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de1e7c9-8c24-4bd9-9b19-6362800c1654 admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:32.012229 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de1e7c9-8c24-4bd9-9b19-6362800c1654 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:32.012549 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de1e7c9-8c24-4bd9-9b19-6362800c1654 admin admin] PATH_INFO: `/v3/projects/cc2f85e6b0264ba3bd6456107baa3af9/users/829bdef4ab7443b49849565db575ce08/roles/7c3871c0ab68438b9014489d50b53a22` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:32.024666 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5103d327-2153-4fb0-b7c2-736d89f03639 admin admin] RBAC: Authorizing `identity:create_grant(project_id=876fe1ce99894974b12ca34987eb7bcb, user_id=4d7b7cdc8a0c4ebc81fee23a04702664, role_id=7c3871c0ab68438b9014489d50b53a22)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:32.031023 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de1e7c9-8c24-4bd9-9b19-6362800c1654 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc2f85e6b0264ba3bd6456107baa3af9, user_id=829bdef4ab7443b49849565db575ce08, role_id=7c3871c0ab68438b9014489d50b53a22)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:32.033486 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5103d327-2153-4fb0-b7c2-736d89f03639 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:32.034979 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de1e7c9-8c24-4bd9-9b19-6362800c1654 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:32.047181 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:32.058901 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 932/1859] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:11:31 2022] PUT /identity/v3/projects/cc2f85e6b0264ba3bd6456107baa3af9/users/829bdef4ab7443b49849565db575ce08/roles/7c3871c0ab68438b9014489d50b53a22 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 11:11:32.076991 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 928/1860] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:11:31 2022] PUT /identity/v3/projects/876fe1ce99894974b12ca34987eb7bcb/users/4d7b7cdc8a0c4ebc81fee23a04702664/roles/7c3871c0ab68438b9014489d50b53a22 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:32.077195 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec0a96-86a5-48a7-bb8b-ebeef77c646c None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:32.077195 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec0a96-86a5-48a7-bb8b-ebeef77c646c None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:32.077195 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec0a96-86a5-48a7-bb8b-ebeef77c646c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:32.080479 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721fbb96-3b32-4d1b-8a18-3b8e2c898da7 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:32.080766 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721fbb96-3b32-4d1b-8a18-3b8e2c898da7 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:32.081037 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721fbb96-3b32-4d1b-8a18-3b8e2c898da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:32.149088 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-721fbb96-3b32-4d1b-8a18-3b8e2c898da7 None None] MFA Rules not processed for user `4d7b7cdc8a0c4ebc81fee23a04702664`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:32.150796 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-721fbb96-3b32-4d1b-8a18-3b8e2c898da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:32.166835 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-32ec0a96-86a5-48a7-bb8b-ebeef77c646c None None] MFA Rules not processed for user `829bdef4ab7443b49849565db575ce08`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:32.168773 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-32ec0a96-86a5-48a7-bb8b-ebeef77c646c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:32.256266 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:32.336207 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 933/1861] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 11:11:32.340260 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ec0a96-86a5-48a7-bb8b-ebeef77c646c None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:32.349453 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 929/1862] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:11:32.368801 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721fbb96-3b32-4d1b-8a18-3b8e2c898da7 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:32.376004 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-721fbb96-3b32-4d1b-8a18-3b8e2c898da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:32.475816 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ec0a96-86a5-48a7-bb8b-ebeef77c646c None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:32.481958 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b0bfd8-b1a5-4a16-a5f1-d10d20755783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:32.482676 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0bfd8-b1a5-4a16-a5f1-d10d20755783 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:32.483021 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0bfd8-b1a5-4a16-a5f1-d10d20755783 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:32.483360 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0bfd8-b1a5-4a16-a5f1-d10d20755783 admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:32.484092 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b0bfd8-b1a5-4a16-a5f1-d10d20755783 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:32.486335 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b0bfd8-b1a5-4a16-a5f1-d10d20755783 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:32.495308 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721fbb96-3b32-4d1b-8a18-3b8e2c898da7 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:32.501102 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed3d893-88e8-483d-a539-9b41d75ffbf6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f4c2fc51f54f0e977648b13efaed1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:32.501767 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3d893-88e8-483d-a539-9b41d75ffbf6 service cinder] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:32.502089 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3d893-88e8-483d-a539-9b41d75ffbf6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:32.502384 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3d893-88e8-483d-a539-9b41d75ffbf6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:32.513516 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed3d893-88e8-483d-a539-9b41d75ffbf6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:32.515926 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed3d893-88e8-483d-a539-9b41d75ffbf6 service cinder] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:32.529110 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 930/1863] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:11:32 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:11:32.530297 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed3d893-88e8-483d-a539-9b41d75ffbf6 service cinder] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:32.532003 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-0ed3d893-88e8-483d-a539-9b41d75ffbf6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:32.554003 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 934/1864] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:11:32 2022] POST /identity/v3/projects => generated 375 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:11:32.554612 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed3d893-88e8-483d-a539-9b41d75ffbf6 service cinder] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:32.558375 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b0bfd8-b1a5-4a16-a5f1-d10d20755783 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:32.661535 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f77eb0-1705-44c2-b7f6-4d978bdec2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:32.662259 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f77eb0-1705-44c2-b7f6-4d978bdec2f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:32.662705 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f77eb0-1705-44c2-b7f6-4d978bdec2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:32.662976 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f77eb0-1705-44c2-b7f6-4d978bdec2f1 admin admin] PATH_INFO: `/v3/projects/534d496a17fd4f4eb896d6d1b26c36b9` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:32.665844 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f77eb0-1705-44c2-b7f6-4d978bdec2f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=534d496a17fd4f4eb896d6d1b26c36b9)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:32.668524 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f77eb0-1705-44c2-b7f6-4d978bdec2f1 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:32.686126 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b0bfd8-b1a5-4a16-a5f1-d10d20755783 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:32.697557 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b260b2-8c59-49ca-a6ac-eb7dde4708dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:32.698247 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b260b2-8c59-49ca-a6ac-eb7dde4708dc admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:32.698531 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b260b2-8c59-49ca-a6ac-eb7dde4708dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:32.698807 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b260b2-8c59-49ca-a6ac-eb7dde4708dc admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:32.699457 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b260b2-8c59-49ca-a6ac-eb7dde4708dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:32.701394 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b260b2-8c59-49ca-a6ac-eb7dde4708dc admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:32.739011 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 935/1865] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:11:32 2022] POST /identity/v3/users => generated 294 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:11:32.741992 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:32.743628 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b260b2-8c59-49ca-a6ac-eb7dde4708dc admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:32.763360 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b260b2-8c59-49ca-a6ac-eb7dde4708dc admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:32.772095 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-b7f77eb0-1705-44c2-b7f6-4d978bdec2f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '534d496a17fd4f4eb896d6d1b26c36b9', 'request_id': 'req-b7f77eb0-1705-44c2-b7f6-4d978bdec2f1'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:32.780960 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-b7f77eb0-1705-44c2-b7f6-4d978bdec2f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '534d496a17fd4f4eb896d6d1b26c36b9', 'request_id': 'req-b7f77eb0-1705-44c2-b7f6-4d978bdec2f1'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:32.793034 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-b7f77eb0-1705-44c2-b7f6-4d978bdec2f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '534d496a17fd4f4eb896d6d1b26c36b9', 'request_id': 'req-b7f77eb0-1705-44c2-b7f6-4d978bdec2f1'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:32.839507 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-b7f77eb0-1705-44c2-b7f6-4d978bdec2f1 admin admin] The token cache is being invalidate because project 534d496a17fd4f4eb896d6d1b26c36b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:11:32.841996 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-b7f77eb0-1705-44c2-b7f6-4d978bdec2f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:32.844166 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-b7f77eb0-1705-44c2-b7f6-4d978bdec2f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:32.851139 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 931/1866] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:11:32 2022] DELETE /identity/v3/projects/534d496a17fd4f4eb896d6d1b26c36b9 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:32.859088 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c08cf-95c0-4148-9ae6-296958f459f7 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:32.859384 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c08cf-95c0-4148-9ae6-296958f459f7 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:32.859660 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c08cf-95c0-4148-9ae6-296958f459f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:32.884610 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:32.930418 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8ef846-8bc1-48bf-b5ee-98f47d40fc6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:32.931233 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ef846-8bc1-48bf-b5ee-98f47d40fc6a admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:32.931520 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ef846-8bc1-48bf-b5ee-98f47d40fc6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:32.931847 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ef846-8bc1-48bf-b5ee-98f47d40fc6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:32.932518 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8ef846-8bc1-48bf-b5ee-98f47d40fc6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:32.934322 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-698c08cf-95c0-4148-9ae6-296958f459f7 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:32.939938 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-698c08cf-95c0-4148-9ae6-296958f459f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:32.946702 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8ef846-8bc1-48bf-b5ee-98f47d40fc6a admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:32.972247 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 936/1867] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:11:32 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:11:32.976692 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8ef846-8bc1-48bf-b5ee-98f47d40fc6a admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:32.978646 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-5e8ef846-8bc1-48bf-b5ee-98f47d40fc6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:32.980141 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 932/1868] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:11:32.989901 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b7587-90a7-46ca-ae8b-52378eedffd3 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:32.990214 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b7587-90a7-46ca-ae8b-52378eedffd3 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:32.990487 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b7587-90a7-46ca-ae8b-52378eedffd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:33.000346 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8ef846-8bc1-48bf-b5ee-98f47d40fc6a admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:33.008406 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90931842-f740-45a4-8d7e-f35c331ee837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:33.009527 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90931842-f740-45a4-8d7e-f35c331ee837 admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:33.010161 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90931842-f740-45a4-8d7e-f35c331ee837 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:33.010577 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90931842-f740-45a4-8d7e-f35c331ee837 admin admin] PATH_INFO: `/v3/projects/e06a01dff4a8491a8a288590a6de87bf/users/e5feed24e250426b9633cd08e7fa82c8/roles/ea564961b1db4eb4a1d4d880964611b2` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:33.026490 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-a69b7587-90a7-46ca-ae8b-52378eedffd3 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:33.028153 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-a69b7587-90a7-46ca-ae8b-52378eedffd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:33.031757 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90931842-f740-45a4-8d7e-f35c331ee837 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e06a01dff4a8491a8a288590a6de87bf, user_id=e5feed24e250426b9633cd08e7fa82c8, role_id=ea564961b1db4eb4a1d4d880964611b2)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:33.045931 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90931842-f740-45a4-8d7e-f35c331ee837 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:33.061107 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 933/1869] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:11:33.062233 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69b7587-90a7-46ca-ae8b-52378eedffd3 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:33.076788 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 937/1870] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:11:32 2022] PUT /identity/v3/projects/e06a01dff4a8491a8a288590a6de87bf/users/e5feed24e250426b9633cd08e7fa82c8/roles/ea564961b1db4eb4a1d4d880964611b2 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 11:11:33.081126 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90931842-f740-45a4-8d7e-f35c331ee837 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:33.083075 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69b7587-90a7-46ca-ae8b-52378eedffd3 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:33.243675 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90931842-f740-45a4-8d7e-f35c331ee837 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:33.251805 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164587d9-0cbd-44d0-809e-ee806ce1a8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:33.264143 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164587d9-0cbd-44d0-809e-ee806ce1a8a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:33.264822 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1aa1e4-00c5-4a3f-af9b-c200bb6fcd2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:33.266108 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164587d9-0cbd-44d0-809e-ee806ce1a8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:33.266749 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164587d9-0cbd-44d0-809e-ee806ce1a8a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:33.267205 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1aa1e4-00c5-4a3f-af9b-c200bb6fcd2f admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:33.268354 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1aa1e4-00c5-4a3f-af9b-c200bb6fcd2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:33.268822 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1aa1e4-00c5-4a3f-af9b-c200bb6fcd2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:33.269273 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164587d9-0cbd-44d0-809e-ee806ce1a8a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:11:33.270562 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164587d9-0cbd-44d0-809e-ee806ce1a8a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:33.272305 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1aa1e4-00c5-4a3f-af9b-c200bb6fcd2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:33.274135 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164587d9-0cbd-44d0-809e-ee806ce1a8a5 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:33.276175 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1aa1e4-00c5-4a3f-af9b-c200bb6fcd2f admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:33.297169 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 938/1871] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:11:33 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 13 11:11:33.301902 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 934/1872] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 11:11:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:11:33.302965 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1aa1e4-00c5-4a3f-af9b-c200bb6fcd2f admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:33.305974 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164587d9-0cbd-44d0-809e-ee806ce1a8a5 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:33.322938 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1aa1e4-00c5-4a3f-af9b-c200bb6fcd2f admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:33.326019 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164587d9-0cbd-44d0-809e-ee806ce1a8a5 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:33.335686 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a7e79c-07ee-4183-a7c3-f0d32ff0e3f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:33.336517 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7e79c-07ee-4183-a7c3-f0d32ff0e3f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:33.337759 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39babfca-9c61-48c5-a41a-dd5165fdc273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:33.338084 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7e79c-07ee-4183-a7c3-f0d32ff0e3f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:33.338881 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39babfca-9c61-48c5-a41a-dd5165fdc273 admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:33.339339 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7e79c-07ee-4183-a7c3-f0d32ff0e3f9 admin admin] PATH_INFO: `/v3/projects/e06a01dff4a8491a8a288590a6de87bf/users/e5feed24e250426b9633cd08e7fa82c8/roles/ea564961b1db4eb4a1d4d880964611b2` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:33.340514 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39babfca-9c61-48c5-a41a-dd5165fdc273 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:33.341296 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39babfca-9c61-48c5-a41a-dd5165fdc273 admin admin] PATH_INFO: `/v3/projects` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:33.342159 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39babfca-9c61-48c5-a41a-dd5165fdc273 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:33.343164 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a7e79c-07ee-4183-a7c3-f0d32ff0e3f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e06a01dff4a8491a8a288590a6de87bf, user_id=e5feed24e250426b9633cd08e7fa82c8, role_id=ea564961b1db4eb4a1d4d880964611b2)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:33.345571 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39babfca-9c61-48c5-a41a-dd5165fdc273 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:33.348643 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a7e79c-07ee-4183-a7c3-f0d32ff0e3f9 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:33.404775 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 939/1873] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:11:33 2022] PUT /identity/v3/projects/e06a01dff4a8491a8a288590a6de87bf/users/e5feed24e250426b9633cd08e7fa82c8/roles/ea564961b1db4eb4a1d4d880964611b2 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:33.407131 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae379a-874a-447b-bc70-646b4957eb8b None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:33.407439 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae379a-874a-447b-bc70-646b4957eb8b None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:33.409073 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae379a-874a-447b-bc70-646b4957eb8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:33.427834 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 935/1874] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:11:33 2022] POST /identity/v3/projects => generated 385 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:11:33.429426 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39babfca-9c61-48c5-a41a-dd5165fdc273 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:33.498664 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-61ae379a-874a-447b-bc70-646b4957eb8b None None] MFA Rules not processed for user `e5feed24e250426b9633cd08e7fa82c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:33.508406 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-61ae379a-874a-447b-bc70-646b4957eb8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:33.580463 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39babfca-9c61-48c5-a41a-dd5165fdc273 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:33.586842 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a181d541-6a0f-47a7-9dc6-4a8219e2f55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:33.587905 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181d541-6a0f-47a7-9dc6-4a8219e2f55c admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:33.588458 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181d541-6a0f-47a7-9dc6-4a8219e2f55c admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:33.589060 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181d541-6a0f-47a7-9dc6-4a8219e2f55c admin admin] PATH_INFO: `/v3/users` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:33.590157 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a181d541-6a0f-47a7-9dc6-4a8219e2f55c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:33.592841 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a181d541-6a0f-47a7-9dc6-4a8219e2f55c admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:33.644812 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 936/1875] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:11:33 2022] POST /identity/v3/users => generated 293 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 11:11:33.647295 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a181d541-6a0f-47a7-9dc6-4a8219e2f55c admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:33.664221 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a181d541-6a0f-47a7-9dc6-4a8219e2f55c admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:33.670412 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a087da-fddc-4a2b-a67d-767c059e3b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:33.671644 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a087da-fddc-4a2b-a67d-767c059e3b22 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:33.672041 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a087da-fddc-4a2b-a67d-767c059e3b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:33.672646 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a087da-fddc-4a2b-a67d-767c059e3b22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:33.673932 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a087da-fddc-4a2b-a67d-767c059e3b22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:33.675338 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a087da-fddc-4a2b-a67d-767c059e3b22 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:33.677974 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:33.692805 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 937/1876] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:11:33 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:11:33.705969 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a087da-fddc-4a2b-a67d-767c059e3b22 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:33.723058 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 940/1877] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:33 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 11:11:33.736611 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ae379a-874a-447b-bc70-646b4957eb8b None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:33.737390 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a087da-fddc-4a2b-a67d-767c059e3b22 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:33.739541 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-61ae379a-874a-447b-bc70-646b4957eb8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:33.745615 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fa2dd3-5d89-4026-b7a2-ea71e131e104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:33.746530 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fa2dd3-5d89-4026-b7a2-ea71e131e104 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:33.747077 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fa2dd3-5d89-4026-b7a2-ea71e131e104 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:33.747767 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fa2dd3-5d89-4026-b7a2-ea71e131e104 admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:33.748726 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fa2dd3-5d89-4026-b7a2-ea71e131e104 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:33.751084 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fa2dd3-5d89-4026-b7a2-ea71e131e104 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:33.766176 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 938/1878] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:11:33 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:11:33.770740 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fa2dd3-5d89-4026-b7a2-ea71e131e104 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:33.781586 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:33.794776 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fa2dd3-5d89-4026-b7a2-ea71e131e104 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:33.802346 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b51ef38-2104-4a73-923a-f6ac8a4edb82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:33.803021 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51ef38-2104-4a73-923a-f6ac8a4edb82 admin admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:33.803359 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51ef38-2104-4a73-923a-f6ac8a4edb82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:33.804337 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51ef38-2104-4a73-923a-f6ac8a4edb82 admin admin] PATH_INFO: `/v3/projects/088c645a95c940a2a89e182e5445218d/users/dfe9914c5e5648fcbc2f67a303ed5d53/roles/7c3871c0ab68438b9014489d50b53a22` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:33.820034 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ae379a-874a-447b-bc70-646b4957eb8b None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:33.825440 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b51ef38-2104-4a73-923a-f6ac8a4edb82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=088c645a95c940a2a89e182e5445218d, user_id=dfe9914c5e5648fcbc2f67a303ed5d53, role_id=7c3871c0ab68438b9014489d50b53a22)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:33.826733 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed1a851-bb30-4280-89db-68b6f1cdf8f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f4c2fc51f54f0e977648b13efaed1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:33.827652 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed1a851-bb30-4280-89db-68b6f1cdf8f8 service cinder] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:33.828119 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b51ef38-2104-4a73-923a-f6ac8a4edb82 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:33.828544 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed1a851-bb30-4280-89db-68b6f1cdf8f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:33.829255 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed1a851-bb30-4280-89db-68b6f1cdf8f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:33.831778 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-4ed1a851-bb30-4280-89db-68b6f1cdf8f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:33.849992 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 939/1879] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:11:33 2022] PUT /identity/v3/projects/088c645a95c940a2a89e182e5445218d/users/dfe9914c5e5648fcbc2f67a303ed5d53/roles/7c3871c0ab68438b9014489d50b53a22 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:33.861255 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773572ec-3985-4863-879a-0b3a59e55436 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:33.861880 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773572ec-3985-4863-879a-0b3a59e55436 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:33.864024 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773572ec-3985-4863-879a-0b3a59e55436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:33.905143 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-773572ec-3985-4863-879a-0b3a59e55436 None None] MFA Rules not processed for user `dfe9914c5e5648fcbc2f67a303ed5d53`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:33.906555 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-773572ec-3985-4863-879a-0b3a59e55436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:33.942564 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed1a851-bb30-4280-89db-68b6f1cdf8f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:33.944254 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed1a851-bb30-4280-89db-68b6f1cdf8f8 service cinder] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:33.956731 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 941/1880] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:11:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:11:33.984966 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 940/1881] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 11:11:33.990473 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed1a851-bb30-4280-89db-68b6f1cdf8f8 service cinder] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:34.005540 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed1a851-bb30-4280-89db-68b6f1cdf8f8 service cinder] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:34.071216 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7816def9-0b4b-412e-a708-889386a40048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:34.071836 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7816def9-0b4b-412e-a708-889386a40048 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:34.072112 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7816def9-0b4b-412e-a708-889386a40048 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:34.072384 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7816def9-0b4b-412e-a708-889386a40048 admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:34.073020 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7816def9-0b4b-412e-a708-889386a40048 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:34.074958 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7816def9-0b4b-412e-a708-889386a40048 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:34.108047 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 942/1882] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:11:33 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:11:34.112477 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773572ec-3985-4863-879a-0b3a59e55436 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:34.125330 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773572ec-3985-4863-879a-0b3a59e55436 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:34.211072 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd4de84-0daa-4574-841e-0740dbac4a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:34.212061 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4de84-0daa-4574-841e-0740dbac4a88 admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:34.212345 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4de84-0daa-4574-841e-0740dbac4a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:34.212625 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4de84-0daa-4574-841e-0740dbac4a88 admin admin] PATH_INFO: `/v3/users` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:34.213299 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd4de84-0daa-4574-841e-0740dbac4a88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:34.215406 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd4de84-0daa-4574-841e-0740dbac4a88 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:34.248986 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 941/1883] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:11:34 2022] POST /identity/v3/users => generated 299 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:11:34.253678 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7816def9-0b4b-412e-a708-889386a40048 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:34.268238 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7816def9-0b4b-412e-a708-889386a40048 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:34.284501 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f609b8-172d-4091-aa21-89beeaca6145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:34.285836 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f609b8-172d-4091-aa21-89beeaca6145 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:34.288325 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f609b8-172d-4091-aa21-89beeaca6145 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:34.304399 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f609b8-172d-4091-aa21-89beeaca6145 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:34.305207 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f609b8-172d-4091-aa21-89beeaca6145 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:34.307787 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f609b8-172d-4091-aa21-89beeaca6145 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:34.347389 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 943/1884] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:11:34 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:11:34.349266 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd4de84-0daa-4574-841e-0740dbac4a88 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:34.363351 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd4de84-0daa-4574-841e-0740dbac4a88 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:34.390638 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d46517-1d08-4f4d-83c5-b1f2590f6385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:34.391627 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d46517-1d08-4f4d-83c5-b1f2590f6385 admin admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:34.392058 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d46517-1d08-4f4d-83c5-b1f2590f6385 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:34.392817 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d46517-1d08-4f4d-83c5-b1f2590f6385 admin admin] PATH_INFO: `/v3/projects/150e63e043cc4786973d9e6f9656cd30/users/5914825c57fa4023bc99f0b7c1ae8115/roles/ea564961b1db4eb4a1d4d880964611b2` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:34.413194 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d46517-1d08-4f4d-83c5-b1f2590f6385 admin admin] RBAC: Authorizing `identity:create_grant(project_id=150e63e043cc4786973d9e6f9656cd30, user_id=5914825c57fa4023bc99f0b7c1ae8115, role_id=ea564961b1db4eb4a1d4d880964611b2)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:34.416256 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d46517-1d08-4f4d-83c5-b1f2590f6385 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:34.438447 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 942/1885] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:11:34 2022] PUT /identity/v3/projects/150e63e043cc4786973d9e6f9656cd30/users/5914825c57fa4023bc99f0b7c1ae8115/roles/ea564961b1db4eb4a1d4d880964611b2 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:34.446658 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f609b8-172d-4091-aa21-89beeaca6145 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:34.457974 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f609b8-172d-4091-aa21-89beeaca6145 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:34.519452 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:34.528782 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab43e9-2758-4228-8f3b-7066e2051ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:34.529828 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab43e9-2758-4228-8f3b-7066e2051ff9 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:34.530255 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab43e9-2758-4228-8f3b-7066e2051ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:34.530645 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab43e9-2758-4228-8f3b-7066e2051ff9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:34.531436 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbab43e9-2758-4228-8f3b-7066e2051ff9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:34.533246 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbab43e9-2758-4228-8f3b-7066e2051ff9 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:34.555207 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 944/1886] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:11:34 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:11:34.556994 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d46517-1d08-4f4d-83c5-b1f2590f6385 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:34.569468 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d46517-1d08-4f4d-83c5-b1f2590f6385 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:34.575141 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a35293a-4898-47f4-807a-9b70fe614390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:34.576032 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a35293a-4898-47f4-807a-9b70fe614390 admin admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:34.576509 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a35293a-4898-47f4-807a-9b70fe614390 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:34.576969 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a35293a-4898-47f4-807a-9b70fe614390 admin admin] PATH_INFO: `/v3/projects/150e63e043cc4786973d9e6f9656cd30/users/5914825c57fa4023bc99f0b7c1ae8115/roles/ea564961b1db4eb4a1d4d880964611b2` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:34.579475 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a35293a-4898-47f4-807a-9b70fe614390 admin admin] RBAC: Authorizing `identity:create_grant(project_id=150e63e043cc4786973d9e6f9656cd30, user_id=5914825c57fa4023bc99f0b7c1ae8115, role_id=ea564961b1db4eb4a1d4d880964611b2)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:34.582817 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a35293a-4898-47f4-807a-9b70fe614390 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:34.609189 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b4d27c-2b8a-4a83-99bd-cd6adb636338 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:34.609189 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b4d27c-2b8a-4a83-99bd-cd6adb636338 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:34.609189 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b4d27c-2b8a-4a83-99bd-cd6adb636338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:34.611288 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 943/1887] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:11:34 2022] PUT /identity/v3/projects/150e63e043cc4786973d9e6f9656cd30/users/5914825c57fa4023bc99f0b7c1ae8115/roles/ea564961b1db4eb4a1d4d880964611b2 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:34.640213 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-82b4d27c-2b8a-4a83-99bd-cd6adb636338 None None] MFA Rules not processed for user `5914825c57fa4023bc99f0b7c1ae8115`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:34.641483 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-82b4d27c-2b8a-4a83-99bd-cd6adb636338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:34.746339 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 945/1888] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:34 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:11:34.801345 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a35293a-4898-47f4-807a-9b70fe614390 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:34.813882 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:34.928575 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a35293a-4898-47f4-807a-9b70fe614390 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:34.938776 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceac0ef-895d-43ab-816c-1b189da797c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f4c2fc51f54f0e977648b13efaed1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:34.941102 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceac0ef-895d-43ab-816c-1b189da797c1 service cinder] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:34.941102 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceac0ef-895d-43ab-816c-1b189da797c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:34.942125 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceac0ef-895d-43ab-816c-1b189da797c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:34.960593 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceac0ef-895d-43ab-816c-1b189da797c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:34.962699 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceac0ef-895d-43ab-816c-1b189da797c1 service cinder] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:34.976209 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 944/1889] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:11:34 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:11:35.071639 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b4d27c-2b8a-4a83-99bd-cd6adb636338 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:35.216689 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b4d27c-2b8a-4a83-99bd-cd6adb636338 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:35.225244 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f24ae8-b093-42e9-a65d-676941226dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:35.225902 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f24ae8-b093-42e9-a65d-676941226dce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:35.226342 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f24ae8-b093-42e9-a65d-676941226dce admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:35.226622 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f24ae8-b093-42e9-a65d-676941226dce admin admin] PATH_INFO: `/v3/users/dfe9914c5e5648fcbc2f67a303ed5d53` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:35.227989 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f24ae8-b093-42e9-a65d-676941226dce admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfe9914c5e5648fcbc2f67a303ed5d53)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:35.230532 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f24ae8-b093-42e9-a65d-676941226dce admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:35.295630 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-72f24ae8-b093-42e9-a65d-676941226dce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfe9914c5e5648fcbc2f67a303ed5d53'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:35.296387 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-72f24ae8-b093-42e9-a65d-676941226dce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfe9914c5e5648fcbc2f67a303ed5d53'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:35.297064 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-72f24ae8-b093-42e9-a65d-676941226dce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfe9914c5e5648fcbc2f67a303ed5d53'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:35.334553 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-72f24ae8-b093-42e9-a65d-676941226dce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfe9914c5e5648fcbc2f67a303ed5d53'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:35.356670 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-72f24ae8-b093-42e9-a65d-676941226dce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfe9914c5e5648fcbc2f67a303ed5d53'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:35.367325 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:35.376390 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 946/1890] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:11:35 2022] DELETE /identity/v3/users/dfe9914c5e5648fcbc2f67a303ed5d53 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:35.381758 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d556797-0423-434c-a7a7-348100ada3ae None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:35.382345 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d556797-0423-434c-a7a7-348100ada3ae None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:35.382690 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d556797-0423-434c-a7a7-348100ada3ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:35.415370 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-8d556797-0423-434c-a7a7-348100ada3ae None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:35.416819 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-8d556797-0423-434c-a7a7-348100ada3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:35.489580 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 945/1891] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:11:35.500620 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f24ae8-b093-42e9-a65d-676941226dce admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:35.502267 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-72f24ae8-b093-42e9-a65d-676941226dce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:35.574450 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f24ae8-b093-42e9-a65d-676941226dce admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:35.578818 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f416ceec-c0b6-45bc-a61e-a8dd51b02105 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:35.579438 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f416ceec-c0b6-45bc-a61e-a8dd51b02105 service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:35.579720 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f416ceec-c0b6-45bc-a61e-a8dd51b02105 service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:35.580001 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f416ceec-c0b6-45bc-a61e-a8dd51b02105 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:35.593487 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f416ceec-c0b6-45bc-a61e-a8dd51b02105 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:35.595277 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f416ceec-c0b6-45bc-a61e-a8dd51b02105 service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:35.618315 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 947/1892] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:11:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:11:35.915439 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d556797-0423-434c-a7a7-348100ada3ae None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:35.917133 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-8d556797-0423-434c-a7a7-348100ada3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:35.949660 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d556797-0423-434c-a7a7-348100ada3ae None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:35.954288 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a9f2f-4c0d-4ab2-8da4-2fe5cbc97741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:35.954920 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a9f2f-4c0d-4ab2-8da4-2fe5cbc97741 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:35.955199 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a9f2f-4c0d-4ab2-8da4-2fe5cbc97741 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:35.955464 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a9f2f-4c0d-4ab2-8da4-2fe5cbc97741 admin admin] PATH_INFO: `/v3/projects/088c645a95c940a2a89e182e5445218d` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:35.957466 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65a9f2f-4c0d-4ab2-8da4-2fe5cbc97741 admin admin] RBAC: Authorizing `identity:delete_project(project_id=088c645a95c940a2a89e182e5445218d)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:35.959483 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65a9f2f-4c0d-4ab2-8da4-2fe5cbc97741 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:36.007909 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-b65a9f2f-4c0d-4ab2-8da4-2fe5cbc97741 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '088c645a95c940a2a89e182e5445218d', 'request_id': 'req-b65a9f2f-4c0d-4ab2-8da4-2fe5cbc97741'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:36.013902 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-b65a9f2f-4c0d-4ab2-8da4-2fe5cbc97741 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '088c645a95c940a2a89e182e5445218d', 'request_id': 'req-b65a9f2f-4c0d-4ab2-8da4-2fe5cbc97741'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:36.020031 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-b65a9f2f-4c0d-4ab2-8da4-2fe5cbc97741 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '088c645a95c940a2a89e182e5445218d', 'request_id': 'req-b65a9f2f-4c0d-4ab2-8da4-2fe5cbc97741'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:36.032777 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-b65a9f2f-4c0d-4ab2-8da4-2fe5cbc97741 admin admin] The token cache is being invalidate because project 088c645a95c940a2a89e182e5445218d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:11:36.033064 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-b65a9f2f-4c0d-4ab2-8da4-2fe5cbc97741 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:36.033683 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-b65a9f2f-4c0d-4ab2-8da4-2fe5cbc97741 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:36.035891 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 946/1893] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:11:35 2022] DELETE /identity/v3/projects/088c645a95c940a2a89e182e5445218d => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:36.039868 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f416ceec-c0b6-45bc-a61e-a8dd51b02105 service neutron] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:36.050879 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f416ceec-c0b6-45bc-a61e-a8dd51b02105 service neutron] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:36.108640 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cebb99-ce1a-4666-b06d-4aa2f3d7fe1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:36.109278 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cebb99-ce1a-4666-b06d-4aa2f3d7fe1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:36.109559 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cebb99-ce1a-4666-b06d-4aa2f3d7fe1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:36.109833 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cebb99-ce1a-4666-b06d-4aa2f3d7fe1b admin admin] PATH_INFO: `/v3/users/5914825c57fa4023bc99f0b7c1ae8115` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:36.110999 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cebb99-ce1a-4666-b06d-4aa2f3d7fe1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5914825c57fa4023bc99f0b7c1ae8115)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:36.112906 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cebb99-ce1a-4666-b06d-4aa2f3d7fe1b admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:36.181392 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-27cebb99-ce1a-4666-b06d-4aa2f3d7fe1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5914825c57fa4023bc99f0b7c1ae8115'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:36.182182 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-27cebb99-ce1a-4666-b06d-4aa2f3d7fe1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5914825c57fa4023bc99f0b7c1ae8115'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:36.183022 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-27cebb99-ce1a-4666-b06d-4aa2f3d7fe1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5914825c57fa4023bc99f0b7c1ae8115'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:36.196454 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-27cebb99-ce1a-4666-b06d-4aa2f3d7fe1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5914825c57fa4023bc99f0b7c1ae8115'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:36.206280 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-27cebb99-ce1a-4666-b06d-4aa2f3d7fe1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5914825c57fa4023bc99f0b7c1ae8115'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:36.220078 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 948/1894] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:11:36 2022] DELETE /identity/v3/users/5914825c57fa4023bc99f0b7c1ae8115 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:36.475563 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a9f2f-4c0d-4ab2-8da4-2fe5cbc97741 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:36.477001 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-b65a9f2f-4c0d-4ab2-8da4-2fe5cbc97741 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:36.490746 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a9f2f-4c0d-4ab2-8da4-2fe5cbc97741 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:36.518640 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:36.552013 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5147f507-8b3e-45ce-a08b-be46a7e7d9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:36.552663 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5147f507-8b3e-45ce-a08b-be46a7e7d9aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:36.552945 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5147f507-8b3e-45ce-a08b-be46a7e7d9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:36.553220 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5147f507-8b3e-45ce-a08b-be46a7e7d9aa admin admin] PATH_INFO: `/v3/users/4d7b7cdc8a0c4ebc81fee23a04702664` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:36.554453 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5147f507-8b3e-45ce-a08b-be46a7e7d9aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d7b7cdc8a0c4ebc81fee23a04702664)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:36.556378 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5147f507-8b3e-45ce-a08b-be46a7e7d9aa admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:36.607805 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-5147f507-8b3e-45ce-a08b-be46a7e7d9aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d7b7cdc8a0c4ebc81fee23a04702664'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:36.615452 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-5147f507-8b3e-45ce-a08b-be46a7e7d9aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d7b7cdc8a0c4ebc81fee23a04702664'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:36.616284 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-5147f507-8b3e-45ce-a08b-be46a7e7d9aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d7b7cdc8a0c4ebc81fee23a04702664'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:36.616893 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-5147f507-8b3e-45ce-a08b-be46a7e7d9aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d7b7cdc8a0c4ebc81fee23a04702664'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:36.625025 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-5147f507-8b3e-45ce-a08b-be46a7e7d9aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d7b7cdc8a0c4ebc81fee23a04702664'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:36.643658 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 947/1895] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:11:36 2022] DELETE /identity/v3/users/4d7b7cdc8a0c4ebc81fee23a04702664 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:36.648257 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea6510-2b4a-4769-b6a6-4c3c32d92762 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:36.648541 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea6510-2b4a-4769-b6a6-4c3c32d92762 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:36.648817 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea6510-2b4a-4769-b6a6-4c3c32d92762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:36.677766 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-e9ea6510-2b4a-4769-b6a6-4c3c32d92762 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:36.679014 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-e9ea6510-2b4a-4769-b6a6-4c3c32d92762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:36.690307 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5147f507-8b3e-45ce-a08b-be46a7e7d9aa admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:36.692548 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-5147f507-8b3e-45ce-a08b-be46a7e7d9aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:36.694375 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:36.759515 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 949/1896] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:11:36.760300 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea6510-2b4a-4769-b6a6-4c3c32d92762 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:36.763260 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-e9ea6510-2b4a-4769-b6a6-4c3c32d92762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:36.775894 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5147f507-8b3e-45ce-a08b-be46a7e7d9aa admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:36.776085 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea6510-2b4a-4769-b6a6-4c3c32d92762 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:36.780585 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7345604-b277-46b4-96d7-3373d2265e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:36.781225 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7345604-b277-46b4-96d7-3373d2265e91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:36.781505 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7345604-b277-46b4-96d7-3373d2265e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:36.781782 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7345604-b277-46b4-96d7-3373d2265e91 admin admin] PATH_INFO: `/v3/users/829bdef4ab7443b49849565db575ce08` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:36.782366 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722fb20d-901b-440c-910e-914e4ae394ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:36.782985 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7345604-b277-46b4-96d7-3373d2265e91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=829bdef4ab7443b49849565db575ce08)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:36.783107 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722fb20d-901b-440c-910e-914e4ae394ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:36.783257 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722fb20d-901b-440c-910e-914e4ae394ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:36.783531 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722fb20d-901b-440c-910e-914e4ae394ad admin admin] PATH_INFO: `/v3/projects/150e63e043cc4786973d9e6f9656cd30` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:36.784641 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722fb20d-901b-440c-910e-914e4ae394ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=150e63e043cc4786973d9e6f9656cd30)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:36.784903 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7345604-b277-46b4-96d7-3373d2265e91 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:36.787182 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722fb20d-901b-440c-910e-914e4ae394ad admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:36.842266 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-f7345604-b277-46b4-96d7-3373d2265e91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '829bdef4ab7443b49849565db575ce08'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:36.843626 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-722fb20d-901b-440c-910e-914e4ae394ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '150e63e043cc4786973d9e6f9656cd30', 'request_id': 'req-722fb20d-901b-440c-910e-914e4ae394ad'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:36.844817 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:36.852871 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-722fb20d-901b-440c-910e-914e4ae394ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '150e63e043cc4786973d9e6f9656cd30', 'request_id': 'req-722fb20d-901b-440c-910e-914e4ae394ad'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:36.854343 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-f7345604-b277-46b4-96d7-3373d2265e91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '829bdef4ab7443b49849565db575ce08'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:36.856893 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-f7345604-b277-46b4-96d7-3373d2265e91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '829bdef4ab7443b49849565db575ce08'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:36.858063 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-f7345604-b277-46b4-96d7-3373d2265e91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '829bdef4ab7443b49849565db575ce08'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:36.860537 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-722fb20d-901b-440c-910e-914e4ae394ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '150e63e043cc4786973d9e6f9656cd30', 'request_id': 'req-722fb20d-901b-440c-910e-914e4ae394ad'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:36.867630 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-f7345604-b277-46b4-96d7-3373d2265e91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '829bdef4ab7443b49849565db575ce08'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:36.873582 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-722fb20d-901b-440c-910e-914e4ae394ad admin admin] The token cache is being invalidate because project 150e63e043cc4786973d9e6f9656cd30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:11:36.873881 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-722fb20d-901b-440c-910e-914e4ae394ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:36.874964 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-722fb20d-901b-440c-910e-914e4ae394ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:36.877594 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 950/1897] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:11:36 2022] DELETE /identity/v3/projects/150e63e043cc4786973d9e6f9656cd30 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:36.882637 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722fb20d-901b-440c-910e-914e4ae394ad admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:36.888287 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-722fb20d-901b-440c-910e-914e4ae394ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:36.888413 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 948/1898] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:11:36 2022] DELETE /identity/v3/users/829bdef4ab7443b49849565db575ce08 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 11:11:36.888501 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2fcaac-ddef-4ceb-8afe-08a7162483a7 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:36.888932 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2fcaac-ddef-4ceb-8afe-08a7162483a7 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:36.889274 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2fcaac-ddef-4ceb-8afe-08a7162483a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:36.913479 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-5c2fcaac-ddef-4ceb-8afe-08a7162483a7 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:36.914744 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-5c2fcaac-ddef-4ceb-8afe-08a7162483a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:36.959771 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722fb20d-901b-440c-910e-914e4ae394ad admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:36.986694 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 949/1899] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:11:36.988661 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e6ec0-f9b4-4a2c-970f-c6f6c9a322e7 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:36.989064 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e6ec0-f9b4-4a2c-970f-c6f6c9a322e7 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:36.989539 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e6ec0-f9b4-4a2c-970f-c6f6c9a322e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:37.012992 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-709e6ec0-f9b4-4a2c-970f-c6f6c9a322e7 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:37.014253 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-709e6ec0-f9b4-4a2c-970f-c6f6c9a322e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:37.022163 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 950/1900] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:11:37.023391 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da6bafe-bb34-4017-9235-3cba5192b382 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:37.023671 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da6bafe-bb34-4017-9235-3cba5192b382 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:37.023940 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da6bafe-bb34-4017-9235-3cba5192b382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:37.033017 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96c6f04-04ae-4adf-a331-c4e4a9b95f7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:37.033607 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c6f04-04ae-4adf-a331-c4e4a9b95f7d service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:37.033894 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c6f04-04ae-4adf-a331-c4e4a9b95f7d service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:37.034206 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c6f04-04ae-4adf-a331-c4e4a9b95f7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:37.036759 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-c96c6f04-04ae-4adf-a331-c4e4a9b95f7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:37.043833 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-6da6bafe-bb34-4017-9235-3cba5192b382 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:37.045015 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-6da6bafe-bb34-4017-9235-3cba5192b382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:37.050439 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96c6f04-04ae-4adf-a331-c4e4a9b95f7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:37.052589 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96c6f04-04ae-4adf-a331-c4e4a9b95f7d service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:37.056896 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 951/1901] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:11:37.056896 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da6bafe-bb34-4017-9235-3cba5192b382 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:37.056896 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-6da6bafe-bb34-4017-9235-3cba5192b382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:37.059716 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:37.065353 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 951/1902] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:11:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:11:37.067054 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96c6f04-04ae-4adf-a331-c4e4a9b95f7d service neutron] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:37.071054 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da6bafe-bb34-4017-9235-3cba5192b382 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:37.076559 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96c6f04-04ae-4adf-a331-c4e4a9b95f7d service neutron] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:37.076923 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16dd617-7d42-4933-aeaf-daa9ced4bd69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:37.077565 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16dd617-7d42-4933-aeaf-daa9ced4bd69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:37.077845 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16dd617-7d42-4933-aeaf-daa9ced4bd69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:37.078158 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16dd617-7d42-4933-aeaf-daa9ced4bd69 admin admin] PATH_INFO: `/v3/users/56d032f318a44a33b87841975328899f` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:37.079626 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16dd617-7d42-4933-aeaf-daa9ced4bd69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56d032f318a44a33b87841975328899f)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:37.081535 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16dd617-7d42-4933-aeaf-daa9ced4bd69 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:37.082666 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490aa387-4346-4f04-96b1-ebd317f4b492 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:37.083270 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490aa387-4346-4f04-96b1-ebd317f4b492 service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:37.083549 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490aa387-4346-4f04-96b1-ebd317f4b492 service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:37.083825 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490aa387-4346-4f04-96b1-ebd317f4b492 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:37.095023 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490aa387-4346-4f04-96b1-ebd317f4b492 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:37.096457 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490aa387-4346-4f04-96b1-ebd317f4b492 service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:37.107447 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 952/1903] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:11:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:11:37.108294 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490aa387-4346-4f04-96b1-ebd317f4b492 service neutron] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:37.119463 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490aa387-4346-4f04-96b1-ebd317f4b492 service neutron] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:37.125004 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce8a0c-fe0d-4523-b37c-43f4d1a8e78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:37.125617 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce8a0c-fe0d-4523-b37c-43f4d1a8e78f admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:37.125896 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce8a0c-fe0d-4523-b37c-43f4d1a8e78f admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:37.126217 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce8a0c-fe0d-4523-b37c-43f4d1a8e78f admin admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:37.126868 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ce8a0c-fe0d-4523-b37c-43f4d1a8e78f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:11:37.127175 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ce8a0c-fe0d-4523-b37c-43f4d1a8e78f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:37.128764 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ce8a0c-fe0d-4523-b37c-43f4d1a8e78f admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:37.135818 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-b16dd617-7d42-4933-aeaf-daa9ced4bd69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56d032f318a44a33b87841975328899f'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:37.143595 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 953/1904] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 11:11:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:11:37.144843 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-b16dd617-7d42-4933-aeaf-daa9ced4bd69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56d032f318a44a33b87841975328899f'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:37.145619 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-b16dd617-7d42-4933-aeaf-daa9ced4bd69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56d032f318a44a33b87841975328899f'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:37.146316 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-b16dd617-7d42-4933-aeaf-daa9ced4bd69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56d032f318a44a33b87841975328899f'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:37.147681 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce8a0c-fe0d-4523-b37c-43f4d1a8e78f admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:37.149707 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-a8ce8a0c-fe0d-4523-b37c-43f4d1a8e78f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:37.155749 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-b16dd617-7d42-4933-aeaf-daa9ced4bd69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56d032f318a44a33b87841975328899f'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:37.165090 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce8a0c-fe0d-4523-b37c-43f4d1a8e78f admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:37.169675 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2170d6-1b79-45a2-86cb-2983b14a396d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:37.170341 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2170d6-1b79-45a2-86cb-2983b14a396d admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:37.171303 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2170d6-1b79-45a2-86cb-2983b14a396d admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:37.171303 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2170d6-1b79-45a2-86cb-2983b14a396d admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:37.171501 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2170d6-1b79-45a2-86cb-2983b14a396d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:37.173460 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2170d6-1b79-45a2-86cb-2983b14a396d admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:37.191499 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 952/1905] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:11:37 2022] DELETE /identity/v3/users/56d032f318a44a33b87841975328899f => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:37.198078 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f3a048-b19d-4b5a-9f5a-547339443bd4 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:37.198648 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f3a048-b19d-4b5a-9f5a-547339443bd4 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:37.199227 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f3a048-b19d-4b5a-9f5a-547339443bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:37.204690 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 954/1906] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:11:37 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 11:11:37.209492 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2170d6-1b79-45a2-86cb-2983b14a396d admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:37.226344 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-a9f3a048-b19d-4b5a-9f5a-547339443bd4 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:37.227332 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-a9f3a048-b19d-4b5a-9f5a-547339443bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:37.251702 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:37.280185 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2170d6-1b79-45a2-86cb-2983b14a396d admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:37.286843 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93555ee-5c40-4fdb-964f-cb1d67c2fc99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:37.287479 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93555ee-5c40-4fdb-964f-cb1d67c2fc99 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:37.287822 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93555ee-5c40-4fdb-964f-cb1d67c2fc99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:37.288158 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93555ee-5c40-4fdb-964f-cb1d67c2fc99 admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:37.288859 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93555ee-5c40-4fdb-964f-cb1d67c2fc99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:37.291161 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93555ee-5c40-4fdb-964f-cb1d67c2fc99 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:37.307907 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 953/1907] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 11:11:37.320922 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 955/1908] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:11:37 2022] POST /identity/v3/users => generated 292 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 11:11:37.321153 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f3a048-b19d-4b5a-9f5a-547339443bd4 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:37.321599 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-a9f3a048-b19d-4b5a-9f5a-547339443bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:37.322425 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93555ee-5c40-4fdb-964f-cb1d67c2fc99 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:37.336953 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93555ee-5c40-4fdb-964f-cb1d67c2fc99 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:37.342767 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd98a76-cd39-4e38-a23e-897ba2c4381e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:37.343464 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd98a76-cd39-4e38-a23e-897ba2c4381e admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:37.344104 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd98a76-cd39-4e38-a23e-897ba2c4381e admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:37.344104 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd98a76-cd39-4e38-a23e-897ba2c4381e admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:37.344879 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd98a76-cd39-4e38-a23e-897ba2c4381e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:37.346895 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd98a76-cd39-4e38-a23e-897ba2c4381e admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:37.360983 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 956/1909] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:11:37 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 13 11:11:37.365668 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd98a76-cd39-4e38-a23e-897ba2c4381e admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:37.380258 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd98a76-cd39-4e38-a23e-897ba2c4381e admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:37.386445 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f1091d-6dd8-4d83-9ad4-367d6d4df741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:37.387193 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f1091d-6dd8-4d83-9ad4-367d6d4df741 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:37.388118 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f1091d-6dd8-4d83-9ad4-367d6d4df741 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:37.388594 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f1091d-6dd8-4d83-9ad4-367d6d4df741 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:37.389368 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f1091d-6dd8-4d83-9ad4-367d6d4df741 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:37.391522 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f1091d-6dd8-4d83-9ad4-367d6d4df741 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:37.405982 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 957/1910] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:11:37 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:11:37.411741 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f1091d-6dd8-4d83-9ad4-367d6d4df741 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:37.433113 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f1091d-6dd8-4d83-9ad4-367d6d4df741 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:37.436510 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f3a048-b19d-4b5a-9f5a-547339443bd4 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:37.440443 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7659165-31be-4734-b008-1c9562fdbbf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:37.442377 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7659165-31be-4734-b008-1c9562fdbbf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:37.442655 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7659165-31be-4734-b008-1c9562fdbbf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:37.442930 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7659165-31be-4734-b008-1c9562fdbbf2 admin admin] PATH_INFO: `/v3/projects/aa84599d91ee43159017c46683a20299/users/1913c52c2889442d88965b04bb89cec3/roles/7c3871c0ab68438b9014489d50b53a22` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:37.445436 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e99864e-265e-4c82-ae3c-4ea48365577e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:37.446102 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99864e-265e-4c82-ae3c-4ea48365577e service neutron] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:37.446382 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99864e-265e-4c82-ae3c-4ea48365577e service neutron] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:37.446653 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99864e-265e-4c82-ae3c-4ea48365577e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:37.456340 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e99864e-265e-4c82-ae3c-4ea48365577e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:37.457767 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e99864e-265e-4c82-ae3c-4ea48365577e service neutron] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:37.469272 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 954/1911] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:11:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:11:37.470101 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7659165-31be-4734-b008-1c9562fdbbf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa84599d91ee43159017c46683a20299, user_id=1913c52c2889442d88965b04bb89cec3, role_id=7c3871c0ab68438b9014489d50b53a22)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:37.482156 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7659165-31be-4734-b008-1c9562fdbbf2 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:37.501346 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 958/1912] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:11:37 2022] PUT /identity/v3/projects/aa84599d91ee43159017c46683a20299/users/1913c52c2889442d88965b04bb89cec3/roles/7c3871c0ab68438b9014489d50b53a22 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 11:11:37.512389 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86989ba2-9766-4d22-9a24-b92a87309ec9 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:37.512718 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86989ba2-9766-4d22-9a24-b92a87309ec9 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:37.512967 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86989ba2-9766-4d22-9a24-b92a87309ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:37.552034 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-86989ba2-9766-4d22-9a24-b92a87309ec9 None None] MFA Rules not processed for user `1913c52c2889442d88965b04bb89cec3`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:37.553843 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-86989ba2-9766-4d22-9a24-b92a87309ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:37.646378 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 955/1913] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:11:37.653452 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7659165-31be-4734-b008-1c9562fdbbf2 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:37.752672 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:37.760936 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7659165-31be-4734-b008-1c9562fdbbf2 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:37.769390 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d01241f-0b15-475c-998c-267aca28a2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:37.770057 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01241f-0b15-475c-998c-267aca28a2bc admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:37.770362 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01241f-0b15-475c-998c-267aca28a2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:37.770636 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01241f-0b15-475c-998c-267aca28a2bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:37.771272 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d01241f-0b15-475c-998c-267aca28a2bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:37.773205 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d01241f-0b15-475c-998c-267aca28a2bc admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:37.776052 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86989ba2-9766-4d22-9a24-b92a87309ec9 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:37.777852 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-86989ba2-9766-4d22-9a24-b92a87309ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:37.799705 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86989ba2-9766-4d22-9a24-b92a87309ec9 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:37.806162 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf1aa05-d23d-4542-b471-790133e3049f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:37.806998 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1aa05-d23d-4542-b471-790133e3049f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:37.807120 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1aa05-d23d-4542-b471-790133e3049f admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:37.807370 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1aa05-d23d-4542-b471-790133e3049f admin admin] PATH_INFO: `/v3/projects/876fe1ce99894974b12ca34987eb7bcb` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:37.808565 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf1aa05-d23d-4542-b471-790133e3049f admin admin] RBAC: Authorizing `identity:delete_project(project_id=876fe1ce99894974b12ca34987eb7bcb)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:37.810633 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf1aa05-d23d-4542-b471-790133e3049f admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:37.816611 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 959/1914] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:11:37 2022] POST /identity/v3/projects => generated 385 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:11:37.821512 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d01241f-0b15-475c-998c-267aca28a2bc admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:37.896800 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-ddf1aa05-d23d-4542-b471-790133e3049f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '876fe1ce99894974b12ca34987eb7bcb', 'request_id': 'req-ddf1aa05-d23d-4542-b471-790133e3049f'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:37.907441 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-ddf1aa05-d23d-4542-b471-790133e3049f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '876fe1ce99894974b12ca34987eb7bcb', 'request_id': 'req-ddf1aa05-d23d-4542-b471-790133e3049f'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:37.909325 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:37.920274 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-ddf1aa05-d23d-4542-b471-790133e3049f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '876fe1ce99894974b12ca34987eb7bcb', 'request_id': 'req-ddf1aa05-d23d-4542-b471-790133e3049f'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:37.933979 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d01241f-0b15-475c-998c-267aca28a2bc admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:37.937680 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-ddf1aa05-d23d-4542-b471-790133e3049f admin admin] The token cache is being invalidate because project 876fe1ce99894974b12ca34987eb7bcb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:11:37.938009 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-ddf1aa05-d23d-4542-b471-790133e3049f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:37.938847 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-ddf1aa05-d23d-4542-b471-790133e3049f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:37.941463 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 956/1915] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:11:37 2022] DELETE /identity/v3/projects/876fe1ce99894974b12ca34987eb7bcb => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 11:11:37.942424 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf1aa05-d23d-4542-b471-790133e3049f admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:37.946349 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-ddf1aa05-d23d-4542-b471-790133e3049f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:38.039558 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf1aa05-d23d-4542-b471-790133e3049f admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:38.040597 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff73ca7d-c659-40de-a7d9-cb5e6c271645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:38.041338 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff73ca7d-c659-40de-a7d9-cb5e6c271645 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:38.042319 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff73ca7d-c659-40de-a7d9-cb5e6c271645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:38.042600 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff73ca7d-c659-40de-a7d9-cb5e6c271645 admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:38.043578 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff73ca7d-c659-40de-a7d9-cb5e6c271645 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:38.045000 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f224db07-2a5c-4f1a-96c0-7c279d482410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:38.045505 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff73ca7d-c659-40de-a7d9-cb5e6c271645 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:38.046030 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224db07-2a5c-4f1a-96c0-7c279d482410 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:38.046379 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224db07-2a5c-4f1a-96c0-7c279d482410 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:38.046749 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224db07-2a5c-4f1a-96c0-7c279d482410 admin admin] PATH_INFO: `/v3/projects/cc2f85e6b0264ba3bd6456107baa3af9` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:38.047998 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f224db07-2a5c-4f1a-96c0-7c279d482410 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc2f85e6b0264ba3bd6456107baa3af9)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:38.050010 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f224db07-2a5c-4f1a-96c0-7c279d482410 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:38.072115 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 960/1916] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:11:37 2022] POST /identity/v3/users => generated 293 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:11:38.073656 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32ae06-4954-4f99-9e91-e890cb095b1f None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:38.073959 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32ae06-4954-4f99-9e91-e890cb095b1f None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:38.074230 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32ae06-4954-4f99-9e91-e890cb095b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:38.095096 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-3b32ae06-4954-4f99-9e91-e890cb095b1f None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:38.096297 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-3b32ae06-4954-4f99-9e91-e890cb095b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:38.102484 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-f224db07-2a5c-4f1a-96c0-7c279d482410 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc2f85e6b0264ba3bd6456107baa3af9', 'request_id': 'req-f224db07-2a5c-4f1a-96c0-7c279d482410'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:38.109115 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-f224db07-2a5c-4f1a-96c0-7c279d482410 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc2f85e6b0264ba3bd6456107baa3af9', 'request_id': 'req-f224db07-2a5c-4f1a-96c0-7c279d482410'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:38.115520 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-f224db07-2a5c-4f1a-96c0-7c279d482410 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc2f85e6b0264ba3bd6456107baa3af9', 'request_id': 'req-f224db07-2a5c-4f1a-96c0-7c279d482410'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:38.128746 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-f224db07-2a5c-4f1a-96c0-7c279d482410 admin admin] The token cache is being invalidate because project cc2f85e6b0264ba3bd6456107baa3af9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:11:38.129683 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-f224db07-2a5c-4f1a-96c0-7c279d482410 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:38.130366 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-f224db07-2a5c-4f1a-96c0-7c279d482410 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:38.132109 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 957/1917] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:11:37 2022] DELETE /identity/v3/projects/cc2f85e6b0264ba3bd6456107baa3af9 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:38.132893 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f224db07-2a5c-4f1a-96c0-7c279d482410 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:38.134263 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-f224db07-2a5c-4f1a-96c0-7c279d482410 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:38.162163 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 961/1918] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:11:38.163212 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b32ae06-4954-4f99-9e91-e890cb095b1f None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:38.164465 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-3b32ae06-4954-4f99-9e91-e890cb095b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:38.177035 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b32ae06-4954-4f99-9e91-e890cb095b1f None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:38.181854 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79acc9f4-a1dd-4a38-bbe7-397e27019b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:38.182498 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79acc9f4-a1dd-4a38-bbe7-397e27019b0c admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:38.182773 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79acc9f4-a1dd-4a38-bbe7-397e27019b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:38.183074 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79acc9f4-a1dd-4a38-bbe7-397e27019b0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:38.183735 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79acc9f4-a1dd-4a38-bbe7-397e27019b0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:38.185331 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79acc9f4-a1dd-4a38-bbe7-397e27019b0c admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:38.196139 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 962/1919] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:11:38.199811 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79acc9f4-a1dd-4a38-bbe7-397e27019b0c admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:38.201473 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-79acc9f4-a1dd-4a38-bbe7-397e27019b0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:38.203776 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f224db07-2a5c-4f1a-96c0-7c279d482410 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:38.208478 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804736be-c5f5-499f-81c2-8a4d6b6da22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:38.209104 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804736be-c5f5-499f-81c2-8a4d6b6da22d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:38.209513 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804736be-c5f5-499f-81c2-8a4d6b6da22d admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:38.209789 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804736be-c5f5-499f-81c2-8a4d6b6da22d admin admin] PATH_INFO: `/v3/projects/5dd14725c7c04548ad29caf9c71afb73` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:38.210962 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804736be-c5f5-499f-81c2-8a4d6b6da22d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dd14725c7c04548ad29caf9c71afb73)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:38.212842 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804736be-c5f5-499f-81c2-8a4d6b6da22d admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:38.213999 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79acc9f4-a1dd-4a38-bbe7-397e27019b0c admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:38.218886 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eff52c-a77d-4a83-b930-cdea0245cad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:38.219941 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eff52c-a77d-4a83-b930-cdea0245cad9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:38.220239 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eff52c-a77d-4a83-b930-cdea0245cad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:38.220528 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eff52c-a77d-4a83-b930-cdea0245cad9 admin admin] PATH_INFO: `/v3/users/e5feed24e250426b9633cd08e7fa82c8` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:38.222090 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eff52c-a77d-4a83-b930-cdea0245cad9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5feed24e250426b9633cd08e7fa82c8)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:38.224144 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eff52c-a77d-4a83-b930-cdea0245cad9 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:38.225637 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:38.230271 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:38.269334 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-804736be-c5f5-499f-81c2-8a4d6b6da22d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dd14725c7c04548ad29caf9c71afb73', 'request_id': 'req-804736be-c5f5-499f-81c2-8a4d6b6da22d'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:38.275705 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-804736be-c5f5-499f-81c2-8a4d6b6da22d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dd14725c7c04548ad29caf9c71afb73', 'request_id': 'req-804736be-c5f5-499f-81c2-8a4d6b6da22d'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:38.277424 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-98eff52c-a77d-4a83-b930-cdea0245cad9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5feed24e250426b9633cd08e7fa82c8'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:38.278126 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-98eff52c-a77d-4a83-b930-cdea0245cad9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5feed24e250426b9633cd08e7fa82c8'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:38.278757 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-98eff52c-a77d-4a83-b930-cdea0245cad9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5feed24e250426b9633cd08e7fa82c8'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:38.281751 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-804736be-c5f5-499f-81c2-8a4d6b6da22d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dd14725c7c04548ad29caf9c71afb73', 'request_id': 'req-804736be-c5f5-499f-81c2-8a4d6b6da22d'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:38.292128 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-98eff52c-a77d-4a83-b930-cdea0245cad9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5feed24e250426b9633cd08e7fa82c8'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:38.295495 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-804736be-c5f5-499f-81c2-8a4d6b6da22d admin admin] The token cache is being invalidate because project 5dd14725c7c04548ad29caf9c71afb73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:11:38.295893 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-804736be-c5f5-499f-81c2-8a4d6b6da22d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:38.296683 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-804736be-c5f5-499f-81c2-8a4d6b6da22d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:38.298702 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 958/1920] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:11:38 2022] DELETE /identity/v3/projects/5dd14725c7c04548ad29caf9c71afb73 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:38.302915 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff25c297-776b-4eaa-84e8-0f65e8287406 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:38.302915 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff25c297-776b-4eaa-84e8-0f65e8287406 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:38.302915 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff25c297-776b-4eaa-84e8-0f65e8287406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:38.303253 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-98eff52c-a77d-4a83-b930-cdea0245cad9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5feed24e250426b9633cd08e7fa82c8'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:38.316142 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 963/1921] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:11:38 2022] DELETE /identity/v3/users/e5feed24e250426b9633cd08e7fa82c8 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:38.316861 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eff52c-a77d-4a83-b930-cdea0245cad9 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:38.318205 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-98eff52c-a77d-4a83-b930-cdea0245cad9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:38.320835 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-ff25c297-776b-4eaa-84e8-0f65e8287406 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:38.322079 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-ff25c297-776b-4eaa-84e8-0f65e8287406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:38.394751 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 959/1922] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:11:38.394751 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf7471e-62e8-49f7-a5d2-daaebcfd36d8 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:38.394751 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf7471e-62e8-49f7-a5d2-daaebcfd36d8 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:38.394751 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf7471e-62e8-49f7-a5d2-daaebcfd36d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:38.398418 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eff52c-a77d-4a83-b930-cdea0245cad9 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:38.404833 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50af2f1-ce72-4074-99e8-42587cec2646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:38.404833 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50af2f1-ce72-4074-99e8-42587cec2646 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:38.404833 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50af2f1-ce72-4074-99e8-42587cec2646 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:38.405266 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50af2f1-ce72-4074-99e8-42587cec2646 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:38.406005 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50af2f1-ce72-4074-99e8-42587cec2646 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:38.407609 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50af2f1-ce72-4074-99e8-42587cec2646 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:38.417339 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-acf7471e-62e8-49f7-a5d2-daaebcfd36d8 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:38.418576 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-acf7471e-62e8-49f7-a5d2-daaebcfd36d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:38.422431 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 964/1923] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:11:38.422431 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50af2f1-ce72-4074-99e8-42587cec2646 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:38.430863 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 960/1924] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:11:38.431717 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf7471e-62e8-49f7-a5d2-daaebcfd36d8 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:38.431824 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50af2f1-ce72-4074-99e8-42587cec2646 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:38.433195 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-acf7471e-62e8-49f7-a5d2-daaebcfd36d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:38.436787 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526cc3f8-e94c-48bf-a7bf-a7b14ae53b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:38.437393 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526cc3f8-e94c-48bf-a7bf-a7b14ae53b0b admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:38.437665 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526cc3f8-e94c-48bf-a7bf-a7b14ae53b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:38.438177 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526cc3f8-e94c-48bf-a7bf-a7b14ae53b0b admin admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:38.438684 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526cc3f8-e94c-48bf-a7bf-a7b14ae53b0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:11:38.438986 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526cc3f8-e94c-48bf-a7bf-a7b14ae53b0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:38.440569 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526cc3f8-e94c-48bf-a7bf-a7b14ae53b0b admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:38.446388 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf7471e-62e8-49f7-a5d2-daaebcfd36d8 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:38.452506 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 965/1925] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 11:11:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:11:38.456284 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db3aef-5e89-4eb9-bf92-93541dfa78fe None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:38.456284 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db3aef-5e89-4eb9-bf92-93541dfa78fe None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:38.456284 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db3aef-5e89-4eb9-bf92-93541dfa78fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:38.457489 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaac3ec-47a6-4809-a84c-7f8fa1ceafcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:38.458245 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaac3ec-47a6-4809-a84c-7f8fa1ceafcd admin admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:38.458525 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaac3ec-47a6-4809-a84c-7f8fa1ceafcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:38.458919 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaac3ec-47a6-4809-a84c-7f8fa1ceafcd admin admin] PATH_INFO: `/v3/projects/3db50ca5deed47edbea4a9cf0de81276/users/3d5fa7469a7b4ecb82cf9bbdd77d254b/roles/7c3871c0ab68438b9014489d50b53a22` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:38.475876 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-51db3aef-5e89-4eb9-bf92-93541dfa78fe None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:38.477106 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-51db3aef-5e89-4eb9-bf92-93541dfa78fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:38.478055 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaac3ec-47a6-4809-a84c-7f8fa1ceafcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3db50ca5deed47edbea4a9cf0de81276, user_id=3d5fa7469a7b4ecb82cf9bbdd77d254b, role_id=7c3871c0ab68438b9014489d50b53a22)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:38.481171 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaac3ec-47a6-4809-a84c-7f8fa1ceafcd admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:38.485879 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 966/1926] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:11:38.486782 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51db3aef-5e89-4eb9-bf92-93541dfa78fe None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:38.501286 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51db3aef-5e89-4eb9-bf92-93541dfa78fe None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:38.504876 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 961/1927] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:11:38 2022] PUT /identity/v3/projects/3db50ca5deed47edbea4a9cf0de81276/users/3d5fa7469a7b4ecb82cf9bbdd77d254b/roles/7c3871c0ab68438b9014489d50b53a22 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:38.506149 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaac3ec-47a6-4809-a84c-7f8fa1ceafcd admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:38.576342 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:38.585850 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50688f99-5e0c-4401-b1da-7926e55d62c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:38.586612 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50688f99-5e0c-4401-b1da-7926e55d62c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:38.587030 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50688f99-5e0c-4401-b1da-7926e55d62c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:38.587301 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50688f99-5e0c-4401-b1da-7926e55d62c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:38.588013 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50688f99-5e0c-4401-b1da-7926e55d62c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:38.590271 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50688f99-5e0c-4401-b1da-7926e55d62c2 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:38.591828 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaac3ec-47a6-4809-a84c-7f8fa1ceafcd admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:38.599141 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa17e75-c6ce-45f8-a3eb-d6b4a83eb933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:38.600032 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa17e75-c6ce-45f8-a3eb-d6b4a83eb933 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:38.600402 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa17e75-c6ce-45f8-a3eb-d6b4a83eb933 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:38.600744 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa17e75-c6ce-45f8-a3eb-d6b4a83eb933 admin admin] PATH_INFO: `/v3/domains` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:38.601636 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa17e75-c6ce-45f8-a3eb-d6b4a83eb933 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:11:38.601875 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa17e75-c6ce-45f8-a3eb-d6b4a83eb933 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:38.603707 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa17e75-c6ce-45f8-a3eb-d6b4a83eb933 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:38.617527 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 962/1928] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 11:11:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:11:38.619430 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c75e97e-e049-4db2-bb73-c75f1c7b0215 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:38.619430 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c75e97e-e049-4db2-bb73-c75f1c7b0215 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:38.619652 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c75e97e-e049-4db2-bb73-c75f1c7b0215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:38.627659 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 967/1929] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:11:38 2022] POST /identity/v3/projects => generated 369 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:11:38.628545 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50688f99-5e0c-4401-b1da-7926e55d62c2 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:38.638814 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:38.663548 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-6c75e97e-e049-4db2-bb73-c75f1c7b0215 None None] MFA Rules not processed for user `3d5fa7469a7b4ecb82cf9bbdd77d254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:38.666044 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-6c75e97e-e049-4db2-bb73-c75f1c7b0215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:38.709529 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50688f99-5e0c-4401-b1da-7926e55d62c2 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:38.714688 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ceb3d2-0a51-4e73-8da9-aa1d49a2e65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:38.715371 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ceb3d2-0a51-4e73-8da9-aa1d49a2e65f admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:38.716827 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ceb3d2-0a51-4e73-8da9-aa1d49a2e65f admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:38.716827 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ceb3d2-0a51-4e73-8da9-aa1d49a2e65f admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:38.716827 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ceb3d2-0a51-4e73-8da9-aa1d49a2e65f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:38.718695 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ceb3d2-0a51-4e73-8da9-aa1d49a2e65f admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:38.750625 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 963/1930] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:11:38.754818 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 968/1931] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:11:38 2022] POST /identity/v3/projects => generated 383 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:11:38.755749 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ceb3d2-0a51-4e73-8da9-aa1d49a2e65f admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:38.757548 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-40ceb3d2-0a51-4e73-8da9-aa1d49a2e65f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:38.758695 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c75e97e-e049-4db2-bb73-c75f1c7b0215 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:38.770608 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c75e97e-e049-4db2-bb73-c75f1c7b0215 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:38.834760 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ceb3d2-0a51-4e73-8da9-aa1d49a2e65f admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:38.839795 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cf9aa3-8280-4e26-864e-3c96b218270e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:38.840579 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf9aa3-8280-4e26-864e-3c96b218270e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:38.840867 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf9aa3-8280-4e26-864e-3c96b218270e admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:38.841141 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf9aa3-8280-4e26-864e-3c96b218270e admin admin] PATH_INFO: `/v3/projects/e06a01dff4a8491a8a288590a6de87bf` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:38.843078 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cf9aa3-8280-4e26-864e-3c96b218270e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e06a01dff4a8491a8a288590a6de87bf)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:38.844628 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657dc201-e1cf-49ca-be9b-8610535015d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:38.845251 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657dc201-e1cf-49ca-be9b-8610535015d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:38.845533 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657dc201-e1cf-49ca-be9b-8610535015d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:38.845929 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cf9aa3-8280-4e26-864e-3c96b218270e admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:38.846055 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657dc201-e1cf-49ca-be9b-8610535015d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:38.846614 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657dc201-e1cf-49ca-be9b-8610535015d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:38.849128 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657dc201-e1cf-49ca-be9b-8610535015d8 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:38.876041 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 964/1932] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:11:38 2022] POST /identity/v3/users => generated 285 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:11:38.876041 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657dc201-e1cf-49ca-be9b-8610535015d8 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:38.889605 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657dc201-e1cf-49ca-be9b-8610535015d8 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:38.898370 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3fe103-ae41-4f7b-8d31-39fed7d95268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:38.898989 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3fe103-ae41-4f7b-8d31-39fed7d95268 admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:38.899340 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3fe103-ae41-4f7b-8d31-39fed7d95268 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:38.899527 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3fe103-ae41-4f7b-8d31-39fed7d95268 admin admin] PATH_INFO: `/v3/projects` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:38.900166 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3fe103-ae41-4f7b-8d31-39fed7d95268 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:38.902121 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3fe103-ae41-4f7b-8d31-39fed7d95268 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:38.918017 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-27cf9aa3-8280-4e26-864e-3c96b218270e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e06a01dff4a8491a8a288590a6de87bf', 'request_id': 'req-27cf9aa3-8280-4e26-864e-3c96b218270e'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:38.926995 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-27cf9aa3-8280-4e26-864e-3c96b218270e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e06a01dff4a8491a8a288590a6de87bf', 'request_id': 'req-27cf9aa3-8280-4e26-864e-3c96b218270e'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:38.935692 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-27cf9aa3-8280-4e26-864e-3c96b218270e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e06a01dff4a8491a8a288590a6de87bf', 'request_id': 'req-27cf9aa3-8280-4e26-864e-3c96b218270e'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:38.938034 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 965/1933] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:11:38 2022] POST /identity/v3/projects => generated 385 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:11:38.939061 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3fe103-ae41-4f7b-8d31-39fed7d95268 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:38.942573 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:38.951481 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-27cf9aa3-8280-4e26-864e-3c96b218270e admin admin] The token cache is being invalidate because project e06a01dff4a8491a8a288590a6de87bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:11:38.952057 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-27cf9aa3-8280-4e26-864e-3c96b218270e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:38.953145 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-27cf9aa3-8280-4e26-864e-3c96b218270e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:38.955386 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 969/1934] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:11:38 2022] DELETE /identity/v3/projects/e06a01dff4a8491a8a288590a6de87bf => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:38.956212 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cf9aa3-8280-4e26-864e-3c96b218270e admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:38.958293 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-27cf9aa3-8280-4e26-864e-3c96b218270e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:39.022063 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3fe103-ae41-4f7b-8d31-39fed7d95268 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:39.027017 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaefc95-1198-4a3a-9b98-2510de716232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:39.027629 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaefc95-1198-4a3a-9b98-2510de716232 admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:39.027909 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaefc95-1198-4a3a-9b98-2510de716232 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:39.028204 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaefc95-1198-4a3a-9b98-2510de716232 admin admin] PATH_INFO: `/v3/users` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:39.028835 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaefc95-1198-4a3a-9b98-2510de716232 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:39.030783 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaefc95-1198-4a3a-9b98-2510de716232 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:39.033241 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cf9aa3-8280-4e26-864e-3c96b218270e admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:39.038752 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f519e55-f55b-454c-a139-ee3a51c6f19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:39.039414 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f519e55-f55b-454c-a139-ee3a51c6f19a admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:39.039635 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f519e55-f55b-454c-a139-ee3a51c6f19a admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:39.039912 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f519e55-f55b-454c-a139-ee3a51c6f19a admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:39.040573 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f519e55-f55b-454c-a139-ee3a51c6f19a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:39.041559 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:39.042166 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f519e55-f55b-454c-a139-ee3a51c6f19a admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:39.052718 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 970/1935] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:11:39.053513 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f519e55-f55b-454c-a139-ee3a51c6f19a admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:39.057110 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 966/1936] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:11:38 2022] POST /identity/v3/users => generated 292 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:11:39.057110 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266b405-5520-4ab6-9382-cadfa1624f1d None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:39.057343 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-6f519e55-f55b-454c-a139-ee3a51c6f19a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:39.057438 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266b405-5520-4ab6-9382-cadfa1624f1d None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:39.057438 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266b405-5520-4ab6-9382-cadfa1624f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:39.069744 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f519e55-f55b-454c-a139-ee3a51c6f19a admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:39.074488 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421899f8-1be9-4412-b79b-6f2532f1a6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:39.075103 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421899f8-1be9-4412-b79b-6f2532f1a6a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:39.075418 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421899f8-1be9-4412-b79b-6f2532f1a6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:39.075700 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421899f8-1be9-4412-b79b-6f2532f1a6a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:39.076331 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421899f8-1be9-4412-b79b-6f2532f1a6a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:39.077185 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-6266b405-5520-4ab6-9382-cadfa1624f1d None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:39.078287 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421899f8-1be9-4412-b79b-6f2532f1a6a6 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:39.078434 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-6266b405-5520-4ab6-9382-cadfa1624f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:39.086889 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 967/1937] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:11:39.087963 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6266b405-5520-4ab6-9382-cadfa1624f1d None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:39.101114 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 971/1938] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:11:39 2022] POST /identity/v3/users => generated 299 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:11:39.102414 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421899f8-1be9-4412-b79b-6f2532f1a6a6 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:39.104244 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-421899f8-1be9-4412-b79b-6f2532f1a6a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:39.104400 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6266b405-5520-4ab6-9382-cadfa1624f1d None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:39.108929 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7655e510-df17-4efb-b17c-71b29c22cc97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:39.109522 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655e510-df17-4efb-b17c-71b29c22cc97 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:39.109798 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655e510-df17-4efb-b17c-71b29c22cc97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:39.110106 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655e510-df17-4efb-b17c-71b29c22cc97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:39.110749 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7655e510-df17-4efb-b17c-71b29c22cc97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:39.112311 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7655e510-df17-4efb-b17c-71b29c22cc97 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:39.116374 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421899f8-1be9-4412-b79b-6f2532f1a6a6 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:39.121297 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a7bd9-4d5b-4b63-a2bf-63e0b6410324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:39.121899 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a7bd9-4d5b-4b63-a2bf-63e0b6410324 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:39.122221 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a7bd9-4d5b-4b63-a2bf-63e0b6410324 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:39.122340 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 968/1939] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:11:39.122504 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a7bd9-4d5b-4b63-a2bf-63e0b6410324 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:39.123402 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6a7bd9-4d5b-4b63-a2bf-63e0b6410324 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:39.123744 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da717b-ca74-4d52-b2d3-baca87c2ea5e None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:39.124021 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da717b-ca74-4d52-b2d3-baca87c2ea5e None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:39.124314 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da717b-ca74-4d52-b2d3-baca87c2ea5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:39.124990 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6a7bd9-4d5b-4b63-a2bf-63e0b6410324 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:39.139511 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 972/1940] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:11:39.139511 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a7bd9-4d5b-4b63-a2bf-63e0b6410324 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:39.145250 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-60da717b-ca74-4d52-b2d3-baca87c2ea5e None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:39.146472 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-60da717b-ca74-4d52-b2d3-baca87c2ea5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:39.149544 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a7bd9-4d5b-4b63-a2bf-63e0b6410324 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:39.154065 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48fc12e-6d22-406e-b3ca-100f97f705d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:39.154301 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 969/1941] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:11:39.155099 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60da717b-ca74-4d52-b2d3-baca87c2ea5e None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:39.157671 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48fc12e-6d22-406e-b3ca-100f97f705d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:39.157980 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48fc12e-6d22-406e-b3ca-100f97f705d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:39.158258 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48fc12e-6d22-406e-b3ca-100f97f705d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:39.158903 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48fc12e-6d22-406e-b3ca-100f97f705d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:39.160516 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48fc12e-6d22-406e-b3ca-100f97f705d9 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:39.164565 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60da717b-ca74-4d52-b2d3-baca87c2ea5e None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:39.169450 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8737502e-b28d-42dd-970f-87e8ce793c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:39.170110 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737502e-b28d-42dd-970f-87e8ce793c63 admin admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:39.170387 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737502e-b28d-42dd-970f-87e8ce793c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:39.170658 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737502e-b28d-42dd-970f-87e8ce793c63 admin admin] PATH_INFO: `/v3/projects/05af354cda9844f18e61bb195d61d205/users/8d1a6b8b2cad41d4b291db0bae73b418/roles/7c3871c0ab68438b9014489d50b53a22` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:39.170747 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 973/1942] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:11:39.174723 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48fc12e-6d22-406e-b3ca-100f97f705d9 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:39.184141 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48fc12e-6d22-406e-b3ca-100f97f705d9 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:39.185924 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8737502e-b28d-42dd-970f-87e8ce793c63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05af354cda9844f18e61bb195d61d205, user_id=8d1a6b8b2cad41d4b291db0bae73b418, role_id=7c3871c0ab68438b9014489d50b53a22)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:39.188620 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8737502e-b28d-42dd-970f-87e8ce793c63 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:39.188728 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3575e5df-6e2e-4701-bcb5-5ccf9867e8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:39.189256 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575e5df-6e2e-4701-bcb5-5ccf9867e8f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:39.189536 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575e5df-6e2e-4701-bcb5-5ccf9867e8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:39.189812 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575e5df-6e2e-4701-bcb5-5ccf9867e8f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:39.190477 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3575e5df-6e2e-4701-bcb5-5ccf9867e8f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:39.192576 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3575e5df-6e2e-4701-bcb5-5ccf9867e8f5 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:39.202135 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 970/1943] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:11:39 2022] PUT /identity/v3/projects/05af354cda9844f18e61bb195d61d205/users/8d1a6b8b2cad41d4b291db0bae73b418/roles/7c3871c0ab68438b9014489d50b53a22 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:39.202719 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8737502e-b28d-42dd-970f-87e8ce793c63 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:39.203070 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 974/1944] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:11:39.203853 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3575e5df-6e2e-4701-bcb5-5ccf9867e8f5 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:39.215070 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3575e5df-6e2e-4701-bcb5-5ccf9867e8f5 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:39.266354 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8737502e-b28d-42dd-970f-87e8ce793c63 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:39.271755 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a26795-83b5-4fd5-b9a0-9dcc8eb8c79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:39.272075 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dea2de-5c24-44ea-9e69-7f28be10b816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:39.272363 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a26795-83b5-4fd5-b9a0-9dcc8eb8c79e admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:39.272779 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a26795-83b5-4fd5-b9a0-9dcc8eb8c79e admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:39.272951 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dea2de-5c24-44ea-9e69-7f28be10b816 admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:39.273039 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a26795-83b5-4fd5-b9a0-9dcc8eb8c79e admin admin] PATH_INFO: `/v3/domains` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:39.273125 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dea2de-5c24-44ea-9e69-7f28be10b816 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:39.273337 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dea2de-5c24-44ea-9e69-7f28be10b816 admin admin] PATH_INFO: `/v3/projects/71ef0b4452d24dbebd91107d84d070c7/users/7db1d22bbeb64ad198ca403dd6f561c8/roles/ea564961b1db4eb4a1d4d880964611b2` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:39.273742 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a26795-83b5-4fd5-b9a0-9dcc8eb8c79e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:11:39.274128 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a26795-83b5-4fd5-b9a0-9dcc8eb8c79e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:39.275923 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a26795-83b5-4fd5-b9a0-9dcc8eb8c79e admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:39.287186 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 971/1945] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 11:11:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:11:39.288145 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a26795-83b5-4fd5-b9a0-9dcc8eb8c79e admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:39.288257 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dea2de-5c24-44ea-9e69-7f28be10b816 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71ef0b4452d24dbebd91107d84d070c7, user_id=7db1d22bbeb64ad198ca403dd6f561c8, role_id=ea564961b1db4eb4a1d4d880964611b2)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:39.290892 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dea2de-5c24-44ea-9e69-7f28be10b816 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:39.297807 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a26795-83b5-4fd5-b9a0-9dcc8eb8c79e admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:39.303476 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 975/1946] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:11:39 2022] PUT /identity/v3/projects/71ef0b4452d24dbebd91107d84d070c7/users/7db1d22bbeb64ad198ca403dd6f561c8/roles/ea564961b1db4eb4a1d4d880964611b2 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:39.304684 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08235fa-9b34-473b-be3b-8675ce3d3aab None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:39.304965 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08235fa-9b34-473b-be3b-8675ce3d3aab None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:39.305236 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08235fa-9b34-473b-be3b-8675ce3d3aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:39.334059 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-d08235fa-9b34-473b-be3b-8675ce3d3aab None None] MFA Rules not processed for user `8d1a6b8b2cad41d4b291db0bae73b418`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:39.335273 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-d08235fa-9b34-473b-be3b-8675ce3d3aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:39.347166 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:39.355534 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dc9488-048e-4858-b432-0c32a3eec343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:39.356234 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc9488-048e-4858-b432-0c32a3eec343 admin admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:39.356514 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc9488-048e-4858-b432-0c32a3eec343 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:39.356786 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc9488-048e-4858-b432-0c32a3eec343 admin admin] PATH_INFO: `/v3/projects/fd1aee336bce4536998cfe70b8877562/users/49a6ee24453f4c8bb3a1119f39af6a72/roles/7c3871c0ab68438b9014489d50b53a22` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:39.371525 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dc9488-048e-4858-b432-0c32a3eec343 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd1aee336bce4536998cfe70b8877562, user_id=49a6ee24453f4c8bb3a1119f39af6a72, role_id=7c3871c0ab68438b9014489d50b53a22)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:39.374458 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dc9488-048e-4858-b432-0c32a3eec343 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:39.387260 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 972/1947] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:11:39 2022] PUT /identity/v3/projects/fd1aee336bce4536998cfe70b8877562/users/49a6ee24453f4c8bb3a1119f39af6a72/roles/7c3871c0ab68438b9014489d50b53a22 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:39.390812 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dc9488-048e-4858-b432-0c32a3eec343 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:39.404952 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 976/1948] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:11:39.405628 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08235fa-9b34-473b-be3b-8675ce3d3aab None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:39.417410 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:39.419182 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08235fa-9b34-473b-be3b-8675ce3d3aab None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:39.457465 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dc9488-048e-4858-b432-0c32a3eec343 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:39.462334 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084704d4-930c-4400-8c12-8955d96dee58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:39.463216 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084704d4-930c-4400-8c12-8955d96dee58 admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:39.463495 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084704d4-930c-4400-8c12-8955d96dee58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:39.463761 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084704d4-930c-4400-8c12-8955d96dee58 admin admin] PATH_INFO: `/v3/projects` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:39.464385 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084704d4-930c-4400-8c12-8955d96dee58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:39.466319 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084704d4-930c-4400-8c12-8955d96dee58 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:39.476677 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba38413-60fa-43bb-a160-3f8d5cf66dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:39.477404 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba38413-60fa-43bb-a160-3f8d5cf66dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:39.477682 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba38413-60fa-43bb-a160-3f8d5cf66dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:39.478111 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba38413-60fa-43bb-a160-3f8d5cf66dd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:39.478703 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba38413-60fa-43bb-a160-3f8d5cf66dd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:39.480803 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba38413-60fa-43bb-a160-3f8d5cf66dd0 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:39.491547 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 977/1949] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:11:39.496099 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 973/1950] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:11:39 2022] POST /identity/v3/projects => generated 389 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:11:39.496099 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084704d4-930c-4400-8c12-8955d96dee58 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:39.496308 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83392bfe-77ad-4e80-b490-6d33e06f77f4 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:39.496308 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83392bfe-77ad-4e80-b490-6d33e06f77f4 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:39.496308 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83392bfe-77ad-4e80-b490-6d33e06f77f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:39.498279 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-084704d4-930c-4400-8c12-8955d96dee58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:39.515458 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-83392bfe-77ad-4e80-b490-6d33e06f77f4 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:39.516643 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-83392bfe-77ad-4e80-b490-6d33e06f77f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:39.554797 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084704d4-930c-4400-8c12-8955d96dee58 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:39.558414 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44801dc8-10da-4426-a80a-7785f757dd4a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '399f7d3700a24cb486e56b409a6e5429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:39.559017 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44801dc8-10da-4426-a80a-7785f757dd4a service glance] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:39.559292 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44801dc8-10da-4426-a80a-7785f757dd4a service glance] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:39.559558 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44801dc8-10da-4426-a80a-7785f757dd4a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:39.576776 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 978/1951] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:11:39.577605 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83392bfe-77ad-4e80-b490-6d33e06f77f4 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:39.588516 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83392bfe-77ad-4e80-b490-6d33e06f77f4 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:39.593697 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e0fa33-992d-4b22-a507-dd3e132f88a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:39.594433 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e0fa33-992d-4b22-a507-dd3e132f88a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:39.594737 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e0fa33-992d-4b22-a507-dd3e132f88a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:39.595016 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e0fa33-992d-4b22-a507-dd3e132f88a5 admin admin] PATH_INFO: `/v3/projects/71ef0b4452d24dbebd91107d84d070c7/users/7db1d22bbeb64ad198ca403dd6f561c8/roles/ea564961b1db4eb4a1d4d880964611b2` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:39.597403 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e0fa33-992d-4b22-a507-dd3e132f88a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71ef0b4452d24dbebd91107d84d070c7, user_id=7db1d22bbeb64ad198ca403dd6f561c8, role_id=ea564961b1db4eb4a1d4d880964611b2)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:39.600584 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e0fa33-992d-4b22-a507-dd3e132f88a5 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:39.614414 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 979/1952] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:11:39 2022] PUT /identity/v3/projects/71ef0b4452d24dbebd91107d84d070c7/users/7db1d22bbeb64ad198ca403dd6f561c8/roles/ea564961b1db4eb4a1d4d880964611b2 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:39.615315 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e0fa33-992d-4b22-a507-dd3e132f88a5 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:39.641272 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44801dc8-10da-4426-a80a-7785f757dd4a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:39.642725 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44801dc8-10da-4426-a80a-7785f757dd4a service glance] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:39.652914 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 974/1953] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:11:39 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:11:39.653713 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44801dc8-10da-4426-a80a-7785f757dd4a service glance] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:39.655049 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-44801dc8-10da-4426-a80a-7785f757dd4a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:39.689408 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:39.715854 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e0fa33-992d-4b22-a507-dd3e132f88a5 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:39.721415 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cedb1f-02cb-48e5-be67-ca7fe76dee38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:39.722192 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cedb1f-02cb-48e5-be67-ca7fe76dee38 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:39.722725 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cedb1f-02cb-48e5-be67-ca7fe76dee38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:39.722971 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cedb1f-02cb-48e5-be67-ca7fe76dee38 admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:39.723738 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cedb1f-02cb-48e5-be67-ca7fe76dee38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:39.726211 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cedb1f-02cb-48e5-be67-ca7fe76dee38 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:39.733451 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44801dc8-10da-4426-a80a-7785f757dd4a service glance] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:39.759559 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 980/1954] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:11:39 2022] POST /identity/v3/users => generated 295 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:11:39.759559 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac3c9a-a426-4dc9-9338-a7b30d36825f None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:39.759559 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac3c9a-a426-4dc9-9338-a7b30d36825f None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:39.759559 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac3c9a-a426-4dc9-9338-a7b30d36825f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:39.770364 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:39.791413 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-18ac3c9a-a426-4dc9-9338-a7b30d36825f None None] MFA Rules not processed for user `7db1d22bbeb64ad198ca403dd6f561c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:39.792878 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-18ac3c9a-a426-4dc9-9338-a7b30d36825f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:39.825591 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac07dd-8770-48ed-be53-a5be5ac58b52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:39.826912 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac07dd-8770-48ed-be53-a5be5ac58b52 service neutron] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:39.827293 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac07dd-8770-48ed-be53-a5be5ac58b52 service neutron] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:39.827867 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac07dd-8770-48ed-be53-a5be5ac58b52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:39.840159 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ac07dd-8770-48ed-be53-a5be5ac58b52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:39.843115 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ac07dd-8770-48ed-be53-a5be5ac58b52 service neutron] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:39.854474 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 975/1955] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:11:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:11:39.855297 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac07dd-8770-48ed-be53-a5be5ac58b52 service neutron] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:39.866295 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac07dd-8770-48ed-be53-a5be5ac58b52 service neutron] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:39.872496 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a091464-4fab-4839-926d-7c8a6645fe91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:39.873725 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a091464-4fab-4839-926d-7c8a6645fe91 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:39.873725 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a091464-4fab-4839-926d-7c8a6645fe91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:39.874134 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a091464-4fab-4839-926d-7c8a6645fe91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:39.874992 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a091464-4fab-4839-926d-7c8a6645fe91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:39.876824 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a091464-4fab-4839-926d-7c8a6645fe91 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:39.890347 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 981/1956] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:39 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:11:39.902236 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ac3c9a-a426-4dc9-9338-a7b30d36825f None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:39.904056 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-18ac3c9a-a426-4dc9-9338-a7b30d36825f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:39.904638 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 976/1957] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:11:39.906004 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a091464-4fab-4839-926d-7c8a6645fe91 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:39.918680 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a091464-4fab-4839-926d-7c8a6645fe91 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:39.924833 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8155f5-7924-47ca-991e-cbb3abf6220e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:39.925447 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8155f5-7924-47ca-991e-cbb3abf6220e admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:39.926627 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8155f5-7924-47ca-991e-cbb3abf6220e admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:39.926907 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8155f5-7924-47ca-991e-cbb3abf6220e admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:39.927557 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8155f5-7924-47ca-991e-cbb3abf6220e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:39.929638 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8155f5-7924-47ca-991e-cbb3abf6220e admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:39.947993 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 977/1958] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:11:39.949167 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8155f5-7924-47ca-991e-cbb3abf6220e admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:39.960417 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8155f5-7924-47ca-991e-cbb3abf6220e admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:39.965799 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acde4efc-a090-4742-964f-07099347aacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:39.966700 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde4efc-a090-4742-964f-07099347aacc admin admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:39.967046 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde4efc-a090-4742-964f-07099347aacc admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:39.967388 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde4efc-a090-4742-964f-07099347aacc admin admin] PATH_INFO: `/v3/projects/dbc47473096e4e74baa58bc48fed9f13/users/f8d3c5b594174f74815d6f17a34f075e/roles/7c3871c0ab68438b9014489d50b53a22` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:40.001389 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acde4efc-a090-4742-964f-07099347aacc admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbc47473096e4e74baa58bc48fed9f13, user_id=f8d3c5b594174f74815d6f17a34f075e, role_id=7c3871c0ab68438b9014489d50b53a22)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:40.004430 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acde4efc-a090-4742-964f-07099347aacc admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:40.019160 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ac3c9a-a426-4dc9-9338-a7b30d36825f None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:40.026829 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4603cd42-7154-415b-9e4f-e7fee064db45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f4c2fc51f54f0e977648b13efaed1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:40.028541 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603cd42-7154-415b-9e4f-e7fee064db45 service cinder] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:40.029128 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603cd42-7154-415b-9e4f-e7fee064db45 service cinder] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:40.030151 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603cd42-7154-415b-9e4f-e7fee064db45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:40.036272 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 978/1959] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:11:39 2022] PUT /identity/v3/projects/dbc47473096e4e74baa58bc48fed9f13/users/f8d3c5b594174f74815d6f17a34f075e/roles/7c3871c0ab68438b9014489d50b53a22 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:40.046387 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c4a3c5-9f3a-46e2-a4a0-a2ca6c287cde None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:40.047041 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c4a3c5-9f3a-46e2-a4a0-a2ca6c287cde None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:40.047041 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c4a3c5-9f3a-46e2-a4a0-a2ca6c287cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:40.052440 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4603cd42-7154-415b-9e4f-e7fee064db45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:40.054194 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4603cd42-7154-415b-9e4f-e7fee064db45 service cinder] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:40.069864 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 982/1960] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:11:39 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:11:40.098027 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-88c4a3c5-9f3a-46e2-a4a0-a2ca6c287cde None None] MFA Rules not processed for user `f8d3c5b594174f74815d6f17a34f075e`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:40.099679 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-88c4a3c5-9f3a-46e2-a4a0-a2ca6c287cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:40.280565 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 979/1961] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:40 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:11:40.291116 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4603cd42-7154-415b-9e4f-e7fee064db45 service cinder] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:40.292576 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-4603cd42-7154-415b-9e4f-e7fee064db45 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:40.305881 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4603cd42-7154-415b-9e4f-e7fee064db45 service cinder] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:40.373611 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ba46ca-5f30-4148-bc80-b420851c9ac1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f4c2fc51f54f0e977648b13efaed1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:40.374912 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba46ca-5f30-4148-bc80-b420851c9ac1 service cinder] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:40.375560 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba46ca-5f30-4148-bc80-b420851c9ac1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:40.376229 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba46ca-5f30-4148-bc80-b420851c9ac1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:40.393756 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ba46ca-5f30-4148-bc80-b420851c9ac1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:40.397796 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ba46ca-5f30-4148-bc80-b420851c9ac1 service cinder] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:40.401791 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:40.412871 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 983/1962] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:11:40 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 13 11:11:40.857779 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c4a3c5-9f3a-46e2-a4a0-a2ca6c287cde None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:40.868765 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c4a3c5-9f3a-46e2-a4a0-a2ca6c287cde None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:40.874621 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e58f4-7c5b-44a4-aed1-1afe61a04ad3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f4c2fc51f54f0e977648b13efaed1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:40.875236 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e58f4-7c5b-44a4-aed1-1afe61a04ad3 service cinder] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:40.875519 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e58f4-7c5b-44a4-aed1-1afe61a04ad3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:40.875795 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e58f4-7c5b-44a4-aed1-1afe61a04ad3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:40.887102 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-680e58f4-7c5b-44a4-aed1-1afe61a04ad3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:40.965341 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680e58f4-7c5b-44a4-aed1-1afe61a04ad3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:40.967012 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680e58f4-7c5b-44a4-aed1-1afe61a04ad3 service cinder] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:40.978465 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 980/1963] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:11:40 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:11:41.050403 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5293269e-4808-446b-8660-22e09a2420f3 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:41.051235 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5293269e-4808-446b-8660-22e09a2420f3 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:41.051518 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5293269e-4808-446b-8660-22e09a2420f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:41.085346 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-5293269e-4808-446b-8660-22e09a2420f3 None None] MFA Rules not processed for user `49a6ee24453f4c8bb3a1119f39af6a72`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:41.086625 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-5293269e-4808-446b-8660-22e09a2420f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:41.170155 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 984/1964] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:11:41.184000 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e58f4-7c5b-44a4-aed1-1afe61a04ad3 service cinder] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:41.188731 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:41.197253 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e58f4-7c5b-44a4-aed1-1afe61a04ad3 service cinder] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:41.203636 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636cab8d-ab98-4273-80da-6e674644efb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f4c2fc51f54f0e977648b13efaed1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:41.205097 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636cab8d-ab98-4273-80da-6e674644efb4 service cinder] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:41.205097 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636cab8d-ab98-4273-80da-6e674644efb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:41.205610 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636cab8d-ab98-4273-80da-6e674644efb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:41.216139 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636cab8d-ab98-4273-80da-6e674644efb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:41.217758 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636cab8d-ab98-4273-80da-6e674644efb4 service cinder] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:41.227831 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 981/1965] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:11:41 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:11:42.610052 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3eca7e-7887-4011-a629-dac9aec35656 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:42.610659 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3eca7e-7887-4011-a629-dac9aec35656 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:42.610659 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3eca7e-7887-4011-a629-dac9aec35656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:42.630882 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-9c3eca7e-7887-4011-a629-dac9aec35656 None None] MFA Rules not processed for user `49a6ee24453f4c8bb3a1119f39af6a72`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:42.632148 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-9c3eca7e-7887-4011-a629-dac9aec35656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:42.639082 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 985/1966] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:11:45.185840 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636cab8d-ab98-4273-80da-6e674644efb4 service cinder] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:45.194945 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636cab8d-ab98-4273-80da-6e674644efb4 service cinder] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:45.202302 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1cc210-c788-45f0-ac92-8209209162c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f4c2fc51f54f0e977648b13efaed1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:45.202932 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1cc210-c788-45f0-ac92-8209209162c9 service cinder] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:45.203215 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1cc210-c788-45f0-ac92-8209209162c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:45.203491 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1cc210-c788-45f0-ac92-8209209162c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:45.205337 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-0e1cc210-c788-45f0-ac92-8209209162c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:45.270659 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1cc210-c788-45f0-ac92-8209209162c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:45.272365 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1cc210-c788-45f0-ac92-8209209162c9 service cinder] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:45.281262 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 982/1967] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:11:45 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:11:47.753814 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3eca7e-7887-4011-a629-dac9aec35656 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:47.873202 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3eca7e-7887-4011-a629-dac9aec35656 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:47.887905 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ac71d5-a8c8-4226-b482-4a77480787ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:47.888618 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac71d5-a8c8-4226-b482-4a77480787ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:47.888902 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac71d5-a8c8-4226-b482-4a77480787ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:47.889178 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac71d5-a8c8-4226-b482-4a77480787ea admin admin] PATH_INFO: `/v3/users/1913c52c2889442d88965b04bb89cec3` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:47.890382 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ac71d5-a8c8-4226-b482-4a77480787ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=1913c52c2889442d88965b04bb89cec3)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:47.892435 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ac71d5-a8c8-4226-b482-4a77480787ea admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:47.960576 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-58ac71d5-a8c8-4226-b482-4a77480787ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1913c52c2889442d88965b04bb89cec3'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:47.961804 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-58ac71d5-a8c8-4226-b482-4a77480787ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1913c52c2889442d88965b04bb89cec3'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:47.962956 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-58ac71d5-a8c8-4226-b482-4a77480787ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1913c52c2889442d88965b04bb89cec3'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:47.981354 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-58ac71d5-a8c8-4226-b482-4a77480787ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1913c52c2889442d88965b04bb89cec3'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:47.990414 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-58ac71d5-a8c8-4226-b482-4a77480787ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1913c52c2889442d88965b04bb89cec3'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:48.000916 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:48.014824 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 986/1968] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:11:47 2022] DELETE /identity/v3/users/1913c52c2889442d88965b04bb89cec3 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:48.015039 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a3078-47c4-4ba2-911e-669f38583495 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:48.015039 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a3078-47c4-4ba2-911e-669f38583495 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:48.015039 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a3078-47c4-4ba2-911e-669f38583495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:48.040253 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-707a3078-47c4-4ba2-911e-669f38583495 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:48.042036 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-707a3078-47c4-4ba2-911e-669f38583495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:48.125379 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 983/1969] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:11:48.138384 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ac71d5-a8c8-4226-b482-4a77480787ea admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:48.139840 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-58ac71d5-a8c8-4226-b482-4a77480787ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:48.219417 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ac71d5-a8c8-4226-b482-4a77480787ea admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:48.225703 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3400684-3158-43e1-9075-302ca5bf4275 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:48.226391 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3400684-3158-43e1-9075-302ca5bf4275 service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:48.226667 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3400684-3158-43e1-9075-302ca5bf4275 service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:48.227103 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3400684-3158-43e1-9075-302ca5bf4275 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:48.241251 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3400684-3158-43e1-9075-302ca5bf4275 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:48.242913 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3400684-3158-43e1-9075-302ca5bf4275 service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:48.257511 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 987/1970] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:11:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:11:48.688223 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707a3078-47c4-4ba2-911e-669f38583495 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:48.690459 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-707a3078-47c4-4ba2-911e-669f38583495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:48.719393 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707a3078-47c4-4ba2-911e-669f38583495 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:48.725235 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef176a5-5ae6-4876-9a52-8240b5d44a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:48.725538 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef176a5-5ae6-4876-9a52-8240b5d44a21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:48.725809 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef176a5-5ae6-4876-9a52-8240b5d44a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:48.726126 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef176a5-5ae6-4876-9a52-8240b5d44a21 admin admin] PATH_INFO: `/v3/projects/aa84599d91ee43159017c46683a20299` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:48.727470 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef176a5-5ae6-4876-9a52-8240b5d44a21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa84599d91ee43159017c46683a20299)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:48.729975 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef176a5-5ae6-4876-9a52-8240b5d44a21 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:48.783457 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-fef176a5-5ae6-4876-9a52-8240b5d44a21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa84599d91ee43159017c46683a20299', 'request_id': 'req-fef176a5-5ae6-4876-9a52-8240b5d44a21'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:48.792459 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-fef176a5-5ae6-4876-9a52-8240b5d44a21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa84599d91ee43159017c46683a20299', 'request_id': 'req-fef176a5-5ae6-4876-9a52-8240b5d44a21'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:48.800268 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-fef176a5-5ae6-4876-9a52-8240b5d44a21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa84599d91ee43159017c46683a20299', 'request_id': 'req-fef176a5-5ae6-4876-9a52-8240b5d44a21'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:48.825574 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-fef176a5-5ae6-4876-9a52-8240b5d44a21 admin admin] The token cache is being invalidate because project aa84599d91ee43159017c46683a20299 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:11:48.825959 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-fef176a5-5ae6-4876-9a52-8240b5d44a21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:48.826625 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-fef176a5-5ae6-4876-9a52-8240b5d44a21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:48.828144 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 984/1971] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:11:48 2022] DELETE /identity/v3/projects/aa84599d91ee43159017c46683a20299 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:48.833008 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3400684-3158-43e1-9075-302ca5bf4275 service neutron] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:48.842757 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3400684-3158-43e1-9075-302ca5bf4275 service neutron] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:48.910977 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdbd94f-ee5f-4053-9b4d-3586b07bf069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:48.911611 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdbd94f-ee5f-4053-9b4d-3586b07bf069 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:48.911889 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdbd94f-ee5f-4053-9b4d-3586b07bf069 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:48.912162 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdbd94f-ee5f-4053-9b4d-3586b07bf069 admin admin] PATH_INFO: `/v3/users/3d5fa7469a7b4ecb82cf9bbdd77d254b` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:48.913313 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdbd94f-ee5f-4053-9b4d-3586b07bf069 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d5fa7469a7b4ecb82cf9bbdd77d254b)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:48.915241 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdbd94f-ee5f-4053-9b4d-3586b07bf069 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:48.966947 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-afdbd94f-ee5f-4053-9b4d-3586b07bf069 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d5fa7469a7b4ecb82cf9bbdd77d254b'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:48.967611 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-afdbd94f-ee5f-4053-9b4d-3586b07bf069 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d5fa7469a7b4ecb82cf9bbdd77d254b'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:48.968226 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-afdbd94f-ee5f-4053-9b4d-3586b07bf069 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d5fa7469a7b4ecb82cf9bbdd77d254b'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:48.979973 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-afdbd94f-ee5f-4053-9b4d-3586b07bf069 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d5fa7469a7b4ecb82cf9bbdd77d254b'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:48.988242 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-afdbd94f-ee5f-4053-9b4d-3586b07bf069 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d5fa7469a7b4ecb82cf9bbdd77d254b'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:49.002229 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 988/1972] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:11:48 2022] DELETE /identity/v3/users/3d5fa7469a7b4ecb82cf9bbdd77d254b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:49.379306 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef176a5-5ae6-4876-9a52-8240b5d44a21 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:49.380958 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-fef176a5-5ae6-4876-9a52-8240b5d44a21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:49.395859 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef176a5-5ae6-4876-9a52-8240b5d44a21 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:49.435286 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:49.492606 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539b1453-e611-4769-838a-05d37f26cd5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:49.493271 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b1453-e611-4769-838a-05d37f26cd5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:49.493548 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b1453-e611-4769-838a-05d37f26cd5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:49.493822 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b1453-e611-4769-838a-05d37f26cd5f admin admin] PATH_INFO: `/v3/projects/3db50ca5deed47edbea4a9cf0de81276` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:49.495054 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539b1453-e611-4769-838a-05d37f26cd5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3db50ca5deed47edbea4a9cf0de81276)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:49.496950 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539b1453-e611-4769-838a-05d37f26cd5f admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:49.549132 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-539b1453-e611-4769-838a-05d37f26cd5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3db50ca5deed47edbea4a9cf0de81276', 'request_id': 'req-539b1453-e611-4769-838a-05d37f26cd5f'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:49.555760 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-539b1453-e611-4769-838a-05d37f26cd5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3db50ca5deed47edbea4a9cf0de81276', 'request_id': 'req-539b1453-e611-4769-838a-05d37f26cd5f'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:49.562147 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-539b1453-e611-4769-838a-05d37f26cd5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3db50ca5deed47edbea4a9cf0de81276', 'request_id': 'req-539b1453-e611-4769-838a-05d37f26cd5f'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:49.580237 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-539b1453-e611-4769-838a-05d37f26cd5f admin admin] The token cache is being invalidate because project 3db50ca5deed47edbea4a9cf0de81276 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:11:49.580842 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-539b1453-e611-4769-838a-05d37f26cd5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:49.581546 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-539b1453-e611-4769-838a-05d37f26cd5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:49.583653 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 985/1973] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:11:49 2022] DELETE /identity/v3/projects/3db50ca5deed47edbea4a9cf0de81276 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:49.587618 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdbd94f-ee5f-4053-9b4d-3586b07bf069 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:49.589160 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-afdbd94f-ee5f-4053-9b4d-3586b07bf069 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:49.602984 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdbd94f-ee5f-4053-9b4d-3586b07bf069 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:49.622604 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:49.668743 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff835166-b646-45ab-8468-9b45fc4c5997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:49.669319 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff835166-b646-45ab-8468-9b45fc4c5997 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:49.669599 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff835166-b646-45ab-8468-9b45fc4c5997 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:49.669932 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff835166-b646-45ab-8468-9b45fc4c5997 admin admin] PATH_INFO: `/v3/users/7db1d22bbeb64ad198ca403dd6f561c8` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:49.671116 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff835166-b646-45ab-8468-9b45fc4c5997 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7db1d22bbeb64ad198ca403dd6f561c8)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:49.673179 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff835166-b646-45ab-8468-9b45fc4c5997 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:49.723971 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-ff835166-b646-45ab-8468-9b45fc4c5997 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7db1d22bbeb64ad198ca403dd6f561c8'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:49.724623 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-ff835166-b646-45ab-8468-9b45fc4c5997 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7db1d22bbeb64ad198ca403dd6f561c8'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:49.725227 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-ff835166-b646-45ab-8468-9b45fc4c5997 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7db1d22bbeb64ad198ca403dd6f561c8'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:49.737616 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-ff835166-b646-45ab-8468-9b45fc4c5997 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7db1d22bbeb64ad198ca403dd6f561c8'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:49.749214 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-ff835166-b646-45ab-8468-9b45fc4c5997 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7db1d22bbeb64ad198ca403dd6f561c8'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:49.763362 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 989/1974] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:11:49 2022] DELETE /identity/v3/users/7db1d22bbeb64ad198ca403dd6f561c8 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 11:11:50.085719 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539b1453-e611-4769-838a-05d37f26cd5f admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:50.087282 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-539b1453-e611-4769-838a-05d37f26cd5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:50.101303 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539b1453-e611-4769-838a-05d37f26cd5f admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:50.173000 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0208929c-6457-47af-aa26-0f761f028bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:50.173631 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208929c-6457-47af-aa26-0f761f028bb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:50.173909 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208929c-6457-47af-aa26-0f761f028bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:50.174294 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208929c-6457-47af-aa26-0f761f028bb9 admin admin] PATH_INFO: `/v3/projects/71ef0b4452d24dbebd91107d84d070c7` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:50.175937 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0208929c-6457-47af-aa26-0f761f028bb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71ef0b4452d24dbebd91107d84d070c7)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:50.177820 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0208929c-6457-47af-aa26-0f761f028bb9 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:50.220079 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:50.224249 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-0208929c-6457-47af-aa26-0f761f028bb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71ef0b4452d24dbebd91107d84d070c7', 'request_id': 'req-0208929c-6457-47af-aa26-0f761f028bb9'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:50.232951 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-0208929c-6457-47af-aa26-0f761f028bb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71ef0b4452d24dbebd91107d84d070c7', 'request_id': 'req-0208929c-6457-47af-aa26-0f761f028bb9'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:50.240434 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-0208929c-6457-47af-aa26-0f761f028bb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71ef0b4452d24dbebd91107d84d070c7', 'request_id': 'req-0208929c-6457-47af-aa26-0f761f028bb9'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:50.255619 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-0208929c-6457-47af-aa26-0f761f028bb9 admin admin] The token cache is being invalidate because project 71ef0b4452d24dbebd91107d84d070c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:11:50.255899 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-0208929c-6457-47af-aa26-0f761f028bb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:50.256511 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-0208929c-6457-47af-aa26-0f761f028bb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:50.258016 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 986/1975] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:11:50 2022] DELETE /identity/v3/projects/71ef0b4452d24dbebd91107d84d070c7 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:50.263885 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53288d18-f699-408f-8c60-6786438b7acf None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:50.264365 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53288d18-f699-408f-8c60-6786438b7acf None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:50.264465 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53288d18-f699-408f-8c60-6786438b7acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:50.284208 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-53288d18-f699-408f-8c60-6786438b7acf None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:50.286075 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-53288d18-f699-408f-8c60-6786438b7acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:50.344207 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 990/1976] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:11:50.352384 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3968aef-5c79-422d-a3ff-a3ae604ce16e None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:50.352676 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3968aef-5c79-422d-a3ff-a3ae604ce16e None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:50.352947 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3968aef-5c79-422d-a3ff-a3ae604ce16e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:50.372546 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-c3968aef-5c79-422d-a3ff-a3ae604ce16e None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:50.374058 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-c3968aef-5c79-422d-a3ff-a3ae604ce16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:50.382893 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 987/1977] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:11:50.387042 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53288d18-f699-408f-8c60-6786438b7acf None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:50.398520 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53288d18-f699-408f-8c60-6786438b7acf None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:50.404064 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f795029-5a32-436b-ab2f-f97d6500acbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:50.404921 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f795029-5a32-436b-ab2f-f97d6500acbe admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:50.405309 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f795029-5a32-436b-ab2f-f97d6500acbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:50.405665 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f795029-5a32-436b-ab2f-f97d6500acbe admin admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:50.406435 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f795029-5a32-436b-ab2f-f97d6500acbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:11:50.406951 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f795029-5a32-436b-ab2f-f97d6500acbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:50.409538 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f795029-5a32-436b-ab2f-f97d6500acbe admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:50.421902 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 991/1978] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 11:11:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:11:50.426218 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3968aef-5c79-422d-a3ff-a3ae604ce16e None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:50.435500 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3968aef-5c79-422d-a3ff-a3ae604ce16e None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:50.440695 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca827655-91df-4b92-8e40-99fed468e607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:50.441866 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca827655-91df-4b92-8e40-99fed468e607 admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:50.442184 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca827655-91df-4b92-8e40-99fed468e607 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:50.442460 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca827655-91df-4b92-8e40-99fed468e607 admin admin] PATH_INFO: `/v3/projects` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:50.443094 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca827655-91df-4b92-8e40-99fed468e607 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:50.445034 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca827655-91df-4b92-8e40-99fed468e607 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:50.473266 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 988/1979] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:11:50 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:11:50.477377 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f795029-5a32-436b-ab2f-f97d6500acbe admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:50.487340 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f795029-5a32-436b-ab2f-f97d6500acbe admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:50.516962 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:50.552966 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35744697-0ebf-4b3c-abfb-9082329d51c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:50.553575 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35744697-0ebf-4b3c-abfb-9082329d51c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:50.553851 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35744697-0ebf-4b3c-abfb-9082329d51c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:50.554168 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35744697-0ebf-4b3c-abfb-9082329d51c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:50.554795 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35744697-0ebf-4b3c-abfb-9082329d51c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:50.556696 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35744697-0ebf-4b3c-abfb-9082329d51c6 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:50.580078 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 992/1980] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:11:50 2022] POST /identity/v3/users => generated 290 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 11:11:50.584913 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca827655-91df-4b92-8e40-99fed468e607 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:50.595773 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca827655-91df-4b92-8e40-99fed468e607 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:50.601981 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc2371-9de9-44a0-83e3-6c67fa438fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:50.602229 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc2371-9de9-44a0-83e3-6c67fa438fbe admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:50.602586 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc2371-9de9-44a0-83e3-6c67fa438fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:50.602925 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc2371-9de9-44a0-83e3-6c67fa438fbe admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:50.605347 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dc2371-9de9-44a0-83e3-6c67fa438fbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:50.607063 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dc2371-9de9-44a0-83e3-6c67fa438fbe admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:50.617741 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 989/1981] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:11:50.621838 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35744697-0ebf-4b3c-abfb-9082329d51c6 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:50.634044 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35744697-0ebf-4b3c-abfb-9082329d51c6 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:50.638815 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f328261-6c38-4fee-bd4f-420b604bfd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:50.639434 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f328261-6c38-4fee-bd4f-420b604bfd04 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:50.639710 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f328261-6c38-4fee-bd4f-420b604bfd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:50.639984 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f328261-6c38-4fee-bd4f-420b604bfd04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:50.640630 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f328261-6c38-4fee-bd4f-420b604bfd04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:50.642267 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f328261-6c38-4fee-bd4f-420b604bfd04 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:50.653814 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 993/1982] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:11:50.658358 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc2371-9de9-44a0-83e3-6c67fa438fbe admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:50.668327 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc2371-9de9-44a0-83e3-6c67fa438fbe admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:50.672909 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cf1371-8a6c-4e8e-ad36-6434807b5ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:50.673553 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf1371-8a6c-4e8e-ad36-6434807b5ab0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:50.673832 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf1371-8a6c-4e8e-ad36-6434807b5ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:50.674141 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf1371-8a6c-4e8e-ad36-6434807b5ab0 admin admin] PATH_INFO: `/v3/projects/d81415b0ce6147b29afd23ed7ada2eeb/users/f30f160f183746a3b5bd32d05d2cc96d/roles/7c3871c0ab68438b9014489d50b53a22` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:50.688716 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cf1371-8a6c-4e8e-ad36-6434807b5ab0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d81415b0ce6147b29afd23ed7ada2eeb, user_id=f30f160f183746a3b5bd32d05d2cc96d, role_id=7c3871c0ab68438b9014489d50b53a22)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:50.692221 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cf1371-8a6c-4e8e-ad36-6434807b5ab0 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:50.705543 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 990/1983] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:11:50 2022] PUT /identity/v3/projects/d81415b0ce6147b29afd23ed7ada2eeb/users/f30f160f183746a3b5bd32d05d2cc96d/roles/7c3871c0ab68438b9014489d50b53a22 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:50.717588 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6cf959-32c5-4560-aeba-95fd1ce07040 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:50.717887 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6cf959-32c5-4560-aeba-95fd1ce07040 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:50.718184 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6cf959-32c5-4560-aeba-95fd1ce07040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:50.747710 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-da6cf959-32c5-4560-aeba-95fd1ce07040 None None] MFA Rules not processed for user `f30f160f183746a3b5bd32d05d2cc96d`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:50.749185 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-da6cf959-32c5-4560-aeba-95fd1ce07040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:50.821417 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 994/1984] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:11:50.825599 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cf1371-8a6c-4e8e-ad36-6434807b5ab0 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:50.899302 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cf1371-8a6c-4e8e-ad36-6434807b5ab0 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:50.904564 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7ea642-8f43-45ba-85c2-de9eb900fb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:50.905184 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ea642-8f43-45ba-85c2-de9eb900fb07 admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:50.905466 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ea642-8f43-45ba-85c2-de9eb900fb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:50.905740 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ea642-8f43-45ba-85c2-de9eb900fb07 admin admin] PATH_INFO: `/v3/projects` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:50.906435 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7ea642-8f43-45ba-85c2-de9eb900fb07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:50.908395 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7ea642-8f43-45ba-85c2-de9eb900fb07 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:50.942226 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 991/1985] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:11:50 2022] POST /identity/v3/projects => generated 381 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:11:50.944057 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6cf959-32c5-4560-aeba-95fd1ce07040 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:50.957740 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6cf959-32c5-4560-aeba-95fd1ce07040 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:51.024832 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7ea642-8f43-45ba-85c2-de9eb900fb07 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:51.027096 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-bd7ea642-8f43-45ba-85c2-de9eb900fb07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:51.032516 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c185a967-cde2-4fe4-b317-cc5482c65b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:51.033129 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c185a967-cde2-4fe4-b317-cc5482c65b0e admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:51.033407 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c185a967-cde2-4fe4-b317-cc5482c65b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:51.033683 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c185a967-cde2-4fe4-b317-cc5482c65b0e admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:51.034545 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c185a967-cde2-4fe4-b317-cc5482c65b0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:51.036973 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c185a967-cde2-4fe4-b317-cc5482c65b0e admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:51.047064 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7ea642-8f43-45ba-85c2-de9eb900fb07 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:51.057243 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d586205-c5bb-4fcd-924f-60e73b02e7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:51.057931 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d586205-c5bb-4fcd-924f-60e73b02e7d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:51.058863 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d586205-c5bb-4fcd-924f-60e73b02e7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:51.058863 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d586205-c5bb-4fcd-924f-60e73b02e7d0 admin admin] PATH_INFO: `/v3/users/f8d3c5b594174f74815d6f17a34f075e` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:51.061215 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d586205-c5bb-4fcd-924f-60e73b02e7d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8d3c5b594174f74815d6f17a34f075e)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:51.063700 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d586205-c5bb-4fcd-924f-60e73b02e7d0 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:51.070662 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 995/1986] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:11:50 2022] POST /identity/v3/users => generated 297 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 11:11:51.072254 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c185a967-cde2-4fe4-b317-cc5482c65b0e admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:51.090454 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c185a967-cde2-4fe4-b317-cc5482c65b0e admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:51.098746 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1426b098-d4ee-48ac-a468-2b9f2159c8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:51.099280 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1426b098-d4ee-48ac-a468-2b9f2159c8e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:51.099632 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1426b098-d4ee-48ac-a468-2b9f2159c8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:51.099963 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1426b098-d4ee-48ac-a468-2b9f2159c8e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:51.100745 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1426b098-d4ee-48ac-a468-2b9f2159c8e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:51.102555 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1426b098-d4ee-48ac-a468-2b9f2159c8e8 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:51.121856 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 996/1987] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:11:51 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:11:51.123465 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1426b098-d4ee-48ac-a468-2b9f2159c8e8 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:51.130444 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-8d586205-c5bb-4fcd-924f-60e73b02e7d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8d3c5b594174f74815d6f17a34f075e'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:51.133412 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:51.140062 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1426b098-d4ee-48ac-a468-2b9f2159c8e8 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:51.149174 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783fa82f-585b-4709-afce-45a479fd023a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:51.149608 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-8d586205-c5bb-4fcd-924f-60e73b02e7d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8d3c5b594174f74815d6f17a34f075e'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:51.150436 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-8d586205-c5bb-4fcd-924f-60e73b02e7d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8d3c5b594174f74815d6f17a34f075e'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:51.150708 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783fa82f-585b-4709-afce-45a479fd023a admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:51.151127 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783fa82f-585b-4709-afce-45a479fd023a admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:51.151349 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-8d586205-c5bb-4fcd-924f-60e73b02e7d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8d3c5b594174f74815d6f17a34f075e'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:51.151712 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783fa82f-585b-4709-afce-45a479fd023a admin admin] PATH_INFO: `/v3/projects/9c935a0197a64f5bac019ced1d2baf00/users/7ad0144963ea409391caaf4306ff4ef4/roles/ea564961b1db4eb4a1d4d880964611b2` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:51.163789 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-8d586205-c5bb-4fcd-924f-60e73b02e7d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8d3c5b594174f74815d6f17a34f075e'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:51.169328 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:51.172955 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783fa82f-585b-4709-afce-45a479fd023a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c935a0197a64f5bac019ced1d2baf00, user_id=7ad0144963ea409391caaf4306ff4ef4, role_id=ea564961b1db4eb4a1d4d880964611b2)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:51.177650 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783fa82f-585b-4709-afce-45a479fd023a admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:51.188247 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 992/1988] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:11:51 2022] DELETE /identity/v3/users/f8d3c5b594174f74815d6f17a34f075e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 11:11:51.193508 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1001d81-b278-4b73-8f50-585c65ff0aa4 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:51.196712 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 997/1989] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:11:51 2022] PUT /identity/v3/projects/9c935a0197a64f5bac019ced1d2baf00/users/7ad0144963ea409391caaf4306ff4ef4/roles/ea564961b1db4eb4a1d4d880964611b2 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:51.197052 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1001d81-b278-4b73-8f50-585c65ff0aa4 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:51.197583 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1001d81-b278-4b73-8f50-585c65ff0aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:51.200470 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783fa82f-585b-4709-afce-45a479fd023a admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:51.202372 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-783fa82f-585b-4709-afce-45a479fd023a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:51.218278 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-f1001d81-b278-4b73-8f50-585c65ff0aa4 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:51.219853 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-f1001d81-b278-4b73-8f50-585c65ff0aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:51.290375 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783fa82f-585b-4709-afce-45a479fd023a admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:51.298819 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d455bb29-ddc8-424c-81dd-689812a0b456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:51.299445 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d455bb29-ddc8-424c-81dd-689812a0b456 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:51.299734 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d455bb29-ddc8-424c-81dd-689812a0b456 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:51.300148 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d455bb29-ddc8-424c-81dd-689812a0b456 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:51.306166 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d455bb29-ddc8-424c-81dd-689812a0b456 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:51.307827 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d455bb29-ddc8-424c-81dd-689812a0b456 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:51.310888 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 993/1990] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:11:51.322406 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1001d81-b278-4b73-8f50-585c65ff0aa4 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:51.326349 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 998/1991] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:11:51 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 13 11:11:51.327038 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-f1001d81-b278-4b73-8f50-585c65ff0aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:51.329033 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d455bb29-ddc8-424c-81dd-689812a0b456 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:51.350394 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d455bb29-ddc8-424c-81dd-689812a0b456 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:51.355994 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7205881b-ad07-4be1-8db2-7c4a2690c725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:51.357167 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7205881b-ad07-4be1-8db2-7c4a2690c725 admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:51.357530 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7205881b-ad07-4be1-8db2-7c4a2690c725 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:51.357883 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7205881b-ad07-4be1-8db2-7c4a2690c725 admin admin] PATH_INFO: `/v3/projects/9c935a0197a64f5bac019ced1d2baf00/users/7ad0144963ea409391caaf4306ff4ef4/roles/ea564961b1db4eb4a1d4d880964611b2` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:51.360953 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7205881b-ad07-4be1-8db2-7c4a2690c725 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c935a0197a64f5bac019ced1d2baf00, user_id=7ad0144963ea409391caaf4306ff4ef4, role_id=ea564961b1db4eb4a1d4d880964611b2)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:51.365043 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7205881b-ad07-4be1-8db2-7c4a2690c725 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:51.381883 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 999/1992] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:11:51 2022] PUT /identity/v3/projects/9c935a0197a64f5bac019ced1d2baf00/users/7ad0144963ea409391caaf4306ff4ef4/roles/ea564961b1db4eb4a1d4d880964611b2 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:51.392534 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b52a98b-daae-4722-915c-ceb978ff2608 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:51.392798 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b52a98b-daae-4722-915c-ceb978ff2608 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:51.393018 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b52a98b-daae-4722-915c-ceb978ff2608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:51.402849 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1001d81-b278-4b73-8f50-585c65ff0aa4 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:51.435082 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-9b52a98b-daae-4722-915c-ceb978ff2608 None None] MFA Rules not processed for user `7ad0144963ea409391caaf4306ff4ef4`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:51.436843 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-9b52a98b-daae-4722-915c-ceb978ff2608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:51.474618 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0984d7-cb7d-49d8-808d-68971f5e42bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:51.475305 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0984d7-cb7d-49d8-808d-68971f5e42bd service neutron] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:51.475589 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0984d7-cb7d-49d8-808d-68971f5e42bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:51.475875 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0984d7-cb7d-49d8-808d-68971f5e42bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:51.517852 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:51.535737 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1000/1993] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:51 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:11:51.550863 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b52a98b-daae-4722-915c-ceb978ff2608 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:51.551878 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0984d7-cb7d-49d8-808d-68971f5e42bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:51.552314 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-9b52a98b-daae-4722-915c-ceb978ff2608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:51.553326 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0984d7-cb7d-49d8-808d-68971f5e42bd service neutron] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:51.564521 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 994/1994] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:11:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:11:51.634518 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b52a98b-daae-4722-915c-ceb978ff2608 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:51.638334 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ada2dbc-2b05-46bd-8515-03f88a82e720 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f4c2fc51f54f0e977648b13efaed1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:51.638948 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ada2dbc-2b05-46bd-8515-03f88a82e720 service cinder] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:51.639222 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ada2dbc-2b05-46bd-8515-03f88a82e720 service cinder] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:51.639484 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ada2dbc-2b05-46bd-8515-03f88a82e720 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:51.658783 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ada2dbc-2b05-46bd-8515-03f88a82e720 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:51.661179 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ada2dbc-2b05-46bd-8515-03f88a82e720 service cinder] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:51.675104 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1001/1995] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:11:51 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:11:52.067125 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0984d7-cb7d-49d8-808d-68971f5e42bd service neutron] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:52.068564 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-ca0984d7-cb7d-49d8-808d-68971f5e42bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:52.085765 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0984d7-cb7d-49d8-808d-68971f5e42bd service neutron] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:52.092204 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325d46a8-151a-4d73-90f3-2ef986d98bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:52.093236 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d46a8-151a-4d73-90f3-2ef986d98bd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:52.093696 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d46a8-151a-4d73-90f3-2ef986d98bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:52.094185 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d46a8-151a-4d73-90f3-2ef986d98bd6 admin admin] PATH_INFO: `/v3/projects/dbc47473096e4e74baa58bc48fed9f13` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:52.095651 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325d46a8-151a-4d73-90f3-2ef986d98bd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbc47473096e4e74baa58bc48fed9f13)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:52.098187 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325d46a8-151a-4d73-90f3-2ef986d98bd6 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:52.176543 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-325d46a8-151a-4d73-90f3-2ef986d98bd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbc47473096e4e74baa58bc48fed9f13', 'request_id': 'req-325d46a8-151a-4d73-90f3-2ef986d98bd6'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:52.183481 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-325d46a8-151a-4d73-90f3-2ef986d98bd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbc47473096e4e74baa58bc48fed9f13', 'request_id': 'req-325d46a8-151a-4d73-90f3-2ef986d98bd6'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:52.188926 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-325d46a8-151a-4d73-90f3-2ef986d98bd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbc47473096e4e74baa58bc48fed9f13', 'request_id': 'req-325d46a8-151a-4d73-90f3-2ef986d98bd6'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:52.195556 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ada2dbc-2b05-46bd-8515-03f88a82e720 service cinder] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:52.203749 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-325d46a8-151a-4d73-90f3-2ef986d98bd6 admin admin] The token cache is being invalidate because project dbc47473096e4e74baa58bc48fed9f13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:11:52.204044 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-325d46a8-151a-4d73-90f3-2ef986d98bd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:52.204718 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-325d46a8-151a-4d73-90f3-2ef986d98bd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:52.206040 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:52.206553 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 995/1996] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:11:52 2022] DELETE /identity/v3/projects/dbc47473096e4e74baa58bc48fed9f13 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:52.211373 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf9a2aa-039c-4031-9eae-f1bf37eed199 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:52.211598 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf9a2aa-039c-4031-9eae-f1bf37eed199 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:52.211920 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf9a2aa-039c-4031-9eae-f1bf37eed199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:52.214732 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ada2dbc-2b05-46bd-8515-03f88a82e720 service cinder] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:52.231676 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-5cf9a2aa-039c-4031-9eae-f1bf37eed199 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:52.232910 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-5cf9a2aa-039c-4031-9eae-f1bf37eed199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:52.276419 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dbc94f-7dd2-4178-9d7b-1bb6cf8c64aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:52.277113 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dbc94f-7dd2-4178-9d7b-1bb6cf8c64aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:52.277391 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dbc94f-7dd2-4178-9d7b-1bb6cf8c64aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:52.277665 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dbc94f-7dd2-4178-9d7b-1bb6cf8c64aa admin admin] PATH_INFO: `/v3/users/f30f160f183746a3b5bd32d05d2cc96d` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:52.278842 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dbc94f-7dd2-4178-9d7b-1bb6cf8c64aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=f30f160f183746a3b5bd32d05d2cc96d)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:52.280834 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dbc94f-7dd2-4178-9d7b-1bb6cf8c64aa admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:52.294698 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 996/1997] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 11:11:52.304255 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8a9c9-a018-4310-b3cd-fe5c2c9f2c9c None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:52.304562 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8a9c9-a018-4310-b3cd-fe5c2c9f2c9c None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:52.304830 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8a9c9-a018-4310-b3cd-fe5c2c9f2c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:52.329483 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-a6b8a9c9-a018-4310-b3cd-fe5c2c9f2c9c None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:52.330771 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-a6b8a9c9-a018-4310-b3cd-fe5c2c9f2c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:52.331442 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-17dbc94f-7dd2-4178-9d7b-1bb6cf8c64aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f30f160f183746a3b5bd32d05d2cc96d'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:52.332119 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-17dbc94f-7dd2-4178-9d7b-1bb6cf8c64aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f30f160f183746a3b5bd32d05d2cc96d'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:52.332723 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-17dbc94f-7dd2-4178-9d7b-1bb6cf8c64aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f30f160f183746a3b5bd32d05d2cc96d'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:52.339367 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 997/1998] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:11:52.343382 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b8a9c9-a018-4310-b3cd-fe5c2c9f2c9c None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:52.347549 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-17dbc94f-7dd2-4178-9d7b-1bb6cf8c64aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f30f160f183746a3b5bd32d05d2cc96d'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:52.353533 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b8a9c9-a018-4310-b3cd-fe5c2c9f2c9c None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:52.357703 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-17dbc94f-7dd2-4178-9d7b-1bb6cf8c64aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f30f160f183746a3b5bd32d05d2cc96d'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:52.359252 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50742bc-59cd-476d-81e1-979cbe06976b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:52.359878 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50742bc-59cd-476d-81e1-979cbe06976b admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:52.360156 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50742bc-59cd-476d-81e1-979cbe06976b admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:52.360424 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50742bc-59cd-476d-81e1-979cbe06976b admin admin] PATH_INFO: `/v3/domains` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:52.361074 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50742bc-59cd-476d-81e1-979cbe06976b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:11:52.361375 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50742bc-59cd-476d-81e1-979cbe06976b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:52.363686 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50742bc-59cd-476d-81e1-979cbe06976b admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:52.374865 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1002/1999] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:11:52 2022] DELETE /identity/v3/users/f30f160f183746a3b5bd32d05d2cc96d => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:52.379510 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6914e4cd-0dad-42b4-8332-b84a48f6807b None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:52.380274 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6914e4cd-0dad-42b4-8332-b84a48f6807b None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:52.380566 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6914e4cd-0dad-42b4-8332-b84a48f6807b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:52.386207 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 998/2000] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 11:11:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 11:11:52.387175 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50742bc-59cd-476d-81e1-979cbe06976b admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:52.401330 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50742bc-59cd-476d-81e1-979cbe06976b admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:52.402804 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-6914e4cd-0dad-42b4-8332-b84a48f6807b None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:52.404024 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-6914e4cd-0dad-42b4-8332-b84a48f6807b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:52.444407 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:52.478614 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1003/2001] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 11:11:52.481243 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73058ed9-1ad2-48f6-8b5a-d7eb692cccb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:52.482106 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73058ed9-1ad2-48f6-8b5a-d7eb692cccb0 admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:52.482564 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73058ed9-1ad2-48f6-8b5a-d7eb692cccb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:52.482935 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73058ed9-1ad2-48f6-8b5a-d7eb692cccb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:52.483665 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73058ed9-1ad2-48f6-8b5a-d7eb692cccb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:52.485776 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73058ed9-1ad2-48f6-8b5a-d7eb692cccb0 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:52.489269 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6914e4cd-0dad-42b4-8332-b84a48f6807b None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:52.491859 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-6914e4cd-0dad-42b4-8332-b84a48f6807b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:52.519336 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 999/2002] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:11:52 2022] POST /identity/v3/projects => generated 373 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 11:11:52.522483 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:52.522948 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73058ed9-1ad2-48f6-8b5a-d7eb692cccb0 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:52.559883 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6914e4cd-0dad-42b4-8332-b84a48f6807b None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:52.601204 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73058ed9-1ad2-48f6-8b5a-d7eb692cccb0 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:52.606519 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f27308a-4afd-4124-913d-a5c28442d29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:52.607226 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f27308a-4afd-4124-913d-a5c28442d29f admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:52.607520 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f27308a-4afd-4124-913d-a5c28442d29f admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:52.607797 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f27308a-4afd-4124-913d-a5c28442d29f admin admin] PATH_INFO: `/v3/users` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:52.608425 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f27308a-4afd-4124-913d-a5c28442d29f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:52.610160 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f81bf88-3400-4388-aeed-251735ab7942 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:52.610418 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f27308a-4afd-4124-913d-a5c28442d29f admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:52.610773 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f81bf88-3400-4388-aeed-251735ab7942 service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:52.611054 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f81bf88-3400-4388-aeed-251735ab7942 service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:52.611319 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f81bf88-3400-4388-aeed-251735ab7942 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:52.625674 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f81bf88-3400-4388-aeed-251735ab7942 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:52.627322 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f81bf88-3400-4388-aeed-251735ab7942 service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:52.635124 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1000/2003] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:11:52 2022] POST /identity/v3/users => generated 287 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 11:11:52.638624 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1004/2004] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:11:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 13 11:11:52.639289 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f27308a-4afd-4124-913d-a5c28442d29f admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:52.649251 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f27308a-4afd-4124-913d-a5c28442d29f admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:52.653842 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c71e6d3-aebd-415b-900e-748c9557d516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:52.654509 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71e6d3-aebd-415b-900e-748c9557d516 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:52.654786 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71e6d3-aebd-415b-900e-748c9557d516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:52.655053 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71e6d3-aebd-415b-900e-748c9557d516 admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:52.655718 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c71e6d3-aebd-415b-900e-748c9557d516 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:52.657282 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c71e6d3-aebd-415b-900e-748c9557d516 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:52.673532 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1001/2005] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:11:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 13 11:11:52.678133 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f81bf88-3400-4388-aeed-251735ab7942 service neutron] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:52.688292 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f81bf88-3400-4388-aeed-251735ab7942 service neutron] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:52.693343 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a846a68-1eb4-4bf9-a287-0fc2b9fe8f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:52.693970 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a846a68-1eb4-4bf9-a287-0fc2b9fe8f50 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:52.694260 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a846a68-1eb4-4bf9-a287-0fc2b9fe8f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:52.694625 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a846a68-1eb4-4bf9-a287-0fc2b9fe8f50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:52.695225 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a846a68-1eb4-4bf9-a287-0fc2b9fe8f50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:52.696921 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a846a68-1eb4-4bf9-a287-0fc2b9fe8f50 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:52.709396 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1005/2006] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:11:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:11:52.714015 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c71e6d3-aebd-415b-900e-748c9557d516 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:52.725674 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c71e6d3-aebd-415b-900e-748c9557d516 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:52.730700 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43707c03-aa0c-424e-8eae-f1056c976e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:52.731369 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43707c03-aa0c-424e-8eae-f1056c976e93 admin admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:52.731645 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43707c03-aa0c-424e-8eae-f1056c976e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:52.731947 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43707c03-aa0c-424e-8eae-f1056c976e93 admin admin] PATH_INFO: `/v3/projects/363cc01a748f4031b0d7b79675108caf/users/54e3ec4a20454c2d8d65bef20b322782/roles/7c3871c0ab68438b9014489d50b53a22` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:52.747490 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43707c03-aa0c-424e-8eae-f1056c976e93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=363cc01a748f4031b0d7b79675108caf, user_id=54e3ec4a20454c2d8d65bef20b322782, role_id=7c3871c0ab68438b9014489d50b53a22)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:52.750752 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43707c03-aa0c-424e-8eae-f1056c976e93 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:52.770015 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1002/2007] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:11:52 2022] PUT /identity/v3/projects/363cc01a748f4031b0d7b79675108caf/users/54e3ec4a20454c2d8d65bef20b322782/roles/7c3871c0ab68438b9014489d50b53a22 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:52.773658 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35266c-bc2b-4b59-94fd-62c70d124800 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:52.773963 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35266c-bc2b-4b59-94fd-62c70d124800 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:52.774238 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35266c-bc2b-4b59-94fd-62c70d124800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:52.795135 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-8e35266c-bc2b-4b59-94fd-62c70d124800 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:52.796350 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-8e35266c-bc2b-4b59-94fd-62c70d124800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:52.862116 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1006/2008] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:11:52.872575 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43707c03-aa0c-424e-8eae-f1056c976e93 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:52.946947 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e35266c-bc2b-4b59-94fd-62c70d124800 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:52.948563 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-8e35266c-bc2b-4b59-94fd-62c70d124800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:52.955454 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43707c03-aa0c-424e-8eae-f1056c976e93 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:52.965056 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e35266c-bc2b-4b59-94fd-62c70d124800 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:52.970193 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce68f1-fd19-495b-ad09-b2f0111a878d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:52.970935 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce68f1-fd19-495b-ad09-b2f0111a878d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:52.971242 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce68f1-fd19-495b-ad09-b2f0111a878d admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:52.971609 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce68f1-fd19-495b-ad09-b2f0111a878d admin admin] PATH_INFO: `/v3/projects/d81415b0ce6147b29afd23ed7ada2eeb` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:52.973395 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ce68f1-fd19-495b-ad09-b2f0111a878d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d81415b0ce6147b29afd23ed7ada2eeb)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:52.975830 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ce68f1-fd19-495b-ad09-b2f0111a878d admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:52.978830 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7756daa-2d6e-43c2-833b-87b3fc6706bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:52.979584 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7756daa-2d6e-43c2-833b-87b3fc6706bd service neutron] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:52.979922 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7756daa-2d6e-43c2-833b-87b3fc6706bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:52.980301 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7756daa-2d6e-43c2-833b-87b3fc6706bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:52.992127 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7756daa-2d6e-43c2-833b-87b3fc6706bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:52.993702 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7756daa-2d6e-43c2-833b-87b3fc6706bd service neutron] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:53.010596 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1003/2009] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:11:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:11:53.042576 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-65ce68f1-fd19-495b-ad09-b2f0111a878d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd81415b0ce6147b29afd23ed7ada2eeb', 'request_id': 'req-65ce68f1-fd19-495b-ad09-b2f0111a878d'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:53.053593 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-65ce68f1-fd19-495b-ad09-b2f0111a878d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd81415b0ce6147b29afd23ed7ada2eeb', 'request_id': 'req-65ce68f1-fd19-495b-ad09-b2f0111a878d'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:53.066103 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-65ce68f1-fd19-495b-ad09-b2f0111a878d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd81415b0ce6147b29afd23ed7ada2eeb', 'request_id': 'req-65ce68f1-fd19-495b-ad09-b2f0111a878d'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:53.073334 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:53.086099 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-65ce68f1-fd19-495b-ad09-b2f0111a878d admin admin] The token cache is being invalidate because project d81415b0ce6147b29afd23ed7ada2eeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:11:53.086788 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-65ce68f1-fd19-495b-ad09-b2f0111a878d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:53.088804 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-65ce68f1-fd19-495b-ad09-b2f0111a878d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:53.103512 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1007/2010] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:11:52 2022] DELETE /identity/v3/projects/d81415b0ce6147b29afd23ed7ada2eeb => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:53.107969 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7756daa-2d6e-43c2-833b-87b3fc6706bd service neutron] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:53.118912 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7756daa-2d6e-43c2-833b-87b3fc6706bd service neutron] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:53.134503 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:53.196765 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0852fc-2a8f-468c-acf3-ab55ad60e858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:53.197728 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0852fc-2a8f-468c-acf3-ab55ad60e858 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:53.198222 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0852fc-2a8f-468c-acf3-ab55ad60e858 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:53.198743 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0852fc-2a8f-468c-acf3-ab55ad60e858 admin admin] PATH_INFO: `/v3/users/7ad0144963ea409391caaf4306ff4ef4` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:53.207172 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0852fc-2a8f-468c-acf3-ab55ad60e858 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ad0144963ea409391caaf4306ff4ef4)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:53.209478 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0852fc-2a8f-468c-acf3-ab55ad60e858 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:53.264621 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-8a0852fc-2a8f-468c-acf3-ab55ad60e858 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ad0144963ea409391caaf4306ff4ef4'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:53.272704 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-8a0852fc-2a8f-468c-acf3-ab55ad60e858 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ad0144963ea409391caaf4306ff4ef4'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:53.273450 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-8a0852fc-2a8f-468c-acf3-ab55ad60e858 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ad0144963ea409391caaf4306ff4ef4'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:53.274134 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-8a0852fc-2a8f-468c-acf3-ab55ad60e858 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ad0144963ea409391caaf4306ff4ef4'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:53.283637 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-8a0852fc-2a8f-468c-acf3-ab55ad60e858 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ad0144963ea409391caaf4306ff4ef4'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:53.303401 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1004/2011] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:11:53 2022] DELETE /identity/v3/users/7ad0144963ea409391caaf4306ff4ef4 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:53.610287 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce68f1-fd19-495b-ad09-b2f0111a878d admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:53.612196 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-65ce68f1-fd19-495b-ad09-b2f0111a878d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:53.628216 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce68f1-fd19-495b-ad09-b2f0111a878d admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:53.736140 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed6f8f-dcb3-4cb8-ba7f-7d203353b1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:53.738290 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed6f8f-dcb3-4cb8-ba7f-7d203353b1c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:53.738675 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed6f8f-dcb3-4cb8-ba7f-7d203353b1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:53.739421 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed6f8f-dcb3-4cb8-ba7f-7d203353b1c4 admin admin] PATH_INFO: `/v3/projects/9c935a0197a64f5bac019ced1d2baf00` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:53.740847 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ed6f8f-dcb3-4cb8-ba7f-7d203353b1c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c935a0197a64f5bac019ced1d2baf00)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:53.743133 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ed6f8f-dcb3-4cb8-ba7f-7d203353b1c4 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:53.826295 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-85ed6f8f-dcb3-4cb8-ba7f-7d203353b1c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c935a0197a64f5bac019ced1d2baf00', 'request_id': 'req-85ed6f8f-dcb3-4cb8-ba7f-7d203353b1c4'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:53.836658 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-85ed6f8f-dcb3-4cb8-ba7f-7d203353b1c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c935a0197a64f5bac019ced1d2baf00', 'request_id': 'req-85ed6f8f-dcb3-4cb8-ba7f-7d203353b1c4'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:53.845605 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-85ed6f8f-dcb3-4cb8-ba7f-7d203353b1c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c935a0197a64f5bac019ced1d2baf00', 'request_id': 'req-85ed6f8f-dcb3-4cb8-ba7f-7d203353b1c4'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:53.862931 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-85ed6f8f-dcb3-4cb8-ba7f-7d203353b1c4 admin admin] The token cache is being invalidate because project 9c935a0197a64f5bac019ced1d2baf00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:11:53.863233 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-85ed6f8f-dcb3-4cb8-ba7f-7d203353b1c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:53.863906 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-85ed6f8f-dcb3-4cb8-ba7f-7d203353b1c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:11:53.870079 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1008/2012] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:11:53 2022] DELETE /identity/v3/projects/9c935a0197a64f5bac019ced1d2baf00 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:53.872016 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb62019-92ee-43ab-9c16-a83473fe0939 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:53.877197 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb62019-92ee-43ab-9c16-a83473fe0939 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:53.877578 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb62019-92ee-43ab-9c16-a83473fe0939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:53.904684 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-bfb62019-92ee-43ab-9c16-a83473fe0939 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:53.906026 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-bfb62019-92ee-43ab-9c16-a83473fe0939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:53.984413 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1005/2013] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:11:53.993617 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c710dcd9-4c5f-436c-9164-f7755e5dc556 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:53.993918 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c710dcd9-4c5f-436c-9164-f7755e5dc556 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:53.994327 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c710dcd9-4c5f-436c-9164-f7755e5dc556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:54.017471 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-c710dcd9-4c5f-436c-9164-f7755e5dc556 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:54.019773 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-c710dcd9-4c5f-436c-9164-f7755e5dc556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:54.035595 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1009/2014] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:11:54.040215 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb62019-92ee-43ab-9c16-a83473fe0939 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:54.053354 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb62019-92ee-43ab-9c16-a83473fe0939 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:54.058688 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f974abf-fd63-4734-8e5e-6e85e13ad958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:54.059561 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f974abf-fd63-4734-8e5e-6e85e13ad958 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:54.060217 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f974abf-fd63-4734-8e5e-6e85e13ad958 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:54.060792 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f974abf-fd63-4734-8e5e-6e85e13ad958 admin admin] PATH_INFO: `/v3/domains` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:54.061905 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f974abf-fd63-4734-8e5e-6e85e13ad958 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:11:54.062450 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f974abf-fd63-4734-8e5e-6e85e13ad958 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:54.064526 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f974abf-fd63-4734-8e5e-6e85e13ad958 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:54.078529 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1006/2015] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 11:11:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:11:54.083390 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c710dcd9-4c5f-436c-9164-f7755e5dc556 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:54.092671 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c710dcd9-4c5f-436c-9164-f7755e5dc556 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:54.099569 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acabb00e-774e-47b2-95bf-7d8008f2b840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:54.100178 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acabb00e-774e-47b2-95bf-7d8008f2b840 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:54.100455 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acabb00e-774e-47b2-95bf-7d8008f2b840 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:54.100724 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acabb00e-774e-47b2-95bf-7d8008f2b840 admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:54.101361 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acabb00e-774e-47b2-95bf-7d8008f2b840 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:54.103290 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acabb00e-774e-47b2-95bf-7d8008f2b840 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:54.145621 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1010/2016] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:11:54 2022] POST /identity/v3/projects => generated 383 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:11:54.149735 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f974abf-fd63-4734-8e5e-6e85e13ad958 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:54.177433 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f974abf-fd63-4734-8e5e-6e85e13ad958 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:54.208972 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:54.262144 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a4a383-4b5b-43c4-a353-311d3215e61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:54.262772 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a4a383-4b5b-43c4-a353-311d3215e61f admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:54.263051 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a4a383-4b5b-43c4-a353-311d3215e61f admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:54.263310 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a4a383-4b5b-43c4-a353-311d3215e61f admin admin] PATH_INFO: `/v3/users` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:54.264055 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a4a383-4b5b-43c4-a353-311d3215e61f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:54.266623 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a4a383-4b5b-43c4-a353-311d3215e61f admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:54.298526 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1007/2017] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:11:54 2022] POST /identity/v3/users => generated 292 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 11:11:54.303741 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acabb00e-774e-47b2-95bf-7d8008f2b840 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:54.322084 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acabb00e-774e-47b2-95bf-7d8008f2b840 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:54.330272 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0df65e-46df-42a5-9726-0ff3754146ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:54.330914 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0df65e-46df-42a5-9726-0ff3754146ce admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:54.331191 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0df65e-46df-42a5-9726-0ff3754146ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:54.331464 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0df65e-46df-42a5-9726-0ff3754146ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:54.332885 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0df65e-46df-42a5-9726-0ff3754146ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:54.337067 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0df65e-46df-42a5-9726-0ff3754146ce admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:54.355649 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1011/2018] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:11:54 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:11:54.358180 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a4a383-4b5b-43c4-a353-311d3215e61f admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:54.372496 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a4a383-4b5b-43c4-a353-311d3215e61f admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:54.378001 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9520be-375e-4abc-85b9-7f380ad5947c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:54.379378 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9520be-375e-4abc-85b9-7f380ad5947c admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:54.379656 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9520be-375e-4abc-85b9-7f380ad5947c admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:54.379929 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9520be-375e-4abc-85b9-7f380ad5947c admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:54.380575 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9520be-375e-4abc-85b9-7f380ad5947c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:54.382195 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9520be-375e-4abc-85b9-7f380ad5947c admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:54.398405 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1008/2019] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:11:54 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:11:54.401030 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0df65e-46df-42a5-9726-0ff3754146ce admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:54.411308 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0df65e-46df-42a5-9726-0ff3754146ce admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:54.416192 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1944051a-99f2-47c9-857d-5542452461b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:54.416857 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944051a-99f2-47c9-857d-5542452461b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:54.417135 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944051a-99f2-47c9-857d-5542452461b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:54.418063 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944051a-99f2-47c9-857d-5542452461b8 admin admin] PATH_INFO: `/v3/projects/bc09697c48894e9580f70f09b829a593/users/a73024b071b14177b20736c015420f8a/roles/7c3871c0ab68438b9014489d50b53a22` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:54.440551 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1944051a-99f2-47c9-857d-5542452461b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc09697c48894e9580f70f09b829a593, user_id=a73024b071b14177b20736c015420f8a, role_id=7c3871c0ab68438b9014489d50b53a22)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:54.445365 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1944051a-99f2-47c9-857d-5542452461b8 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:54.459774 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1012/2020] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:11:54 2022] PUT /identity/v3/projects/bc09697c48894e9580f70f09b829a593/users/a73024b071b14177b20736c015420f8a/roles/7c3871c0ab68438b9014489d50b53a22 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:54.464701 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad011f79-f8f8-4e9a-9ecd-9aa9d21ce472 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:54.464989 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad011f79-f8f8-4e9a-9ecd-9aa9d21ce472 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:54.465265 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad011f79-f8f8-4e9a-9ecd-9aa9d21ce472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:54.486359 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-ad011f79-f8f8-4e9a-9ecd-9aa9d21ce472 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:54.487574 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-ad011f79-f8f8-4e9a-9ecd-9aa9d21ce472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:54.559312 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1009/2021] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:11:54.569440 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1944051a-99f2-47c9-857d-5542452461b8 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:54.571774 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-1944051a-99f2-47c9-857d-5542452461b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:54.597391 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:54.642471 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1944051a-99f2-47c9-857d-5542452461b8 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:54.646386 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a24c613-6bf9-4143-a24d-07f5e6ef0776 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:54.647002 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a24c613-6bf9-4143-a24d-07f5e6ef0776 service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:54.647275 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a24c613-6bf9-4143-a24d-07f5e6ef0776 service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:54.647546 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a24c613-6bf9-4143-a24d-07f5e6ef0776 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:54.658484 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a24c613-6bf9-4143-a24d-07f5e6ef0776 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:54.660169 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a24c613-6bf9-4143-a24d-07f5e6ef0776 service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:54.674006 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1013/2022] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:11:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:11:57.953411 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618dbac4-da5c-4153-ae2b-a6a30a13ce1a None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:57.954373 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618dbac4-da5c-4153-ae2b-a6a30a13ce1a None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:57.954798 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618dbac4-da5c-4153-ae2b-a6a30a13ce1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:57.990655 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-618dbac4-da5c-4153-ae2b-a6a30a13ce1a None None] MFA Rules not processed for user `54e3ec4a20454c2d8d65bef20b322782`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:11:57.992307 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-618dbac4-da5c-4153-ae2b-a6a30a13ce1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:58.073833 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1010/2023] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:11:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:11:58.078336 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a24c613-6bf9-4143-a24d-07f5e6ef0776 service neutron] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:58.080140 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-4a24c613-6bf9-4143-a24d-07f5e6ef0776 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:11:58.094029 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a24c613-6bf9-4143-a24d-07f5e6ef0776 service neutron] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:58.099080 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d91d1ed-f46d-4f31-ad46-64f556e3dd35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:58.100043 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d91d1ed-f46d-4f31-ad46-64f556e3dd35 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:58.100395 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d91d1ed-f46d-4f31-ad46-64f556e3dd35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:58.100747 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d91d1ed-f46d-4f31-ad46-64f556e3dd35 admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:58.101467 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d91d1ed-f46d-4f31-ad46-64f556e3dd35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:58.103552 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d91d1ed-f46d-4f31-ad46-64f556e3dd35 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:58.136309 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1014/2024] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:11:58 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:11:58.140238 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618dbac4-da5c-4153-ae2b-a6a30a13ce1a None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:58.153711 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618dbac4-da5c-4153-ae2b-a6a30a13ce1a None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:58.189018 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:11:58.229777 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac69c27e-d55c-4596-94ac-bc13c8549cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:58.230484 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac69c27e-d55c-4596-94ac-bc13c8549cf3 admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:58.230770 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac69c27e-d55c-4596-94ac-bc13c8549cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:58.231045 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac69c27e-d55c-4596-94ac-bc13c8549cf3 admin admin] PATH_INFO: `/v3/users` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:58.231767 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac69c27e-d55c-4596-94ac-bc13c8549cf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:58.234059 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac69c27e-d55c-4596-94ac-bc13c8549cf3 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:58.265459 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1011/2025] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:11:58 2022] POST /identity/v3/users => generated 293 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 11:11:58.268239 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d91d1ed-f46d-4f31-ad46-64f556e3dd35 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:58.306434 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d91d1ed-f46d-4f31-ad46-64f556e3dd35 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:58.319098 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47862bb-0a16-44a7-bc23-24568d22523f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:58.320142 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47862bb-0a16-44a7-bc23-24568d22523f admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:58.322365 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47862bb-0a16-44a7-bc23-24568d22523f admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:58.322734 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47862bb-0a16-44a7-bc23-24568d22523f admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:58.323564 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47862bb-0a16-44a7-bc23-24568d22523f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:58.329740 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47862bb-0a16-44a7-bc23-24568d22523f admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:58.353789 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1015/2026] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:11:58 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:11:58.355351 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac69c27e-d55c-4596-94ac-bc13c8549cf3 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:58.370551 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac69c27e-d55c-4596-94ac-bc13c8549cf3 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:58.378246 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab720023-6f70-482d-9e37-70f1ed1a345f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:58.380903 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab720023-6f70-482d-9e37-70f1ed1a345f admin admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:58.381244 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab720023-6f70-482d-9e37-70f1ed1a345f admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:58.382080 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab720023-6f70-482d-9e37-70f1ed1a345f admin admin] PATH_INFO: `/v3/projects/ef281dd43a3d470284eb261c5fcd4b04/users/2fc74ffec6e94364aac6385f6bc5445a/roles/ea564961b1db4eb4a1d4d880964611b2` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:58.409296 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab720023-6f70-482d-9e37-70f1ed1a345f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef281dd43a3d470284eb261c5fcd4b04, user_id=2fc74ffec6e94364aac6385f6bc5445a, role_id=ea564961b1db4eb4a1d4d880964611b2)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:58.413578 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab720023-6f70-482d-9e37-70f1ed1a345f admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:58.443562 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1012/2027] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:11:58 2022] PUT /identity/v3/projects/ef281dd43a3d470284eb261c5fcd4b04/users/2fc74ffec6e94364aac6385f6bc5445a/roles/ea564961b1db4eb4a1d4d880964611b2 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:11:58.445119 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47862bb-0a16-44a7-bc23-24568d22523f admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:58.459528 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47862bb-0a16-44a7-bc23-24568d22523f admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:58.551471 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c5627-efef-47aa-9630-06d17e674000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:58.552257 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c5627-efef-47aa-9630-06d17e674000 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:58.552522 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c5627-efef-47aa-9630-06d17e674000 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:58.552795 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c5627-efef-47aa-9630-06d17e674000 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:58.553445 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457c5627-efef-47aa-9630-06d17e674000 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:58.557011 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457c5627-efef-47aa-9630-06d17e674000 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:58.584770 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1016/2028] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:11:58 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:11:58.586736 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab720023-6f70-482d-9e37-70f1ed1a345f admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:11:58.605222 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab720023-6f70-482d-9e37-70f1ed1a345f admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:11:58.614972 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96324bdf-a45a-4ac5-8b76-07d23b25af88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:11:58.615661 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96324bdf-a45a-4ac5-8b76-07d23b25af88 admin admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:11:58.615997 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96324bdf-a45a-4ac5-8b76-07d23b25af88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:11:58.616282 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96324bdf-a45a-4ac5-8b76-07d23b25af88 admin admin] PATH_INFO: `/v3/projects/ef281dd43a3d470284eb261c5fcd4b04/users/2fc74ffec6e94364aac6385f6bc5445a/roles/ea564961b1db4eb4a1d4d880964611b2` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:11:58.619495 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96324bdf-a45a-4ac5-8b76-07d23b25af88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef281dd43a3d470284eb261c5fcd4b04, user_id=2fc74ffec6e94364aac6385f6bc5445a, role_id=ea564961b1db4eb4a1d4d880964611b2)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:11:58.622552 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96324bdf-a45a-4ac5-8b76-07d23b25af88 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:11:58.636676 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1013/2029] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:11:58 2022] PUT /identity/v3/projects/ef281dd43a3d470284eb261c5fcd4b04/users/2fc74ffec6e94364aac6385f6bc5445a/roles/ea564961b1db4eb4a1d4d880964611b2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:12:02.380105 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e59f9-7cb5-4de3-9c3b-49c965bf3216 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:12:02.381146 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e59f9-7cb5-4de3-9c3b-49c965bf3216 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:12:02.381681 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e59f9-7cb5-4de3-9c3b-49c965bf3216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:12:02.484127 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-ce1e59f9-7cb5-4de3-9c3b-49c965bf3216 None None] MFA Rules not processed for user `a73024b071b14177b20736c015420f8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:12:02.486562 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-ce1e59f9-7cb5-4de3-9c3b-49c965bf3216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:12:02.751038 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1017/2030] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:12:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:12:02.757825 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96324bdf-a45a-4ac5-8b76-07d23b25af88 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:12:02.896468 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96324bdf-a45a-4ac5-8b76-07d23b25af88 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:12:02.932347 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbd13c8-d8db-46f8-9b1d-e366707d9a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:12:02.934187 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd13c8-d8db-46f8-9b1d-e366707d9a54 admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:12:02.934470 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd13c8-d8db-46f8-9b1d-e366707d9a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:12:02.936493 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd13c8-d8db-46f8-9b1d-e366707d9a54 admin admin] PATH_INFO: `/v3/projects` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:12:02.937188 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbd13c8-d8db-46f8-9b1d-e366707d9a54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:12:02.946367 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbd13c8-d8db-46f8-9b1d-e366707d9a54 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:12:03.011650 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1014/2031] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:12:02 2022] POST /identity/v3/projects => generated 381 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:12:03.017558 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1e59f9-7cb5-4de3-9c3b-49c965bf3216 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:12:03.030501 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1e59f9-7cb5-4de3-9c3b-49c965bf3216 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:12:03.056315 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:12:03.207986 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0885708-93a4-4521-95da-df68db8741db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:12:03.210258 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0885708-93a4-4521-95da-df68db8741db admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:12:03.210957 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0885708-93a4-4521-95da-df68db8741db admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:12:03.212482 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0885708-93a4-4521-95da-df68db8741db admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:12:03.214089 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0885708-93a4-4521-95da-df68db8741db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:12:03.218326 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0885708-93a4-4521-95da-df68db8741db admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:12:03.293795 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1018/2032] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:12:03 2022] POST /identity/v3/users => generated 297 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 11:12:03.300997 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbd13c8-d8db-46f8-9b1d-e366707d9a54 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:12:03.322368 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbd13c8-d8db-46f8-9b1d-e366707d9a54 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:12:03.339112 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e693775d-3354-4eba-ab4c-1feece860952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:12:03.339978 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693775d-3354-4eba-ab4c-1feece860952 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:12:03.341010 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693775d-3354-4eba-ab4c-1feece860952 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:12:03.342724 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693775d-3354-4eba-ab4c-1feece860952 admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:12:03.343856 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e693775d-3354-4eba-ab4c-1feece860952 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:12:03.345733 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e693775d-3354-4eba-ab4c-1feece860952 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:12:03.366045 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1015/2033] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:12:03 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 13 11:12:03.370446 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0885708-93a4-4521-95da-df68db8741db admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:12:03.389762 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0885708-93a4-4521-95da-df68db8741db admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:12:03.405508 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02dcc6a-0843-40c6-a7a2-ef5134d50bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:12:03.406834 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02dcc6a-0843-40c6-a7a2-ef5134d50bd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:12:03.407512 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02dcc6a-0843-40c6-a7a2-ef5134d50bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:12:03.408154 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02dcc6a-0843-40c6-a7a2-ef5134d50bd3 admin admin] PATH_INFO: `/v3/projects/86404db92d004e1fbef4e6c65fd72cb9/users/87481f225ead4faea8fdb667b3f3a1e3/roles/ea564961b1db4eb4a1d4d880964611b2` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:12:03.445386 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02dcc6a-0843-40c6-a7a2-ef5134d50bd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86404db92d004e1fbef4e6c65fd72cb9, user_id=87481f225ead4faea8fdb667b3f3a1e3, role_id=ea564961b1db4eb4a1d4d880964611b2)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:12:03.453017 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02dcc6a-0843-40c6-a7a2-ef5134d50bd3 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:12:03.481414 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1019/2034] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:12:03 2022] PUT /identity/v3/projects/86404db92d004e1fbef4e6c65fd72cb9/users/87481f225ead4faea8fdb667b3f3a1e3/roles/ea564961b1db4eb4a1d4d880964611b2 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:12:03.488292 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e693775d-3354-4eba-ab4c-1feece860952 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:12:03.507715 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e693775d-3354-4eba-ab4c-1feece860952 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:12:03.611580 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba89ef5-6224-497f-9374-cbb0c97da928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:12:03.612312 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba89ef5-6224-497f-9374-cbb0c97da928 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:12:03.613389 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba89ef5-6224-497f-9374-cbb0c97da928 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:12:03.613765 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba89ef5-6224-497f-9374-cbb0c97da928 admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:12:03.614531 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba89ef5-6224-497f-9374-cbb0c97da928 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:12:03.616737 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba89ef5-6224-497f-9374-cbb0c97da928 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:12:03.618795 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:12:03.638670 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02dcc6a-0843-40c6-a7a2-ef5134d50bd3 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:12:03.641113 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1016/2035] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:12:03 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:12:03.697901 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02dcc6a-0843-40c6-a7a2-ef5134d50bd3 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:12:03.713271 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1e0863-5872-45a6-b1e5-1f2c2052dd78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:12:03.714520 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e0863-5872-45a6-b1e5-1f2c2052dd78 admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:12:03.715167 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e0863-5872-45a6-b1e5-1f2c2052dd78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:12:03.715654 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e0863-5872-45a6-b1e5-1f2c2052dd78 admin admin] PATH_INFO: `/v3/projects/86404db92d004e1fbef4e6c65fd72cb9/users/87481f225ead4faea8fdb667b3f3a1e3/roles/ea564961b1db4eb4a1d4d880964611b2` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:12:03.727592 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1e0863-5872-45a6-b1e5-1f2c2052dd78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86404db92d004e1fbef4e6c65fd72cb9, user_id=87481f225ead4faea8fdb667b3f3a1e3, role_id=ea564961b1db4eb4a1d4d880964611b2)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:12:03.730509 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1e0863-5872-45a6-b1e5-1f2c2052dd78 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:12:03.817283 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1020/2036] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:12:03 2022] PUT /identity/v3/projects/86404db92d004e1fbef4e6c65fd72cb9/users/87481f225ead4faea8fdb667b3f3a1e3/roles/ea564961b1db4eb4a1d4d880964611b2 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:12:07.809870 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba89ef5-6224-497f-9374-cbb0c97da928 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:12:07.811969 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-eba89ef5-6224-497f-9374-cbb0c97da928 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:12:07.837253 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba89ef5-6224-497f-9374-cbb0c97da928 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:12:07.964442 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f470c-3501-4c15-a17e-527c63ccbbd0 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:12:07.965433 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f470c-3501-4c15-a17e-527c63ccbbd0 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:12:07.965963 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f470c-3501-4c15-a17e-527c63ccbbd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:12:07.967181 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb74a21d-efb0-4b8d-a266-102c59370413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:12:07.967906 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb74a21d-efb0-4b8d-a266-102c59370413 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:12:07.968131 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb74a21d-efb0-4b8d-a266-102c59370413 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:12:07.968394 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb74a21d-efb0-4b8d-a266-102c59370413 admin admin] PATH_INFO: `/v3/users/8d1a6b8b2cad41d4b291db0bae73b418` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:12:07.971019 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb74a21d-efb0-4b8d-a266-102c59370413 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d1a6b8b2cad41d4b291db0bae73b418)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:12:07.973109 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb74a21d-efb0-4b8d-a266-102c59370413 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:12:08.025046 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-e92f470c-3501-4c15-a17e-527c63ccbbd0 None None] MFA Rules not processed for user `2fc74ffec6e94364aac6385f6bc5445a`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:12:08.026493 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-e92f470c-3501-4c15-a17e-527c63ccbbd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:12:08.091271 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-eb74a21d-efb0-4b8d-a266-102c59370413 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d1a6b8b2cad41d4b291db0bae73b418'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:12:08.114324 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-eb74a21d-efb0-4b8d-a266-102c59370413 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d1a6b8b2cad41d4b291db0bae73b418'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:12:08.115453 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-eb74a21d-efb0-4b8d-a266-102c59370413 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d1a6b8b2cad41d4b291db0bae73b418'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:12:08.116688 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-eb74a21d-efb0-4b8d-a266-102c59370413 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d1a6b8b2cad41d4b291db0bae73b418'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:12:08.133505 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-eb74a21d-efb0-4b8d-a266-102c59370413 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d1a6b8b2cad41d4b291db0bae73b418'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:12:08.187465 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1017/2037] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:12:07 2022] DELETE /identity/v3/users/8d1a6b8b2cad41d4b291db0bae73b418 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:12:08.194384 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1021/2038] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:12:07 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 11:12:08.201167 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce015e2e-adda-4675-8794-13e2dc19ba24 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:12:08.201622 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce015e2e-adda-4675-8794-13e2dc19ba24 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:12:08.201733 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce015e2e-adda-4675-8794-13e2dc19ba24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:12:08.211523 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92f470c-3501-4c15-a17e-527c63ccbbd0 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:12:08.219105 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-e92f470c-3501-4c15-a17e-527c63ccbbd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:12:08.237079 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-ce015e2e-adda-4675-8794-13e2dc19ba24 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:12:08.239706 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-ce015e2e-adda-4675-8794-13e2dc19ba24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:12:08.329135 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:12:08.370002 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1018/2039] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:12:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:12:08.370210 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92f470c-3501-4c15-a17e-527c63ccbbd0 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:12:08.380837 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce015e2e-adda-4675-8794-13e2dc19ba24 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:12:08.397808 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-ce015e2e-adda-4675-8794-13e2dc19ba24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:12:08.416625 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:12:08.490500 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce015e2e-adda-4675-8794-13e2dc19ba24 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:12:08.495365 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf124e0-f313-4f2d-813e-7a7cc6bc2de0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:12:08.496223 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf124e0-f313-4f2d-813e-7a7cc6bc2de0 service neutron] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:12:08.496601 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf124e0-f313-4f2d-813e-7a7cc6bc2de0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:12:08.496975 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf124e0-f313-4f2d-813e-7a7cc6bc2de0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:12:08.514662 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf124e0-f313-4f2d-813e-7a7cc6bc2de0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:12:08.516391 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf124e0-f313-4f2d-813e-7a7cc6bc2de0 service neutron] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:12:08.529024 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1019/2040] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:12:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 13 11:12:08.530697 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0e0ebc-a48d-4858-81b0-7166021b6d94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78384fbffdd346578855e7214b335d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:12:08.531506 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0e0ebc-a48d-4858-81b0-7166021b6d94 service nova] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:12:08.532154 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0e0ebc-a48d-4858-81b0-7166021b6d94 service nova] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:12:08.532575 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0e0ebc-a48d-4858-81b0-7166021b6d94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:12:08.539217 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-1d0e0ebc-a48d-4858-81b0-7166021b6d94 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:12:08.701203 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0e0ebc-a48d-4858-81b0-7166021b6d94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:12:08.702876 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0e0ebc-a48d-4858-81b0-7166021b6d94 service nova] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:12:08.729276 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1022/2041] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:12:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:12:09.048221 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf124e0-f313-4f2d-813e-7a7cc6bc2de0 service neutron] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:12:09.050639 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-baf124e0-f313-4f2d-813e-7a7cc6bc2de0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:12:09.119180 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf124e0-f313-4f2d-813e-7a7cc6bc2de0 service neutron] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:12:09.136434 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0f453c-b12f-4399-a9c0-9300094f32db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:12:09.137178 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f453c-b12f-4399-a9c0-9300094f32db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:12:09.137534 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f453c-b12f-4399-a9c0-9300094f32db admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:12:09.137834 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f453c-b12f-4399-a9c0-9300094f32db admin admin] PATH_INFO: `/v3/projects/05af354cda9844f18e61bb195d61d205` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:12:09.139232 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0f453c-b12f-4399-a9c0-9300094f32db admin admin] RBAC: Authorizing `identity:delete_project(project_id=05af354cda9844f18e61bb195d61d205)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:12:09.141235 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0f453c-b12f-4399-a9c0-9300094f32db admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:12:09.244632 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-8a0f453c-b12f-4399-a9c0-9300094f32db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05af354cda9844f18e61bb195d61d205', 'request_id': 'req-8a0f453c-b12f-4399-a9c0-9300094f32db'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:12:09.254952 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-8a0f453c-b12f-4399-a9c0-9300094f32db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05af354cda9844f18e61bb195d61d205', 'request_id': 'req-8a0f453c-b12f-4399-a9c0-9300094f32db'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:12:09.263390 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-8a0f453c-b12f-4399-a9c0-9300094f32db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05af354cda9844f18e61bb195d61d205', 'request_id': 'req-8a0f453c-b12f-4399-a9c0-9300094f32db'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:12:09.310293 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-8a0f453c-b12f-4399-a9c0-9300094f32db admin admin] The token cache is being invalidate because project 05af354cda9844f18e61bb195d61d205 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:12:09.310838 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-8a0f453c-b12f-4399-a9c0-9300094f32db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:12:09.311748 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-8a0f453c-b12f-4399-a9c0-9300094f32db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:12:09.318774 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1020/2042] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:12:09 2022] DELETE /identity/v3/projects/05af354cda9844f18e61bb195d61d205 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:12:09.322451 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40852cc6-f91a-476c-ac3d-b94bfeaf5cf6 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:12:09.323303 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40852cc6-f91a-476c-ac3d-b94bfeaf5cf6 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:12:09.323798 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40852cc6-f91a-476c-ac3d-b94bfeaf5cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:12:09.352475 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-40852cc6-f91a-476c-ac3d-b94bfeaf5cf6 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:12:09.354158 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-40852cc6-f91a-476c-ac3d-b94bfeaf5cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:12:09.512037 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1023/2043] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:12:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:12:09.539293 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2fb114-cbcb-4ed5-b70f-5605eacf312a None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:12:09.539641 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2fb114-cbcb-4ed5-b70f-5605eacf312a None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:12:09.539917 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2fb114-cbcb-4ed5-b70f-5605eacf312a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:12:09.591887 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-9b2fb114-cbcb-4ed5-b70f-5605eacf312a None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:12:09.594991 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-9b2fb114-cbcb-4ed5-b70f-5605eacf312a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:12:09.617735 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1021/2044] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:12:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:12:09.622654 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40852cc6-f91a-476c-ac3d-b94bfeaf5cf6 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:12:09.673507 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40852cc6-f91a-476c-ac3d-b94bfeaf5cf6 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:12:09.688884 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4989d64f-9331-43b0-8af8-caba2eddb5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:12:09.689538 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989d64f-9331-43b0-8af8-caba2eddb5b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:12:09.689820 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989d64f-9331-43b0-8af8-caba2eddb5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:12:09.690120 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989d64f-9331-43b0-8af8-caba2eddb5b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:12:09.690836 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4989d64f-9331-43b0-8af8-caba2eddb5b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:12:09.694121 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4989d64f-9331-43b0-8af8-caba2eddb5b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:12:09.704846 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4989d64f-9331-43b0-8af8-caba2eddb5b9 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:12:09.747982 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1024/2045] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 11:12:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:12:09.752542 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2fb114-cbcb-4ed5-b70f-5605eacf312a None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:12:09.766891 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2fb114-cbcb-4ed5-b70f-5605eacf312a None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:12:09.774112 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7cd4fa-44a2-4240-a9f7-9927448ef469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:12:09.775007 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7cd4fa-44a2-4240-a9f7-9927448ef469 admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:12:09.775483 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7cd4fa-44a2-4240-a9f7-9927448ef469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:12:09.775973 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7cd4fa-44a2-4240-a9f7-9927448ef469 admin admin] PATH_INFO: `/v3/projects` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:12:09.776937 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7cd4fa-44a2-4240-a9f7-9927448ef469 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:12:09.778691 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7cd4fa-44a2-4240-a9f7-9927448ef469 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:12:09.841887 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4989d64f-9331-43b0-8af8-caba2eddb5b9 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:12:09.842187 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1022/2046] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:12:09 2022] POST /identity/v3/projects => generated 399 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:12:09.869980 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4989d64f-9331-43b0-8af8-caba2eddb5b9 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:12:09.913068 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:12:10.020646 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737fe82c-4188-47be-9d90-81fefb41d99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:12:10.021447 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737fe82c-4188-47be-9d90-81fefb41d99b admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:12:10.022161 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737fe82c-4188-47be-9d90-81fefb41d99b admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:12:10.022161 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737fe82c-4188-47be-9d90-81fefb41d99b admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:12:10.022865 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737fe82c-4188-47be-9d90-81fefb41d99b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:12:10.027637 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737fe82c-4188-47be-9d90-81fefb41d99b admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:12:10.129307 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7cd4fa-44a2-4240-a9f7-9927448ef469 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:12:10.134961 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1025/2047] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:12:09 2022] POST /identity/v3/users => generated 300 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 11:12:10.154252 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7cd4fa-44a2-4240-a9f7-9927448ef469 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:12:10.169450 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a8c60b-9834-4ffc-9dda-04861cd025ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:12:10.170281 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a8c60b-9834-4ffc-9dda-04861cd025ea admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:12:10.170622 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a8c60b-9834-4ffc-9dda-04861cd025ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:12:10.170899 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a8c60b-9834-4ffc-9dda-04861cd025ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:12:10.171561 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a8c60b-9834-4ffc-9dda-04861cd025ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:12:10.199884 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a8c60b-9834-4ffc-9dda-04861cd025ea admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:12:10.235931 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1023/2048] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:12:10 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:12:10.236235 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737fe82c-4188-47be-9d90-81fefb41d99b admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:12:10.255733 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737fe82c-4188-47be-9d90-81fefb41d99b admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:12:10.261783 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d25bbfb-4b8d-4e51-b9d4-c5d10cc00cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:12:10.264581 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d25bbfb-4b8d-4e51-b9d4-c5d10cc00cd9 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:12:10.264900 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d25bbfb-4b8d-4e51-b9d4-c5d10cc00cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:12:10.265140 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d25bbfb-4b8d-4e51-b9d4-c5d10cc00cd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:12:10.265805 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d25bbfb-4b8d-4e51-b9d4-c5d10cc00cd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:12:10.268177 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d25bbfb-4b8d-4e51-b9d4-c5d10cc00cd9 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:12:10.316404 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1026/2049] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:12:10 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 13 11:12:10.318419 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a8c60b-9834-4ffc-9dda-04861cd025ea admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:12:10.338422 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a8c60b-9834-4ffc-9dda-04861cd025ea admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:12:10.351953 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcce6ef-d706-48e9-8566-5b264468f4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:12:10.353613 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcce6ef-d706-48e9-8566-5b264468f4ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:12:10.356361 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcce6ef-d706-48e9-8566-5b264468f4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:12:10.356797 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcce6ef-d706-48e9-8566-5b264468f4ad admin admin] PATH_INFO: `/v3/projects/712552d78be04a16b39912533ebfa30e/users/2a98fadf73b449eeb4c8949b468ec443/roles/7c3871c0ab68438b9014489d50b53a22` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:12:10.402539 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcce6ef-d706-48e9-8566-5b264468f4ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=712552d78be04a16b39912533ebfa30e, user_id=2a98fadf73b449eeb4c8949b468ec443, role_id=7c3871c0ab68438b9014489d50b53a22)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:12:10.406637 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcce6ef-d706-48e9-8566-5b264468f4ad admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:12:10.442518 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1024/2050] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:12:10 2022] PUT /identity/v3/projects/712552d78be04a16b39912533ebfa30e/users/2a98fadf73b449eeb4c8949b468ec443/roles/7c3871c0ab68438b9014489d50b53a22 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:12:10.449786 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e33018-ab2b-4885-8616-1ee582d1d372 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:12:10.450802 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e33018-ab2b-4885-8616-1ee582d1d372 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:12:10.451263 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e33018-ab2b-4885-8616-1ee582d1d372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:12:10.541694 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-a6e33018-ab2b-4885-8616-1ee582d1d372 None None] MFA Rules not processed for user `2a98fadf73b449eeb4c8949b468ec443`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:12:10.543492 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-a6e33018-ab2b-4885-8616-1ee582d1d372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:12:10.751048 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1027/2051] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:12:10 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:12:10.759930 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcce6ef-d706-48e9-8566-5b264468f4ad admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:12:10.761812 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-fbcce6ef-d706-48e9-8566-5b264468f4ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:12:10.847383 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:12:10.912658 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcce6ef-d706-48e9-8566-5b264468f4ad admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:12:10.927283 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b699c40-c9ab-403e-bb70-03678f6f670d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f4c2fc51f54f0e977648b13efaed1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:12:10.927916 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b699c40-c9ab-403e-bb70-03678f6f670d service cinder] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:12:10.928375 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b699c40-c9ab-403e-bb70-03678f6f670d service cinder] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:12:10.928646 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b699c40-c9ab-403e-bb70-03678f6f670d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:12:10.949405 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b699c40-c9ab-403e-bb70-03678f6f670d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:12:10.951189 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b699c40-c9ab-403e-bb70-03678f6f670d service cinder] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:12:10.973408 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1025/2052] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:12:10 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:12:11.807635 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d99163-460b-4f52-a6b1-002d6f68d15e None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:12:11.808102 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d99163-460b-4f52-a6b1-002d6f68d15e None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:12:11.808544 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d99163-460b-4f52-a6b1-002d6f68d15e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:12:11.887361 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-f4d99163-460b-4f52-a6b1-002d6f68d15e None None] MFA Rules not processed for user `54e3ec4a20454c2d8d65bef20b322782`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:12:11.889676 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-f4d99163-460b-4f52-a6b1-002d6f68d15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:12:12.079717 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1028/2053] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:12:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:12:13.181815 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faeaed3-8944-4437-86e8-fbbcbd79206a None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:12:13.182379 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faeaed3-8944-4437-86e8-fbbcbd79206a None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:12:13.182379 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faeaed3-8944-4437-86e8-fbbcbd79206a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:12:13.237209 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-1faeaed3-8944-4437-86e8-fbbcbd79206a None None] MFA Rules not processed for user `87481f225ead4faea8fdb667b3f3a1e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:12:13.240007 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-1faeaed3-8944-4437-86e8-fbbcbd79206a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:12:13.405809 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1026/2054] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:12:13 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:12:13.424075 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d99163-460b-4f52-a6b1-002d6f68d15e None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:12:13.426103 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-f4d99163-460b-4f52-a6b1-002d6f68d15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:12:13.477031 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:12:13.518545 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d99163-460b-4f52-a6b1-002d6f68d15e None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:12:13.523571 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515cffd2-2a22-4bd8-8b9f-00c0743a45bf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '399f7d3700a24cb486e56b409a6e5429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:12:13.524509 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515cffd2-2a22-4bd8-8b9f-00c0743a45bf service glance] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:12:13.524997 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515cffd2-2a22-4bd8-8b9f-00c0743a45bf service glance] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:12:13.525621 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515cffd2-2a22-4bd8-8b9f-00c0743a45bf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:12:13.528601 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-515cffd2-2a22-4bd8-8b9f-00c0743a45bf service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:12:13.607425 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515cffd2-2a22-4bd8-8b9f-00c0743a45bf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:12:13.610147 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515cffd2-2a22-4bd8-8b9f-00c0743a45bf service glance] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:12:13.627350 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1029/2055] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:12:13 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:12:13.906753 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c13061-7aa2-458b-bc84-65dca85ead13 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:12:13.907335 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c13061-7aa2-458b-bc84-65dca85ead13 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:12:13.907796 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c13061-7aa2-458b-bc84-65dca85ead13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:12:13.959580 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-a1c13061-7aa2-458b-bc84-65dca85ead13 None None] MFA Rules not processed for user `6e803a9cc6114c4f93869e50bca313e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:12:13.960920 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-a1c13061-7aa2-458b-bc84-65dca85ead13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:12:14.094364 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1027/2056] 10.222.0.25 () {58 vars in 1009 bytes} [Thu Oct 13 11:12:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:12:14.185554 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515cffd2-2a22-4bd8-8b9f-00c0743a45bf service glance] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:12:14.187063 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-515cffd2-2a22-4bd8-8b9f-00c0743a45bf service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:12:14.288690 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515cffd2-2a22-4bd8-8b9f-00c0743a45bf service glance] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:12:14.302984 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6612c1f6-daee-417f-90da-ca93605d6da3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e24c779d0a604ef28dfc1235ee76a711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:12:14.303832 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612c1f6-daee-417f-90da-ca93605d6da3 service swift] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:12:14.304302 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612c1f6-daee-417f-90da-ca93605d6da3 service swift] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:12:14.306079 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612c1f6-daee-417f-90da-ca93605d6da3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:12:14.316562 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6612c1f6-daee-417f-90da-ca93605d6da3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:12:14.318965 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6612c1f6-daee-417f-90da-ca93605d6da3 service swift] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:12:14.329751 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1030/2057] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Oct 13 11:12:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 13 11:12:16.880057 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c13061-7aa2-458b-bc84-65dca85ead13 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:12:17.043282 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c13061-7aa2-458b-bc84-65dca85ead13 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:12:17.048506 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001334c9-d169-47c1-993b-09b3dd38173f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:12:17.049731 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001334c9-d169-47c1-993b-09b3dd38173f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:12:17.050266 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001334c9-d169-47c1-993b-09b3dd38173f admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:12:17.050760 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001334c9-d169-47c1-993b-09b3dd38173f admin admin] PATH_INFO: `/v3/users/2a98fadf73b449eeb4c8949b468ec443` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:12:17.055541 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001334c9-d169-47c1-993b-09b3dd38173f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a98fadf73b449eeb4c8949b468ec443)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:12:17.057780 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001334c9-d169-47c1-993b-09b3dd38173f admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:12:17.091850 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:12:17.175567 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-001334c9-d169-47c1-993b-09b3dd38173f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a98fadf73b449eeb4c8949b468ec443'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:12:17.189609 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-001334c9-d169-47c1-993b-09b3dd38173f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a98fadf73b449eeb4c8949b468ec443'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:12:17.190840 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-001334c9-d169-47c1-993b-09b3dd38173f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a98fadf73b449eeb4c8949b468ec443'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:12:17.191826 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-001334c9-d169-47c1-993b-09b3dd38173f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a98fadf73b449eeb4c8949b468ec443'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:12:17.219552 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-001334c9-d169-47c1-993b-09b3dd38173f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a98fadf73b449eeb4c8949b468ec443'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:12:17.254464 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1028/2058] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:12:16 2022] DELETE /identity/v3/users/2a98fadf73b449eeb4c8949b468ec443 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:12:17.258609 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d66df-f6e6-4266-a9c9-fbdb35d690cd None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:12:17.262397 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d66df-f6e6-4266-a9c9-fbdb35d690cd None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:12:17.262715 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d66df-f6e6-4266-a9c9-fbdb35d690cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:12:17.310437 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-a02d66df-f6e6-4266-a9c9-fbdb35d690cd None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:12:17.312731 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-a02d66df-f6e6-4266-a9c9-fbdb35d690cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:12:17.451938 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1031/2059] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:12:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:12:17.463904 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001334c9-d169-47c1-993b-09b3dd38173f admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:12:17.465621 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-001334c9-d169-47c1-993b-09b3dd38173f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:12:17.610782 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001334c9-d169-47c1-993b-09b3dd38173f admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:12:17.621781 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9988c0f-ad29-4e3d-9ca2-8c7872e627cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:12:17.623035 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9988c0f-ad29-4e3d-9ca2-8c7872e627cd service neutron] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:12:17.623594 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9988c0f-ad29-4e3d-9ca2-8c7872e627cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:12:17.623868 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9988c0f-ad29-4e3d-9ca2-8c7872e627cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:12:17.641139 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9988c0f-ad29-4e3d-9ca2-8c7872e627cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:12:17.647724 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9988c0f-ad29-4e3d-9ca2-8c7872e627cd service neutron] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:12:17.662068 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1029/2060] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:12:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:12:18.335328 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d66df-f6e6-4266-a9c9-fbdb35d690cd None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:12:18.336805 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-a02d66df-f6e6-4266-a9c9-fbdb35d690cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:12:18.360228 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d66df-f6e6-4266-a9c9-fbdb35d690cd None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:12:18.366100 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6398d15-a5a2-4065-8a17-86cbb24f07fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:12:18.366761 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6398d15-a5a2-4065-8a17-86cbb24f07fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:12:18.367040 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6398d15-a5a2-4065-8a17-86cbb24f07fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:12:18.367497 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6398d15-a5a2-4065-8a17-86cbb24f07fe admin admin] PATH_INFO: `/v3/projects/712552d78be04a16b39912533ebfa30e` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:12:18.368723 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6398d15-a5a2-4065-8a17-86cbb24f07fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=712552d78be04a16b39912533ebfa30e)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:12:18.370706 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6398d15-a5a2-4065-8a17-86cbb24f07fe admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:12:18.400982 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:12:18.538642 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-f6398d15-a5a2-4065-8a17-86cbb24f07fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '712552d78be04a16b39912533ebfa30e', 'request_id': 'req-f6398d15-a5a2-4065-8a17-86cbb24f07fe'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:12:18.550459 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-f6398d15-a5a2-4065-8a17-86cbb24f07fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '712552d78be04a16b39912533ebfa30e', 'request_id': 'req-f6398d15-a5a2-4065-8a17-86cbb24f07fe'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:12:18.565374 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-f6398d15-a5a2-4065-8a17-86cbb24f07fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '712552d78be04a16b39912533ebfa30e', 'request_id': 'req-f6398d15-a5a2-4065-8a17-86cbb24f07fe'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:12:18.592053 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-f6398d15-a5a2-4065-8a17-86cbb24f07fe admin admin] The token cache is being invalidate because project 712552d78be04a16b39912533ebfa30e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:12:18.592554 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-f6398d15-a5a2-4065-8a17-86cbb24f07fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:12:18.593389 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-f6398d15-a5a2-4065-8a17-86cbb24f07fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:12:18.595161 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1032/2061] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:12:18 2022] DELETE /identity/v3/projects/712552d78be04a16b39912533ebfa30e => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:12:25.745265 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b03709-160c-4ff6-8dd1-126bf04103ef None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:12:25.745790 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b03709-160c-4ff6-8dd1-126bf04103ef None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:12:25.746207 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b03709-160c-4ff6-8dd1-126bf04103ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:12:25.772292 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-02b03709-160c-4ff6-8dd1-126bf04103ef None None] MFA Rules not processed for user `1674289511b749d4b23c4441714e437d`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:12:25.773616 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-02b03709-160c-4ff6-8dd1-126bf04103ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:12:25.847490 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1030/2062] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:12:25 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:12:25.884284 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1f9bf-6df3-4d05-849d-656c50d66df1 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:12:25.886551 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1f9bf-6df3-4d05-849d-656c50d66df1 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:12:25.886970 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1f9bf-6df3-4d05-849d-656c50d66df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:12:25.911566 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-13a1f9bf-6df3-4d05-849d-656c50d66df1 None None] MFA Rules not processed for user `6e803a9cc6114c4f93869e50bca313e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:12:25.912847 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-13a1f9bf-6df3-4d05-849d-656c50d66df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:12:25.983615 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1033/2063] 10.222.0.25 () {58 vars in 1009 bytes} [Thu Oct 13 11:12:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:12:25.997256 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b03709-160c-4ff6-8dd1-126bf04103ef None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:12:25.999013 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-02b03709-160c-4ff6-8dd1-126bf04103ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:12:26.060592 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:12:26.096125 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b03709-160c-4ff6-8dd1-126bf04103ef None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:12:26.120803 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cf5c89-f5ac-49ec-b647-a0e222291770 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e24c779d0a604ef28dfc1235ee76a711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:12:26.121430 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cf5c89-f5ac-49ec-b647-a0e222291770 service swift] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:12:26.121708 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cf5c89-f5ac-49ec-b647-a0e222291770 service swift] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:12:26.121998 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cf5c89-f5ac-49ec-b647-a0e222291770 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:12:26.137328 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cf5c89-f5ac-49ec-b647-a0e222291770 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:12:26.139338 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cf5c89-f5ac-49ec-b647-a0e222291770 service swift] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:12:26.151591 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1031/2064] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Oct 13 11:12:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 13 11:12:27.066804 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ea935f-49e7-4c56-8737-52768214c294 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:12:27.067802 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ea935f-49e7-4c56-8737-52768214c294 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:12:27.068310 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ea935f-49e7-4c56-8737-52768214c294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:12:27.093794 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-51ea935f-49e7-4c56-8737-52768214c294 None None] MFA Rules not processed for user `a73024b071b14177b20736c015420f8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:12:27.095307 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-51ea935f-49e7-4c56-8737-52768214c294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:12:27.189541 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1034/2065] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:12:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:12:31.773518 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eefb7d-f15b-48eb-8e59-a44760f057ac None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:12:31.774610 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eefb7d-f15b-48eb-8e59-a44760f057ac None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:12:31.775351 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eefb7d-f15b-48eb-8e59-a44760f057ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:12:31.829158 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-20eefb7d-f15b-48eb-8e59-a44760f057ac None None] MFA Rules not processed for user `6e803a9cc6114c4f93869e50bca313e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:12:31.832064 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-20eefb7d-f15b-48eb-8e59-a44760f057ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:12:31.848179 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1032/2066] 10.222.0.25 () {58 vars in 1009 bytes} [Thu Oct 13 11:12:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:12:31.855094 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ea935f-49e7-4c56-8737-52768214c294 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:12:31.887284 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ea935f-49e7-4c56-8737-52768214c294 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:12:31.912409 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a843f0-fda3-4c4a-b5f6-eb787bd2caa2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e24c779d0a604ef28dfc1235ee76a711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:12:31.913037 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a843f0-fda3-4c4a-b5f6-eb787bd2caa2 service swift] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:12:31.913315 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a843f0-fda3-4c4a-b5f6-eb787bd2caa2 service swift] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:12:31.913583 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a843f0-fda3-4c4a-b5f6-eb787bd2caa2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:12:31.926075 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a843f0-fda3-4c4a-b5f6-eb787bd2caa2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:12:31.928175 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a843f0-fda3-4c4a-b5f6-eb787bd2caa2 service swift] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:12:31.937533 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1035/2067] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Oct 13 11:12:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 13 11:12:37.875080 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616dc83e-2c99-4337-8a6f-6d5326b6d456 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:12:37.890547 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616dc83e-2c99-4337-8a6f-6d5326b6d456 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:12:37.891276 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616dc83e-2c99-4337-8a6f-6d5326b6d456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:12:37.936382 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-616dc83e-2c99-4337-8a6f-6d5326b6d456 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:12:37.938084 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-616dc83e-2c99-4337-8a6f-6d5326b6d456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:12:38.097362 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1033/2068] 10.222.0.30 () {58 vars in 1016 bytes} [Thu Oct 13 11:12:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:12:38.157137 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a843f0-fda3-4c4a-b5f6-eb787bd2caa2 service swift] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:12:38.158853 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-a5a843f0-fda3-4c4a-b5f6-eb787bd2caa2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:12:38.234236 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:12:38.309657 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a843f0-fda3-4c4a-b5f6-eb787bd2caa2 service swift] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:12:38.321197 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728351fd-6bca-404c-8d3c-e2109a392133 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78384fbffdd346578855e7214b335d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:12:38.321826 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728351fd-6bca-404c-8d3c-e2109a392133 service nova] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:12:38.322270 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728351fd-6bca-404c-8d3c-e2109a392133 service nova] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:12:38.322544 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728351fd-6bca-404c-8d3c-e2109a392133 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:12:38.332650 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728351fd-6bca-404c-8d3c-e2109a392133 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:12:38.334419 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728351fd-6bca-404c-8d3c-e2109a392133 service nova] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:12:38.364509 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1036/2069] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:12:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:12:48.077663 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=45 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:12:48.344322 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=19 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:12:49.750870 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9787a33-1bd7-49d6-9011-627c34b74367 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:12:49.751467 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9787a33-1bd7-49d6-9011-627c34b74367 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:12:49.751579 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9787a33-1bd7-49d6-9011-627c34b74367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:12:49.775237 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-e9787a33-1bd7-49d6-9011-627c34b74367 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:12:49.776566 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-e9787a33-1bd7-49d6-9011-627c34b74367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:12:49.787112 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1034/2070] 10.222.0.30 () {58 vars in 1016 bytes} [Thu Oct 13 11:12:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:12:50.025431 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728351fd-6bca-404c-8d3c-e2109a392133 service nova] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:12:50.027175 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-728351fd-6bca-404c-8d3c-e2109a392133 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:12:50.043166 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728351fd-6bca-404c-8d3c-e2109a392133 service nova] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:12:50.049174 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b76e85-e78f-41f4-8590-e7b1a1514932 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78384fbffdd346578855e7214b335d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:12:50.049777 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b76e85-e78f-41f4-8590-e7b1a1514932 service nova] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:12:50.050247 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b76e85-e78f-41f4-8590-e7b1a1514932 service nova] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:12:50.050681 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b76e85-e78f-41f4-8590-e7b1a1514932 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:12:50.060778 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b76e85-e78f-41f4-8590-e7b1a1514932 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:12:50.062653 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b76e85-e78f-41f4-8590-e7b1a1514932 service nova] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:12:50.084606 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1037/2071] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:12:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:12:56.111004 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fde693-4324-434c-a0ed-47c383e1a17f None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:12:56.111548 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fde693-4324-434c-a0ed-47c383e1a17f None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:12:56.111548 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fde693-4324-434c-a0ed-47c383e1a17f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:12:56.131032 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-d0fde693-4324-434c-a0ed-47c383e1a17f None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:12:56.132528 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-d0fde693-4324-434c-a0ed-47c383e1a17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:12:56.140331 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1035/2072] 10.222.0.30 () {58 vars in 1016 bytes} [Thu Oct 13 11:12:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:12:56.269377 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b76e85-e78f-41f4-8590-e7b1a1514932 service nova] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:12:56.281759 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b76e85-e78f-41f4-8590-e7b1a1514932 service nova] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:12:56.288133 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e6d29a-cd4d-4df9-bdc2-f9c39c04a8c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78384fbffdd346578855e7214b335d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:12:56.288865 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6d29a-cd4d-4df9-bdc2-f9c39c04a8c1 service nova] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:12:56.289237 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6d29a-cd4d-4df9-bdc2-f9c39c04a8c1 service nova] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:12:56.289465 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6d29a-cd4d-4df9-bdc2-f9c39c04a8c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:12:56.298710 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e6d29a-cd4d-4df9-bdc2-f9c39c04a8c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:12:56.300295 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e6d29a-cd4d-4df9-bdc2-f9c39c04a8c1 service nova] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:12:56.309855 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1038/2073] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:12:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:12:56.956675 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdba2362-77fb-4518-90e8-9e42453b81b1 None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:12:56.957051 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdba2362-77fb-4518-90e8-9e42453b81b1 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:12:56.957393 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdba2362-77fb-4518-90e8-9e42453b81b1 None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:12:56.958875 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1036/2074] 10.222.0.25 () {54 vars in 921 bytes} [Thu Oct 13 11:12:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:12:56.966763 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4bcac-ad65-47c0-9feb-5e5b317868e2 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:12:56.967083 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4bcac-ad65-47c0-9feb-5e5b317868e2 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:12:56.967367 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4bcac-ad65-47c0-9feb-5e5b317868e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:12:56.988856 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-87f4bcac-ad65-47c0-9feb-5e5b317868e2 None None] MFA Rules not processed for user `78384fbffdd346578855e7214b335d8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:12:56.989778 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-87f4bcac-ad65-47c0-9feb-5e5b317868e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:12:56.999682 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1039/2075] 10.222.0.25 () {58 vars in 1018 bytes} [Thu Oct 13 11:12:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:12:57.012552 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdba2362-77fb-4518-90e8-9e42453b81b1 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:12:57.014289 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-cdba2362-77fb-4518-90e8-9e42453b81b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:12:57.081889 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdba2362-77fb-4518-90e8-9e42453b81b1 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:12:57.085153 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a55eb0-b6eb-4674-b977-ecae0e0e6aa7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '399f7d3700a24cb486e56b409a6e5429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:12:57.085769 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a55eb0-b6eb-4674-b977-ecae0e0e6aa7 service glance] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:12:57.086108 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a55eb0-b6eb-4674-b977-ecae0e0e6aa7 service glance] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:12:57.086387 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a55eb0-b6eb-4674-b977-ecae0e0e6aa7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:12:57.101379 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a55eb0-b6eb-4674-b977-ecae0e0e6aa7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:12:57.103124 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a55eb0-b6eb-4674-b977-ecae0e0e6aa7 service glance] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:12:57.114812 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1037/2076] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:12:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:12:57.183706 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c83bff-831b-4ee0-aaf3-92209de6cf6a None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:12:57.183990 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c83bff-831b-4ee0-aaf3-92209de6cf6a None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:12:57.184264 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c83bff-831b-4ee0-aaf3-92209de6cf6a None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:12:57.185628 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1040/2077] 10.222.0.25 () {54 vars in 921 bytes} [Thu Oct 13 11:12:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:12:57.190914 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e812b4c-e702-4909-bfc5-4e0e585af390 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:12:57.191204 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e812b4c-e702-4909-bfc5-4e0e585af390 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:12:57.191478 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e812b4c-e702-4909-bfc5-4e0e585af390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:12:57.212821 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-8e812b4c-e702-4909-bfc5-4e0e585af390 None None] MFA Rules not processed for user `085e8bffed444287bc5f805461c3fb55`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:12:57.214079 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-8e812b4c-e702-4909-bfc5-4e0e585af390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:12:57.263745 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1038/2078] 10.222.0.25 () {58 vars in 1018 bytes} [Thu Oct 13 11:12:57 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:12:57.276364 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c83bff-831b-4ee0-aaf3-92209de6cf6a None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:12:57.278238 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-56c83bff-831b-4ee0-aaf3-92209de6cf6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:12:57.291708 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c83bff-831b-4ee0-aaf3-92209de6cf6a None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:12:57.295384 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b21f08-2506-424a-87f6-465f74b9df88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:12:57.296205 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b21f08-2506-424a-87f6-465f74b9df88 service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:12:57.296642 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b21f08-2506-424a-87f6-465f74b9df88 service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:12:57.296915 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b21f08-2506-424a-87f6-465f74b9df88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:12:57.304200 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b21f08-2506-424a-87f6-465f74b9df88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:12:57.305621 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b21f08-2506-424a-87f6-465f74b9df88 service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:12:57.315047 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1041/2079] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:12:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:12:57.464148 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc65ce-95a9-47b8-ac79-aca6bd464c6c None None] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:12:57.464379 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc65ce-95a9-47b8-ac79-aca6bd464c6c None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:12:57.464673 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc65ce-95a9-47b8-ac79-aca6bd464c6c None None] PATH_INFO: `/` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:12:57.466079 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1039/2080] 10.222.0.25 () {54 vars in 921 bytes} [Thu Oct 13 11:12:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:12:57.471963 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8337a17-d343-4dc1-9c5c-d715a42ccab9 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:12:57.472464 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8337a17-d343-4dc1-9c5c-d715a42ccab9 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:12:57.472811 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8337a17-d343-4dc1-9c5c-d715a42ccab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:12:57.495763 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-e8337a17-d343-4dc1-9c5c-d715a42ccab9 None None] MFA Rules not processed for user `78384fbffdd346578855e7214b335d8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:12:57.497048 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-e8337a17-d343-4dc1-9c5c-d715a42ccab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:12:57.514681 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1042/2081] 10.222.0.25 () {58 vars in 1018 bytes} [Thu Oct 13 11:12:57 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:12:57.525608 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc65ce-95a9-47b8-ac79-aca6bd464c6c None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:12:57.527394 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-c8fc65ce-95a9-47b8-ac79-aca6bd464c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:12:57.541294 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc65ce-95a9-47b8-ac79-aca6bd464c6c None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:12:57.544889 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e3cbe0-9206-4555-bfb3-b3176db1b029 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:12:57.545517 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e3cbe0-9206-4555-bfb3-b3176db1b029 service neutron] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:12:57.545797 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e3cbe0-9206-4555-bfb3-b3176db1b029 service neutron] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:12:57.546116 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e3cbe0-9206-4555-bfb3-b3176db1b029 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:12:57.557105 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e3cbe0-9206-4555-bfb3-b3176db1b029 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:12:57.558557 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e3cbe0-9206-4555-bfb3-b3176db1b029 service neutron] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:12:57.570680 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1040/2082] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:12:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:13:01.303937 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70693328-dbd7-48a4-8aeb-34ff18d36d86 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:13:01.304535 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70693328-dbd7-48a4-8aeb-34ff18d36d86 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:13:01.304535 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70693328-dbd7-48a4-8aeb-34ff18d36d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:13:01.326362 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-70693328-dbd7-48a4-8aeb-34ff18d36d86 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:13:01.328773 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-70693328-dbd7-48a4-8aeb-34ff18d36d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:13:01.337627 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1043/2083] 10.222.0.30 () {58 vars in 1016 bytes} [Thu Oct 13 11:13:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:13:01.372118 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e3cbe0-9206-4555-bfb3-b3176db1b029 service neutron] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:13:01.389102 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e3cbe0-9206-4555-bfb3-b3176db1b029 service neutron] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:13:01.400271 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb6bc0e-160e-4c81-84b0-1509635a18a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78384fbffdd346578855e7214b335d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:13:01.401406 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb6bc0e-160e-4c81-84b0-1509635a18a2 service nova] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:13:01.401825 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb6bc0e-160e-4c81-84b0-1509635a18a2 service nova] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:13:01.402239 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb6bc0e-160e-4c81-84b0-1509635a18a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:13:01.413464 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb6bc0e-160e-4c81-84b0-1509635a18a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:13:01.415480 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb6bc0e-160e-4c81-84b0-1509635a18a2 service nova] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:13:01.427756 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1041/2084] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:13:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:13:06.550395 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4dff85-7d84-4fe5-a597-b5eefacce5ad None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:13:06.551199 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4dff85-7d84-4fe5-a597-b5eefacce5ad None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:13:06.552211 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4dff85-7d84-4fe5-a597-b5eefacce5ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:13:06.587097 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-af4dff85-7d84-4fe5-a597-b5eefacce5ad None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:13:06.588619 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-af4dff85-7d84-4fe5-a597-b5eefacce5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:13:06.597639 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1044/2085] 10.222.0.30 () {58 vars in 1016 bytes} [Thu Oct 13 11:13:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:13:06.796581 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb6bc0e-160e-4c81-84b0-1509635a18a2 service nova] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:13:06.827255 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb6bc0e-160e-4c81-84b0-1509635a18a2 service nova] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:13:06.827611 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4dff85-7d84-4fe5-a597-b5eefacce5ad None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:13:06.833056 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702e67ce-b00b-4760-a4ec-fe65bdf97400 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78384fbffdd346578855e7214b335d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:13:06.833745 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702e67ce-b00b-4760-a4ec-fe65bdf97400 service nova] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:13:06.834125 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702e67ce-b00b-4760-a4ec-fe65bdf97400 service nova] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:13:06.834492 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702e67ce-b00b-4760-a4ec-fe65bdf97400 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:13:06.838788 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4dff85-7d84-4fe5-a597-b5eefacce5ad None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:13:06.843272 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702e67ce-b00b-4760-a4ec-fe65bdf97400 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:13:06.843443 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19160304-bb05-4ee9-a66e-577c3ea10a60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:13:06.844046 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19160304-bb05-4ee9-a66e-577c3ea10a60 service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:13:06.844324 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19160304-bb05-4ee9-a66e-577c3ea10a60 service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:13:06.844600 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19160304-bb05-4ee9-a66e-577c3ea10a60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:13:06.844841 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702e67ce-b00b-4760-a4ec-fe65bdf97400 service nova] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:13:06.846876 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-19160304-bb05-4ee9-a66e-577c3ea10a60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:13:06.855692 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1042/2086] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:13:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:13:06.912353 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19160304-bb05-4ee9-a66e-577c3ea10a60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:13:06.913792 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19160304-bb05-4ee9-a66e-577c3ea10a60 service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:13:06.923402 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1045/2087] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:13:06 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 13 11:13:08.819650 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758bbdf-4678-4ffb-8a41-035f03d16e83 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:13:08.821008 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758bbdf-4678-4ffb-8a41-035f03d16e83 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:13:08.821482 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758bbdf-4678-4ffb-8a41-035f03d16e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:13:08.850048 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-5758bbdf-4678-4ffb-8a41-035f03d16e83 None None] MFA Rules not processed for user `6e803a9cc6114c4f93869e50bca313e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:13:08.851588 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-5758bbdf-4678-4ffb-8a41-035f03d16e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:13:08.861886 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1043/2088] 10.222.0.25 () {58 vars in 1009 bytes} [Thu Oct 13 11:13:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:13:08.879057 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19160304-bb05-4ee9-a66e-577c3ea10a60 service neutron] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:13:08.896791 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19160304-bb05-4ee9-a66e-577c3ea10a60 service neutron] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:13:08.902787 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa8a529-5b95-4020-91c3-ad234b40e1fe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e24c779d0a604ef28dfc1235ee76a711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:13:08.903430 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa8a529-5b95-4020-91c3-ad234b40e1fe service swift] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:13:08.903843 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa8a529-5b95-4020-91c3-ad234b40e1fe service swift] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:13:08.904120 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa8a529-5b95-4020-91c3-ad234b40e1fe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:13:08.913104 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa8a529-5b95-4020-91c3-ad234b40e1fe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:13:08.914819 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa8a529-5b95-4020-91c3-ad234b40e1fe service swift] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:13:08.923418 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1046/2089] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Oct 13 11:13:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 13 11:13:10.055278 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5758bbdf-4678-4ffb-8a41-035f03d16e83 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:13:10.068997 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5758bbdf-4678-4ffb-8a41-035f03d16e83 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:13:10.073636 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83781c6d-fea2-4aa3-944c-d47331a60076 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:13:10.074767 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83781c6d-fea2-4aa3-944c-d47331a60076 service neutron] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:13:10.075118 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83781c6d-fea2-4aa3-944c-d47331a60076 service neutron] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:13:10.075702 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83781c6d-fea2-4aa3-944c-d47331a60076 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:13:10.078849 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-83781c6d-fea2-4aa3-944c-d47331a60076 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:13:10.172877 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:13:10.193727 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83781c6d-fea2-4aa3-944c-d47331a60076 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:13:10.195453 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83781c6d-fea2-4aa3-944c-d47331a60076 service neutron] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:13:10.207902 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1044/2090] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:13:10 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 13 11:13:18.920033 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=66 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:13:20.202627 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=6 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:13:21.162311 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e82e60c-2fa6-4690-ac47-55a12b262dae None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:13:21.162809 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e82e60c-2fa6-4690-ac47-55a12b262dae None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:13:21.162905 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e82e60c-2fa6-4690-ac47-55a12b262dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:13:21.183026 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-8e82e60c-2fa6-4690-ac47-55a12b262dae None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:13:21.184219 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-8e82e60c-2fa6-4690-ac47-55a12b262dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:13:21.191996 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1047/2091] 10.222.0.30 () {58 vars in 1016 bytes} [Thu Oct 13 11:13:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:13:21.214795 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83781c6d-fea2-4aa3-944c-d47331a60076 service neutron] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:13:21.228244 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83781c6d-fea2-4aa3-944c-d47331a60076 service neutron] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:13:21.233727 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe62266d-424b-440a-8518-6049102a033c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78384fbffdd346578855e7214b335d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:13:21.234273 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62266d-424b-440a-8518-6049102a033c service nova] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:13:21.234553 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62266d-424b-440a-8518-6049102a033c service nova] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:13:21.234824 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62266d-424b-440a-8518-6049102a033c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:13:21.243436 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe62266d-424b-440a-8518-6049102a033c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:13:21.244989 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe62266d-424b-440a-8518-6049102a033c service nova] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:13:21.254557 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1045/2092] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:13:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:13:31.177487 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=3 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:13:31.250317 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=6 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:13:35.056433 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0251d10-7660-448b-ba6d-1d2ade058962 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:13:35.056937 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0251d10-7660-448b-ba6d-1d2ade058962 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:13:35.057039 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0251d10-7660-448b-ba6d-1d2ade058962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:13:35.077143 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-a0251d10-7660-448b-ba6d-1d2ade058962 None None] MFA Rules not processed for user `6e803a9cc6114c4f93869e50bca313e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:13:35.078311 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-a0251d10-7660-448b-ba6d-1d2ade058962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:13:35.086146 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1048/2093] 10.222.0.25 () {58 vars in 967 bytes} [Thu Oct 13 11:13:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:13:35.109346 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe62266d-424b-440a-8518-6049102a033c service nova] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:13:35.120383 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe62266d-424b-440a-8518-6049102a033c service nova] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:13:35.125761 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a55db46-7fa1-4113-ad9a-2527396df523 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e24c779d0a604ef28dfc1235ee76a711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:13:35.126398 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a55db46-7fa1-4113-ad9a-2527396df523 service swift] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:13:35.126706 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a55db46-7fa1-4113-ad9a-2527396df523 service swift] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:13:35.126976 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a55db46-7fa1-4113-ad9a-2527396df523 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:13:35.135214 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a55db46-7fa1-4113-ad9a-2527396df523 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:13:35.136822 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a55db46-7fa1-4113-ad9a-2527396df523 service swift] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:13:35.145417 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1046/2094] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Oct 13 11:13:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 13 11:13:35.762634 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0251d10-7660-448b-ba6d-1d2ade058962 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:13:35.764115 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-a0251d10-7660-448b-ba6d-1d2ade058962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:13:35.832739 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0251d10-7660-448b-ba6d-1d2ade058962 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:13:35.837629 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad47753f-bc85-4150-88cb-8596713c128a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed4bb75e68a640fc92ddd47fad61a25a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:13:35.838253 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad47753f-bc85-4150-88cb-8596713c128a service placement] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:13:35.838529 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad47753f-bc85-4150-88cb-8596713c128a service placement] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:13:35.838801 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad47753f-bc85-4150-88cb-8596713c128a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:13:35.840515 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-ad47753f-bc85-4150-88cb-8596713c128a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:13:35.852273 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad47753f-bc85-4150-88cb-8596713c128a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:13:35.853890 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad47753f-bc85-4150-88cb-8596713c128a service placement] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:13:35.863559 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1049/2095] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:13:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:13:40.762228 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c3ff9-f598-4581-8b6f-04c696bdc427 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:13:40.762813 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c3ff9-f598-4581-8b6f-04c696bdc427 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:13:40.762813 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c3ff9-f598-4581-8b6f-04c696bdc427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:13:40.782028 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-411c3ff9-f598-4581-8b6f-04c696bdc427 None None] MFA Rules not processed for user `49a6ee24453f4c8bb3a1119f39af6a72`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:13:40.783239 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-411c3ff9-f598-4581-8b6f-04c696bdc427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:13:40.836829 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1047/2096] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:13:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:13:45.859388 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=35 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:13:50.830336 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=31 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:13:57.066984 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a013cfcc-c2c6-476e-8a19-e13454438517 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:13:57.067518 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a013cfcc-c2c6-476e-8a19-e13454438517 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:13:57.067518 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a013cfcc-c2c6-476e-8a19-e13454438517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:13:57.086856 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-a013cfcc-c2c6-476e-8a19-e13454438517 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:13:57.088069 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-a013cfcc-c2c6-476e-8a19-e13454438517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:13:57.095896 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1050/2097] 10.222.0.30 () {58 vars in 1016 bytes} [Thu Oct 13 11:13:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:13:57.117743 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411c3ff9-f598-4581-8b6f-04c696bdc427 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:13:57.131043 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411c3ff9-f598-4581-8b6f-04c696bdc427 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:13:57.136575 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b913cc11-aa66-47da-8514-bfecb3d31aa5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78384fbffdd346578855e7214b335d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:13:57.137118 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b913cc11-aa66-47da-8514-bfecb3d31aa5 service nova] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:13:57.137396 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b913cc11-aa66-47da-8514-bfecb3d31aa5 service nova] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:13:57.137668 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b913cc11-aa66-47da-8514-bfecb3d31aa5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:13:57.145902 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b913cc11-aa66-47da-8514-bfecb3d31aa5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:13:57.147506 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b913cc11-aa66-47da-8514-bfecb3d31aa5 service nova] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:13:57.156851 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1048/2098] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:13:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:14:00.342565 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67525669-e3fb-417a-a344-1a5e0023250d None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:14:00.343091 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67525669-e3fb-417a-a344-1a5e0023250d None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:14:00.343091 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67525669-e3fb-417a-a344-1a5e0023250d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:14:00.362684 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-67525669-e3fb-417a-a344-1a5e0023250d None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:14:00.363901 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-67525669-e3fb-417a-a344-1a5e0023250d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:14:00.371640 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1051/2099] 10.222.0.30 () {58 vars in 1016 bytes} [Thu Oct 13 11:14:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:14:00.393228 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b913cc11-aa66-47da-8514-bfecb3d31aa5 service nova] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:14:00.404762 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b913cc11-aa66-47da-8514-bfecb3d31aa5 service nova] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:14:00.410861 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f552d-a3ba-4582-b401-16c8d26259ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78384fbffdd346578855e7214b335d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:14:00.411448 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f552d-a3ba-4582-b401-16c8d26259ab service nova] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:14:00.411730 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f552d-a3ba-4582-b401-16c8d26259ab service nova] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:14:00.412002 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f552d-a3ba-4582-b401-16c8d26259ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:14:00.419960 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9f552d-a3ba-4582-b401-16c8d26259ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:14:00.421522 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9f552d-a3ba-4582-b401-16c8d26259ab service nova] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:14:00.430851 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1049/2100] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:14:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:14:03.468034 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a35b3-7b45-47c6-a0b2-53e6b087ed3a None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:14:03.468496 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a35b3-7b45-47c6-a0b2-53e6b087ed3a None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:14:03.468707 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a35b3-7b45-47c6-a0b2-53e6b087ed3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:14:03.488736 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-702a35b3-7b45-47c6-a0b2-53e6b087ed3a None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:14:03.489978 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-702a35b3-7b45-47c6-a0b2-53e6b087ed3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:14:03.497751 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1052/2101] 10.222.0.30 () {58 vars in 1016 bytes} [Thu Oct 13 11:14:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:14:03.520366 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f552d-a3ba-4582-b401-16c8d26259ab service nova] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:14:03.531355 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f552d-a3ba-4582-b401-16c8d26259ab service nova] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:14:03.537450 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9103927d-f76a-4ff3-ab98-a401cadb7574 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78384fbffdd346578855e7214b335d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:14:03.538095 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103927d-f76a-4ff3-ab98-a401cadb7574 service nova] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:14:03.538397 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103927d-f76a-4ff3-ab98-a401cadb7574 service nova] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:14:03.538664 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103927d-f76a-4ff3-ab98-a401cadb7574 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:14:03.547065 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9103927d-f76a-4ff3-ab98-a401cadb7574 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:14:03.548573 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9103927d-f76a-4ff3-ab98-a401cadb7574 service nova] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:14:03.558340 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1050/2102] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:14:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:14:06.617306 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126c7868-d63e-49b7-b622-177b50398209 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:14:06.617815 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126c7868-d63e-49b7-b622-177b50398209 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:14:06.617929 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126c7868-d63e-49b7-b622-177b50398209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:14:06.637064 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-126c7868-d63e-49b7-b622-177b50398209 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:14:06.638306 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-126c7868-d63e-49b7-b622-177b50398209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:14:06.646081 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1053/2103] 10.222.0.30 () {58 vars in 1016 bytes} [Thu Oct 13 11:14:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:14:06.667777 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9103927d-f76a-4ff3-ab98-a401cadb7574 service nova] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:14:06.678830 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9103927d-f76a-4ff3-ab98-a401cadb7574 service nova] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:14:06.684260 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6474cc6-4709-40cf-b1ed-db6ec5c0d13d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78384fbffdd346578855e7214b335d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:14:06.684850 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6474cc6-4709-40cf-b1ed-db6ec5c0d13d service nova] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:14:06.685131 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6474cc6-4709-40cf-b1ed-db6ec5c0d13d service nova] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:14:06.685402 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6474cc6-4709-40cf-b1ed-db6ec5c0d13d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:14:06.694223 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6474cc6-4709-40cf-b1ed-db6ec5c0d13d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:14:06.695809 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6474cc6-4709-40cf-b1ed-db6ec5c0d13d service nova] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:14:06.705219 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1051/2104] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:14:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:14:09.759490 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4b2606-851c-4df6-9568-d188ad55e5e1 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:14:09.759980 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4b2606-851c-4df6-9568-d188ad55e5e1 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:14:09.759980 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4b2606-851c-4df6-9568-d188ad55e5e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:14:09.779561 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-0f4b2606-851c-4df6-9568-d188ad55e5e1 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:14:09.780745 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-0f4b2606-851c-4df6-9568-d188ad55e5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:14:09.788371 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1054/2105] 10.222.0.30 () {58 vars in 1016 bytes} [Thu Oct 13 11:14:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:14:09.810430 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6474cc6-4709-40cf-b1ed-db6ec5c0d13d service nova] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:14:09.822129 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6474cc6-4709-40cf-b1ed-db6ec5c0d13d service nova] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:14:09.827482 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04143fa5-c1d9-411a-8143-ab0bddf16162 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78384fbffdd346578855e7214b335d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:14:09.828099 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04143fa5-c1d9-411a-8143-ab0bddf16162 service nova] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:14:09.828397 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04143fa5-c1d9-411a-8143-ab0bddf16162 service nova] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:14:09.828652 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04143fa5-c1d9-411a-8143-ab0bddf16162 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:14:09.837134 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04143fa5-c1d9-411a-8143-ab0bddf16162 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:14:09.838719 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04143fa5-c1d9-411a-8143-ab0bddf16162 service nova] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:14:09.847935 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1052/2106] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:14:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:14:15.742140 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b61b5-f0cf-4ff3-8e7c-54569bea3ea2 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:14:15.742681 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b61b5-f0cf-4ff3-8e7c-54569bea3ea2 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:14:15.742681 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b61b5-f0cf-4ff3-8e7c-54569bea3ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:14:15.762451 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-b94b61b5-f0cf-4ff3-8e7c-54569bea3ea2 None None] MFA Rules not processed for user `1674289511b749d4b23c4441714e437d`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:14:15.763648 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-b94b61b5-f0cf-4ff3-8e7c-54569bea3ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:14:15.770469 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1055/2107] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:14:15 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:14:19.843718 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=30 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:14:25.757085 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=18 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:14:34.288497 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f60ac-80fc-42c5-86ed-f75daec25658 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:14:34.289110 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f60ac-80fc-42c5-86ed-f75daec25658 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:14:34.289110 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f60ac-80fc-42c5-86ed-f75daec25658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:14:34.308680 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-b05f60ac-80fc-42c5-86ed-f75daec25658 None None] MFA Rules not processed for user `3b8d890413d4480d96ce9c9be80076d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:14:34.310007 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-b05f60ac-80fc-42c5-86ed-f75daec25658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:14:34.370091 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1053/2108] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:14:34 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:14:43.664732 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94b61b5-f0cf-4ff3-8e7c-54569bea3ea2 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:14:43.666753 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-b94b61b5-f0cf-4ff3-8e7c-54569bea3ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:14:43.682199 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94b61b5-f0cf-4ff3-8e7c-54569bea3ea2 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:14:43.686690 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b763b2a7-1589-4fb1-831b-7fb872a6ef70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:14:43.687319 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b763b2a7-1589-4fb1-831b-7fb872a6ef70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:14:43.687743 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b763b2a7-1589-4fb1-831b-7fb872a6ef70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:14:43.687933 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b763b2a7-1589-4fb1-831b-7fb872a6ef70 admin admin] PATH_INFO: `/v3/users/49a6ee24453f4c8bb3a1119f39af6a72` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:14:43.689036 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b763b2a7-1589-4fb1-831b-7fb872a6ef70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49a6ee24453f4c8bb3a1119f39af6a72)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:14:43.690977 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b763b2a7-1589-4fb1-831b-7fb872a6ef70 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:14:43.739809 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-b763b2a7-1589-4fb1-831b-7fb872a6ef70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49a6ee24453f4c8bb3a1119f39af6a72'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:14:43.740455 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-b763b2a7-1589-4fb1-831b-7fb872a6ef70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49a6ee24453f4c8bb3a1119f39af6a72'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:14:43.741636 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-b763b2a7-1589-4fb1-831b-7fb872a6ef70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49a6ee24453f4c8bb3a1119f39af6a72'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:14:43.753549 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-b763b2a7-1589-4fb1-831b-7fb872a6ef70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49a6ee24453f4c8bb3a1119f39af6a72'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:14:43.760754 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-b763b2a7-1589-4fb1-831b-7fb872a6ef70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49a6ee24453f4c8bb3a1119f39af6a72'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:14:43.773352 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1056/2109] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:14:43 2022] DELETE /identity/v3/users/49a6ee24453f4c8bb3a1119f39af6a72 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:14:43.939815 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f60ac-80fc-42c5-86ed-f75daec25658 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:14:43.953780 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f60ac-80fc-42c5-86ed-f75daec25658 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:14:44.010934 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399a8f65-c8ef-4de0-b4af-de75aee4e190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:14:44.011665 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a8f65-c8ef-4de0-b4af-de75aee4e190 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:14:44.011950 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a8f65-c8ef-4de0-b4af-de75aee4e190 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:14:44.012226 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a8f65-c8ef-4de0-b4af-de75aee4e190 admin admin] PATH_INFO: `/v3/projects/fd1aee336bce4536998cfe70b8877562` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:14:44.013356 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399a8f65-c8ef-4de0-b4af-de75aee4e190 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd1aee336bce4536998cfe70b8877562)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:14:44.015286 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399a8f65-c8ef-4de0-b4af-de75aee4e190 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:14:44.060797 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-399a8f65-c8ef-4de0-b4af-de75aee4e190 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd1aee336bce4536998cfe70b8877562', 'request_id': 'req-399a8f65-c8ef-4de0-b4af-de75aee4e190'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:14:44.066906 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-399a8f65-c8ef-4de0-b4af-de75aee4e190 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd1aee336bce4536998cfe70b8877562', 'request_id': 'req-399a8f65-c8ef-4de0-b4af-de75aee4e190'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:14:44.072337 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-399a8f65-c8ef-4de0-b4af-de75aee4e190 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd1aee336bce4536998cfe70b8877562', 'request_id': 'req-399a8f65-c8ef-4de0-b4af-de75aee4e190'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:14:44.084263 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-399a8f65-c8ef-4de0-b4af-de75aee4e190 admin admin] The token cache is being invalidate because project fd1aee336bce4536998cfe70b8877562 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:14:44.085040 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-399a8f65-c8ef-4de0-b4af-de75aee4e190 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:14:44.085650 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-399a8f65-c8ef-4de0-b4af-de75aee4e190 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:14:44.087119 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1054/2110] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:14:43 2022] DELETE /identity/v3/projects/fd1aee336bce4536998cfe70b8877562 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:14:53.769373 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:14:54.081390 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=76,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:14:57.155206 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e1eb0a-17c1-419a-91dc-abbb4470a1ca None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:14:57.155665 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e1eb0a-17c1-419a-91dc-abbb4470a1ca None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:14:57.155778 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e1eb0a-17c1-419a-91dc-abbb4470a1ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:14:57.175532 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-a9e1eb0a-17c1-419a-91dc-abbb4470a1ca None None] MFA Rules not processed for user `6e803a9cc6114c4f93869e50bca313e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:14:57.176720 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-a9e1eb0a-17c1-419a-91dc-abbb4470a1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:14:57.232194 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1057/2111] 10.222.0.25 () {58 vars in 967 bytes} [Thu Oct 13 11:14:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:14:57.278960 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399a8f65-c8ef-4de0-b4af-de75aee4e190 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:14:57.280383 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-399a8f65-c8ef-4de0-b4af-de75aee4e190 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:14:57.349174 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399a8f65-c8ef-4de0-b4af-de75aee4e190 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:14:57.354768 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb7e5b3-a69c-446c-85d3-641daf956df2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e24c779d0a604ef28dfc1235ee76a711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:14:57.355359 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb7e5b3-a69c-446c-85d3-641daf956df2 service swift] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:14:57.355633 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb7e5b3-a69c-446c-85d3-641daf956df2 service swift] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:14:57.355902 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb7e5b3-a69c-446c-85d3-641daf956df2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:14:57.363638 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb7e5b3-a69c-446c-85d3-641daf956df2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:14:57.365193 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb7e5b3-a69c-446c-85d3-641daf956df2 service swift] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:14:57.372955 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1055/2112] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Oct 13 11:14:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 13 11:15:03.959805 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e1eb0a-17c1-419a-91dc-abbb4470a1ca None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:15:03.961258 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-a9e1eb0a-17c1-419a-91dc-abbb4470a1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:15:04.027963 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e1eb0a-17c1-419a-91dc-abbb4470a1ca None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:15:04.032477 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3899b52-aebc-4953-a524-c986180246c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:15:04.033128 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3899b52-aebc-4953-a524-c986180246c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:15:04.033409 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3899b52-aebc-4953-a524-c986180246c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:15:04.033685 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3899b52-aebc-4953-a524-c986180246c4 admin admin] PATH_INFO: `/v3/users/a73024b071b14177b20736c015420f8a` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:15:04.034871 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3899b52-aebc-4953-a524-c986180246c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a73024b071b14177b20736c015420f8a)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:15:04.036798 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3899b52-aebc-4953-a524-c986180246c4 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:15:04.082583 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-e3899b52-aebc-4953-a524-c986180246c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a73024b071b14177b20736c015420f8a'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:15:04.083153 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-e3899b52-aebc-4953-a524-c986180246c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a73024b071b14177b20736c015420f8a'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:15:04.083748 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-e3899b52-aebc-4953-a524-c986180246c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a73024b071b14177b20736c015420f8a'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:15:04.095844 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-e3899b52-aebc-4953-a524-c986180246c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a73024b071b14177b20736c015420f8a'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:15:04.103295 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-e3899b52-aebc-4953-a524-c986180246c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a73024b071b14177b20736c015420f8a'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:15:04.115074 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1058/2113] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:15:03 2022] DELETE /identity/v3/users/a73024b071b14177b20736c015420f8a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:15:04.282542 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb7e5b3-a69c-446c-85d3-641daf956df2 service swift] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:15:04.293629 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb7e5b3-a69c-446c-85d3-641daf956df2 service swift] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:15:04.350619 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427eac97-39aa-4990-9ceb-3f072c3a83b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:15:04.351224 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427eac97-39aa-4990-9ceb-3f072c3a83b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:15:04.351478 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427eac97-39aa-4990-9ceb-3f072c3a83b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:15:04.351779 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427eac97-39aa-4990-9ceb-3f072c3a83b4 admin admin] PATH_INFO: `/v3/projects/bc09697c48894e9580f70f09b829a593` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:15:04.353080 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427eac97-39aa-4990-9ceb-3f072c3a83b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc09697c48894e9580f70f09b829a593)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:15:04.355066 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427eac97-39aa-4990-9ceb-3f072c3a83b4 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:15:04.398898 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-427eac97-39aa-4990-9ceb-3f072c3a83b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc09697c48894e9580f70f09b829a593', 'request_id': 'req-427eac97-39aa-4990-9ceb-3f072c3a83b4'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:15:04.405476 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-427eac97-39aa-4990-9ceb-3f072c3a83b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc09697c48894e9580f70f09b829a593', 'request_id': 'req-427eac97-39aa-4990-9ceb-3f072c3a83b4'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:15:04.410944 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-427eac97-39aa-4990-9ceb-3f072c3a83b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc09697c48894e9580f70f09b829a593', 'request_id': 'req-427eac97-39aa-4990-9ceb-3f072c3a83b4'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:15:04.422941 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-427eac97-39aa-4990-9ceb-3f072c3a83b4 admin admin] The token cache is being invalidate because project bc09697c48894e9580f70f09b829a593 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:15:04.423220 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-427eac97-39aa-4990-9ceb-3f072c3a83b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:15:04.423823 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-427eac97-39aa-4990-9ceb-3f072c3a83b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:15:04.425253 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1056/2114] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:15:04 2022] DELETE /identity/v3/projects/bc09697c48894e9580f70f09b829a593 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:15:04.429598 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3899b52-aebc-4953-a524-c986180246c4 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:15:04.431013 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-e3899b52-aebc-4953-a524-c986180246c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:15:04.443583 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3899b52-aebc-4953-a524-c986180246c4 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:15:04.463912 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:15:04.500697 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447b29d4-364a-498a-9d91-11aca5d22d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:15:04.501310 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b29d4-364a-498a-9d91-11aca5d22d92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:15:04.501585 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b29d4-364a-498a-9d91-11aca5d22d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:15:04.501854 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b29d4-364a-498a-9d91-11aca5d22d92 admin admin] PATH_INFO: `/v3/users/87481f225ead4faea8fdb667b3f3a1e3` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:15:04.502991 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447b29d4-364a-498a-9d91-11aca5d22d92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87481f225ead4faea8fdb667b3f3a1e3)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:15:04.505173 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447b29d4-364a-498a-9d91-11aca5d22d92 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:15:04.551004 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-447b29d4-364a-498a-9d91-11aca5d22d92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87481f225ead4faea8fdb667b3f3a1e3'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:15:04.551688 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-447b29d4-364a-498a-9d91-11aca5d22d92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87481f225ead4faea8fdb667b3f3a1e3'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:15:04.552591 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-447b29d4-364a-498a-9d91-11aca5d22d92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87481f225ead4faea8fdb667b3f3a1e3'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:15:04.564365 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-447b29d4-364a-498a-9d91-11aca5d22d92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87481f225ead4faea8fdb667b3f3a1e3'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:15:04.573811 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-447b29d4-364a-498a-9d91-11aca5d22d92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87481f225ead4faea8fdb667b3f3a1e3'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:15:04.585906 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1059/2115] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:15:04 2022] DELETE /identity/v3/users/87481f225ead4faea8fdb667b3f3a1e3 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:15:04.754359 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427eac97-39aa-4990-9ceb-3f072c3a83b4 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:15:04.755836 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-427eac97-39aa-4990-9ceb-3f072c3a83b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:15:04.769431 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427eac97-39aa-4990-9ceb-3f072c3a83b4 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:15:04.786641 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:15:04.828051 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2acdb1-c666-4893-970c-1dfb43888ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:15:04.828662 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2acdb1-c666-4893-970c-1dfb43888ff5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:15:04.828944 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2acdb1-c666-4893-970c-1dfb43888ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:15:04.829220 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2acdb1-c666-4893-970c-1dfb43888ff5 admin admin] PATH_INFO: `/v3/projects/86404db92d004e1fbef4e6c65fd72cb9` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:15:04.830368 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2acdb1-c666-4893-970c-1dfb43888ff5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86404db92d004e1fbef4e6c65fd72cb9)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:15:04.832260 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2acdb1-c666-4893-970c-1dfb43888ff5 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:15:04.885998 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-8e2acdb1-c666-4893-970c-1dfb43888ff5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86404db92d004e1fbef4e6c65fd72cb9', 'request_id': 'req-8e2acdb1-c666-4893-970c-1dfb43888ff5'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:15:04.893523 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-8e2acdb1-c666-4893-970c-1dfb43888ff5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86404db92d004e1fbef4e6c65fd72cb9', 'request_id': 'req-8e2acdb1-c666-4893-970c-1dfb43888ff5'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:15:04.899049 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-8e2acdb1-c666-4893-970c-1dfb43888ff5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86404db92d004e1fbef4e6c65fd72cb9', 'request_id': 'req-8e2acdb1-c666-4893-970c-1dfb43888ff5'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:15:04.911368 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-8e2acdb1-c666-4893-970c-1dfb43888ff5 admin admin] The token cache is being invalidate because project 86404db92d004e1fbef4e6c65fd72cb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:15:04.911652 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-8e2acdb1-c666-4893-970c-1dfb43888ff5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:15:04.912262 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-8e2acdb1-c666-4893-970c-1dfb43888ff5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:15:04.913731 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1057/2116] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:15:04 2022] DELETE /identity/v3/projects/86404db92d004e1fbef4e6c65fd72cb9 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:15:14.582467 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=42,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:15:14.908407 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:15:15.731753 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447b29d4-364a-498a-9d91-11aca5d22d92 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:15:15.733301 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-447b29d4-364a-498a-9d91-11aca5d22d92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:15:15.790878 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447b29d4-364a-498a-9d91-11aca5d22d92 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:15:15.840675 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfccddef-8642-4eef-8bff-61d7c10c491d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:15:15.841308 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfccddef-8642-4eef-8bff-61d7c10c491d service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:15:15.841584 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfccddef-8642-4eef-8bff-61d7c10c491d service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:15:15.841857 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfccddef-8642-4eef-8bff-61d7c10c491d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:15:15.843622 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-cfccddef-8642-4eef-8bff-61d7c10c491d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:15:15.912929 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfccddef-8642-4eef-8bff-61d7c10c491d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:15:15.914400 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfccddef-8642-4eef-8bff-61d7c10c491d service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:15:15.925108 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1060/2117] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:15:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:15:17.102095 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2acdb1-c666-4893-970c-1dfb43888ff5 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:15:17.103616 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-8e2acdb1-c666-4893-970c-1dfb43888ff5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:15:17.116273 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2acdb1-c666-4893-970c-1dfb43888ff5 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:15:17.119863 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b4cf37-3f78-4cd0-b4ee-dcb34921d18d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:15:17.120461 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4cf37-3f78-4cd0-b4ee-dcb34921d18d service neutron] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:15:17.120741 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4cf37-3f78-4cd0-b4ee-dcb34921d18d service neutron] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:15:17.121015 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4cf37-3f78-4cd0-b4ee-dcb34921d18d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:15:17.122786 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-62b4cf37-3f78-4cd0-b4ee-dcb34921d18d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:15:17.136974 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b4cf37-3f78-4cd0-b4ee-dcb34921d18d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:15:17.138375 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b4cf37-3f78-4cd0-b4ee-dcb34921d18d service neutron] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:15:17.150492 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1058/2118] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:15:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:15:23.630311 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139768dc-36ed-4f11-8cf9-133ca165973e None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:15:23.630788 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139768dc-36ed-4f11-8cf9-133ca165973e None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:15:23.630881 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139768dc-36ed-4f11-8cf9-133ca165973e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:15:23.649519 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-139768dc-36ed-4f11-8cf9-133ca165973e None None] MFA Rules not processed for user `d58260446c094b589b6500195c29f05f`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:15:23.651230 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-139768dc-36ed-4f11-8cf9-133ca165973e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:15:23.703718 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1061/2119] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:15:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:15:27.145116 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=6 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:15:28.693189 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b4cf37-3f78-4cd0-b4ee-dcb34921d18d service neutron] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:15:28.702161 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b4cf37-3f78-4cd0-b4ee-dcb34921d18d service neutron] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:15:28.706078 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327f370f-0435-46f2-860e-a6014bcda1cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:15:28.706693 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f370f-0435-46f2-860e-a6014bcda1cf service neutron] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:15:28.706968 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f370f-0435-46f2-860e-a6014bcda1cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:15:28.707238 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f370f-0435-46f2-860e-a6014bcda1cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:15:28.708973 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-327f370f-0435-46f2-860e-a6014bcda1cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:15:28.781481 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327f370f-0435-46f2-860e-a6014bcda1cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:15:28.783229 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327f370f-0435-46f2-860e-a6014bcda1cf service neutron] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:15:28.796730 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1059/2120] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:15:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:15:32.069555 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139768dc-36ed-4f11-8cf9-133ca165973e None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:15:32.075455 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:15:32.082507 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139768dc-36ed-4f11-8cf9-133ca165973e None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:15:32.086343 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16baf3c-4c42-42ae-baa0-2907d9d3fd0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:15:32.087501 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16baf3c-4c42-42ae-baa0-2907d9d3fd0b service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:15:32.087782 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16baf3c-4c42-42ae-baa0-2907d9d3fd0b service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:15:32.088054 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16baf3c-4c42-42ae-baa0-2907d9d3fd0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:15:32.089897 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-e16baf3c-4c42-42ae-baa0-2907d9d3fd0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:15:32.101003 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16baf3c-4c42-42ae-baa0-2907d9d3fd0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:15:32.103312 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16baf3c-4c42-42ae-baa0-2907d9d3fd0b service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:15:32.116204 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1062/2121] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:15:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:15:32.436771 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327f370f-0435-46f2-860e-a6014bcda1cf service neutron] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:15:32.439898 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-327f370f-0435-46f2-860e-a6014bcda1cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:15:32.545354 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327f370f-0435-46f2-860e-a6014bcda1cf service neutron] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:15:32.556801 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f522bffd-be3b-4c0b-94f5-7653e817a82b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '399f7d3700a24cb486e56b409a6e5429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:15:32.557676 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522bffd-be3b-4c0b-94f5-7653e817a82b service glance] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:15:32.558203 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522bffd-be3b-4c0b-94f5-7653e817a82b service glance] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:15:32.558853 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522bffd-be3b-4c0b-94f5-7653e817a82b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:15:32.562888 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-f522bffd-be3b-4c0b-94f5-7653e817a82b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:15:32.592901 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16baf3c-4c42-42ae-baa0-2907d9d3fd0b service neutron] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:15:32.594306 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-e16baf3c-4c42-42ae-baa0-2907d9d3fd0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:15:32.655768 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f522bffd-be3b-4c0b-94f5-7653e817a82b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:15:32.657920 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f522bffd-be3b-4c0b-94f5-7653e817a82b service glance] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:15:32.669482 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1060/2122] 10.222.0.25 () {60 vars in 1396 bytes} [Thu Oct 13 11:15:32 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3266 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:15:32.677230 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16baf3c-4c42-42ae-baa0-2907d9d3fd0b service neutron] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:15:32.686874 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745b0d32-4759-4c50-8e38-fb709d265e9c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed4bb75e68a640fc92ddd47fad61a25a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:15:32.687676 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b0d32-4759-4c50-8e38-fb709d265e9c service placement] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:15:32.688138 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b0d32-4759-4c50-8e38-fb709d265e9c service placement] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:15:32.688423 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b0d32-4759-4c50-8e38-fb709d265e9c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:15:32.690268 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-745b0d32-4759-4c50-8e38-fb709d265e9c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:15:32.703188 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745b0d32-4759-4c50-8e38-fb709d265e9c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:15:32.704761 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745b0d32-4759-4c50-8e38-fb709d265e9c service placement] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:15:32.720149 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1063/2123] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:15:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 13 11:15:32.899543 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f522bffd-be3b-4c0b-94f5-7653e817a82b service glance] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:15:32.901340 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-f522bffd-be3b-4c0b-94f5-7653e817a82b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:15:32.918341 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f522bffd-be3b-4c0b-94f5-7653e817a82b service glance] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:15:32.924361 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39278f1-d889-4ce3-aff5-5ed27d5e803d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:15:32.925437 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39278f1-d889-4ce3-aff5-5ed27d5e803d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:15:32.925762 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39278f1-d889-4ce3-aff5-5ed27d5e803d admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:15:32.926063 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39278f1-d889-4ce3-aff5-5ed27d5e803d admin admin] PATH_INFO: `/v3/users/1674289511b749d4b23c4441714e437d` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:15:32.927227 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39278f1-d889-4ce3-aff5-5ed27d5e803d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1674289511b749d4b23c4441714e437d)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:15:32.929569 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39278f1-d889-4ce3-aff5-5ed27d5e803d admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:15:33.006635 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:15:33.010944 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-a39278f1-d889-4ce3-aff5-5ed27d5e803d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1674289511b749d4b23c4441714e437d'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:15:33.020265 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-a39278f1-d889-4ce3-aff5-5ed27d5e803d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1674289511b749d4b23c4441714e437d'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:15:33.020916 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-a39278f1-d889-4ce3-aff5-5ed27d5e803d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1674289511b749d4b23c4441714e437d'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:15:33.021693 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-a39278f1-d889-4ce3-aff5-5ed27d5e803d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1674289511b749d4b23c4441714e437d'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:15:33.035219 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-a39278f1-d889-4ce3-aff5-5ed27d5e803d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1674289511b749d4b23c4441714e437d'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:15:33.053064 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1061/2124] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:15:32 2022] DELETE /identity/v3/users/1674289511b749d4b23c4441714e437d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:15:33.235407 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745b0d32-4759-4c50-8e38-fb709d265e9c service placement] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:15:33.252465 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745b0d32-4759-4c50-8e38-fb709d265e9c service placement] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:15:33.318239 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e3dea2-cf8c-4988-b582-57e9a047c692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:15:33.318874 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e3dea2-cf8c-4988-b582-57e9a047c692 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:15:33.319149 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e3dea2-cf8c-4988-b582-57e9a047c692 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:15:33.319419 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e3dea2-cf8c-4988-b582-57e9a047c692 admin admin] PATH_INFO: `/v3/projects/36c3373824594845825502222de2f336` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:15:33.320584 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e3dea2-cf8c-4988-b582-57e9a047c692 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36c3373824594845825502222de2f336)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:15:33.323164 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e3dea2-cf8c-4988-b582-57e9a047c692 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:15:33.371017 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-e5e3dea2-cf8c-4988-b582-57e9a047c692 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36c3373824594845825502222de2f336', 'request_id': 'req-e5e3dea2-cf8c-4988-b582-57e9a047c692'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:15:33.379186 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-e5e3dea2-cf8c-4988-b582-57e9a047c692 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36c3373824594845825502222de2f336', 'request_id': 'req-e5e3dea2-cf8c-4988-b582-57e9a047c692'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:15:33.386714 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-e5e3dea2-cf8c-4988-b582-57e9a047c692 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36c3373824594845825502222de2f336', 'request_id': 'req-e5e3dea2-cf8c-4988-b582-57e9a047c692'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:15:33.398843 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-e5e3dea2-cf8c-4988-b582-57e9a047c692 admin admin] The token cache is being invalidate because project 36c3373824594845825502222de2f336 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:15:33.399139 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-e5e3dea2-cf8c-4988-b582-57e9a047c692 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:15:33.399826 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-e5e3dea2-cf8c-4988-b582-57e9a047c692 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:15:33.401320 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1064/2125] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:15:33 2022] DELETE /identity/v3/projects/36c3373824594845825502222de2f336 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:15:33.406434 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c3daa-f563-4294-8fbc-dce9dd99144c None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:15:33.406937 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c3daa-f563-4294-8fbc-dce9dd99144c None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:15:33.408253 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c3daa-f563-4294-8fbc-dce9dd99144c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:15:33.429085 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-1e8c3daa-f563-4294-8fbc-dce9dd99144c None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:15:33.430479 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-1e8c3daa-f563-4294-8fbc-dce9dd99144c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:15:33.491005 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1062/2126] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:15:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:15:33.499244 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd5214d-e0e0-4e4e-b92a-edb2a62ac40d None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:15:33.499542 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd5214d-e0e0-4e4e-b92a-edb2a62ac40d None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:15:33.499822 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd5214d-e0e0-4e4e-b92a-edb2a62ac40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:15:33.527475 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-acd5214d-e0e0-4e4e-b92a-edb2a62ac40d None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:15:33.529030 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-acd5214d-e0e0-4e4e-b92a-edb2a62ac40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:15:33.539943 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1065/2127] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:15:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:15:33.544401 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8c3daa-f563-4294-8fbc-dce9dd99144c None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:15:33.554243 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8c3daa-f563-4294-8fbc-dce9dd99144c None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:15:33.559392 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5198f86a-e395-4226-930a-b52725b688d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:15:33.559982 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5198f86a-e395-4226-930a-b52725b688d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:15:33.560258 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5198f86a-e395-4226-930a-b52725b688d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:15:33.560555 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5198f86a-e395-4226-930a-b52725b688d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:15:33.561196 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5198f86a-e395-4226-930a-b52725b688d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:15:33.561497 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5198f86a-e395-4226-930a-b52725b688d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:15:33.563097 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5198f86a-e395-4226-930a-b52725b688d4 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:15:33.574506 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1063/2128] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 11:15:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:15:33.579495 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd5214d-e0e0-4e4e-b92a-edb2a62ac40d None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:15:33.584212 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:15:33.590741 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd5214d-e0e0-4e4e-b92a-edb2a62ac40d None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:15:33.600887 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5345e994-b355-4dd7-b603-63c323d84ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:15:33.601855 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5345e994-b355-4dd7-b603-63c323d84ab2 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:15:33.602321 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5345e994-b355-4dd7-b603-63c323d84ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:15:33.603564 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5345e994-b355-4dd7-b603-63c323d84ab2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:15:33.604360 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5345e994-b355-4dd7-b603-63c323d84ab2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:15:33.607934 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5345e994-b355-4dd7-b603-63c323d84ab2 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:15:33.642142 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1066/2129] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:15:33 2022] POST /identity/v3/projects => generated 385 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:15:33.646113 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5198f86a-e395-4226-930a-b52725b688d4 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:15:33.658624 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5198f86a-e395-4226-930a-b52725b688d4 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:15:33.725780 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27670dbc-bdb7-40a4-ac30-09db47dfa9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:15:33.726422 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27670dbc-bdb7-40a4-ac30-09db47dfa9ea admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:15:33.726697 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27670dbc-bdb7-40a4-ac30-09db47dfa9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:15:33.727324 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27670dbc-bdb7-40a4-ac30-09db47dfa9ea admin admin] PATH_INFO: `/v3/users` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:15:33.728133 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27670dbc-bdb7-40a4-ac30-09db47dfa9ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:15:33.730080 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27670dbc-bdb7-40a4-ac30-09db47dfa9ea admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:15:33.757969 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1064/2130] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:15:33 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 11:15:33.759548 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5345e994-b355-4dd7-b603-63c323d84ab2 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:15:33.770034 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5345e994-b355-4dd7-b603-63c323d84ab2 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:15:33.775721 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee94c81-baa0-4822-9abd-17942208f17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:15:33.776373 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee94c81-baa0-4822-9abd-17942208f17a admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:15:33.776599 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee94c81-baa0-4822-9abd-17942208f17a admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:15:33.776875 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee94c81-baa0-4822-9abd-17942208f17a admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:15:33.777606 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee94c81-baa0-4822-9abd-17942208f17a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:15:33.779164 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee94c81-baa0-4822-9abd-17942208f17a admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:15:33.789896 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1067/2131] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:15:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:15:33.794655 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27670dbc-bdb7-40a4-ac30-09db47dfa9ea admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:15:33.806934 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27670dbc-bdb7-40a4-ac30-09db47dfa9ea admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:15:33.812653 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049efcb6-220a-43c6-94d7-0a3cc86a6587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:15:33.813459 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049efcb6-220a-43c6-94d7-0a3cc86a6587 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:15:33.813802 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049efcb6-220a-43c6-94d7-0a3cc86a6587 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:15:33.814184 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049efcb6-220a-43c6-94d7-0a3cc86a6587 admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:15:33.814842 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049efcb6-220a-43c6-94d7-0a3cc86a6587 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:15:33.816744 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049efcb6-220a-43c6-94d7-0a3cc86a6587 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:15:33.827420 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1065/2132] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:15:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 13 11:15:33.831792 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee94c81-baa0-4822-9abd-17942208f17a admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:15:33.841897 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee94c81-baa0-4822-9abd-17942208f17a admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:15:33.847190 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd4fcc8-9b0b-4010-9b78-5e1f53e763e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:15:33.847842 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd4fcc8-9b0b-4010-9b78-5e1f53e763e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:15:33.848115 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd4fcc8-9b0b-4010-9b78-5e1f53e763e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:15:33.848382 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd4fcc8-9b0b-4010-9b78-5e1f53e763e4 admin admin] PATH_INFO: `/v3/projects/8c0dd87e330d471caa030ee7381c2904/users/dd538e9a9b08439a84ae6e3a2c78d862/roles/7c3871c0ab68438b9014489d50b53a22` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:15:33.865191 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd4fcc8-9b0b-4010-9b78-5e1f53e763e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c0dd87e330d471caa030ee7381c2904, user_id=dd538e9a9b08439a84ae6e3a2c78d862, role_id=7c3871c0ab68438b9014489d50b53a22)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:15:33.868788 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd4fcc8-9b0b-4010-9b78-5e1f53e763e4 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:15:33.885420 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1068/2133] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:15:33 2022] PUT /identity/v3/projects/8c0dd87e330d471caa030ee7381c2904/users/dd538e9a9b08439a84ae6e3a2c78d862/roles/7c3871c0ab68438b9014489d50b53a22 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 11:15:33.891044 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a3633-2a90-47a2-9f01-2240ddbc4bcc None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:15:33.891332 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a3633-2a90-47a2-9f01-2240ddbc4bcc None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:15:33.891610 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a3633-2a90-47a2-9f01-2240ddbc4bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:15:33.917253 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-799a3633-2a90-47a2-9f01-2240ddbc4bcc None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:15:33.918497 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-799a3633-2a90-47a2-9f01-2240ddbc4bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:15:33.940289 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:15:33.986814 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1066/2134] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:15:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:15:33.997123 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd4fcc8-9b0b-4010-9b78-5e1f53e763e4 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:15:33.998861 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-3bd4fcc8-9b0b-4010-9b78-5e1f53e763e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:15:34.072875 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd4fcc8-9b0b-4010-9b78-5e1f53e763e4 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:15:34.076550 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb024d6e-67e7-457c-8970-6a8e469dc751 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:15:34.077150 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb024d6e-67e7-457c-8970-6a8e469dc751 service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:15:34.078042 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb024d6e-67e7-457c-8970-6a8e469dc751 service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:15:34.078323 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb024d6e-67e7-457c-8970-6a8e469dc751 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:15:34.087898 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb024d6e-67e7-457c-8970-6a8e469dc751 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:15:34.089314 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb024d6e-67e7-457c-8970-6a8e469dc751 service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:15:34.099124 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1069/2135] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:15:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:15:36.335010 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799a3633-2a90-47a2-9f01-2240ddbc4bcc None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:15:36.350062 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799a3633-2a90-47a2-9f01-2240ddbc4bcc None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:15:36.360958 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f377f-1b55-4e12-b49a-afaa75ba33c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:15:36.361771 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f377f-1b55-4e12-b49a-afaa75ba33c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:15:36.362199 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f377f-1b55-4e12-b49a-afaa75ba33c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:15:36.362572 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f377f-1b55-4e12-b49a-afaa75ba33c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:15:36.365117 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-a99f377f-1b55-4e12-b49a-afaa75ba33c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:15:36.395055 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99f377f-1b55-4e12-b49a-afaa75ba33c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:15:36.398034 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99f377f-1b55-4e12-b49a-afaa75ba33c0 service neutron] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:15:36.410709 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1067/2136] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:15:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:15:38.803628 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea036315-2b43-49a7-ab60-f0e280ebd679 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:15:38.804160 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea036315-2b43-49a7-ab60-f0e280ebd679 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:15:38.804381 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea036315-2b43-49a7-ab60-f0e280ebd679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:15:38.846952 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-ea036315-2b43-49a7-ab60-f0e280ebd679 None None] MFA Rules not processed for user `dd538e9a9b08439a84ae6e3a2c78d862`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:15:38.848376 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-ea036315-2b43-49a7-ab60-f0e280ebd679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:15:38.964525 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1070/2137] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:15:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:15:39.048957 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f377f-1b55-4e12-b49a-afaa75ba33c0 service neutron] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:15:39.050994 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-a99f377f-1b55-4e12-b49a-afaa75ba33c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:15:39.150984 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f377f-1b55-4e12-b49a-afaa75ba33c0 service neutron] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:15:39.157286 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58a4bca-2393-4aa7-a4a2-177138f98e75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78384fbffdd346578855e7214b335d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:15:39.157991 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a4bca-2393-4aa7-a4a2-177138f98e75 service nova] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:15:39.158341 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a4bca-2393-4aa7-a4a2-177138f98e75 service nova] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:15:39.158685 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a4bca-2393-4aa7-a4a2-177138f98e75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:15:39.167881 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58a4bca-2393-4aa7-a4a2-177138f98e75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:15:39.169474 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58a4bca-2393-4aa7-a4a2-177138f98e75 service nova] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:15:39.180315 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1068/2138] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:15:39 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:15:40.718442 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb7a615-955d-4720-9752-ec5e63b19ce9 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:15:40.719352 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb7a615-955d-4720-9752-ec5e63b19ce9 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:15:40.719702 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb7a615-955d-4720-9752-ec5e63b19ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:15:40.745762 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-6bb7a615-955d-4720-9752-ec5e63b19ce9 None None] MFA Rules not processed for user `dd538e9a9b08439a84ae6e3a2c78d862`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:15:40.747020 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-6bb7a615-955d-4720-9752-ec5e63b19ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:15:40.756226 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1071/2139] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:15:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:15:41.096603 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58a4bca-2393-4aa7-a4a2-177138f98e75 service nova] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:15:41.098306 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-c58a4bca-2393-4aa7-a4a2-177138f98e75 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:15:41.115818 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58a4bca-2393-4aa7-a4a2-177138f98e75 service nova] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:15:41.120555 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a26438-0aa6-47f9-9327-2695a4328288 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:15:41.121677 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a26438-0aa6-47f9-9327-2695a4328288 service neutron] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:15:41.121869 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a26438-0aa6-47f9-9327-2695a4328288 service neutron] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:15:41.122180 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a26438-0aa6-47f9-9327-2695a4328288 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:15:41.124141 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-f4a26438-0aa6-47f9-9327-2695a4328288 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:15:41.138123 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a26438-0aa6-47f9-9327-2695a4328288 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:15:41.139847 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a26438-0aa6-47f9-9327-2695a4328288 service neutron] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:15:41.156112 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1069/2140] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:15:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:15:50.739845 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=84,keystone:INSERT=2 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:15:51.147692 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=61 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:15:53.317374 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb7a615-955d-4720-9752-ec5e63b19ce9 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:15:53.331053 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb7a615-955d-4720-9752-ec5e63b19ce9 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:15:53.338392 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057196c6-b2df-4943-96c4-b4b6509304e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78384fbffdd346578855e7214b335d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:15:53.338392 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057196c6-b2df-4943-96c4-b4b6509304e5 service nova] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:15:53.338743 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057196c6-b2df-4943-96c4-b4b6509304e5 service nova] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:15:53.338955 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057196c6-b2df-4943-96c4-b4b6509304e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:15:53.343353 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-057196c6-b2df-4943-96c4-b4b6509304e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:15:53.356802 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057196c6-b2df-4943-96c4-b4b6509304e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:15:53.358415 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057196c6-b2df-4943-96c4-b4b6509304e5 service nova] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:15:53.369276 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1072/2141] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:15:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 13 11:15:55.978987 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d71528a-9d63-4d8c-8d5e-c8ae26ae9245 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:15:55.979512 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d71528a-9d63-4d8c-8d5e-c8ae26ae9245 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:15:55.980192 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d71528a-9d63-4d8c-8d5e-c8ae26ae9245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:15:55.999422 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-9d71528a-9d63-4d8c-8d5e-c8ae26ae9245 None None] MFA Rules not processed for user `6e803a9cc6114c4f93869e50bca313e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:15:56.000726 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-9d71528a-9d63-4d8c-8d5e-c8ae26ae9245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:15:56.060573 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1070/2142] 10.222.0.25 () {58 vars in 1009 bytes} [Thu Oct 13 11:15:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:15:56.075104 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057196c6-b2df-4943-96c4-b4b6509304e5 service nova] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:15:56.077149 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-057196c6-b2df-4943-96c4-b4b6509304e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:15:56.156084 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057196c6-b2df-4943-96c4-b4b6509304e5 service nova] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:15:56.161174 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d24cd7-86d1-4b14-b7bd-b40af7215f07 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e24c779d0a604ef28dfc1235ee76a711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:15:56.162276 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d24cd7-86d1-4b14-b7bd-b40af7215f07 service swift] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:15:56.162276 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d24cd7-86d1-4b14-b7bd-b40af7215f07 service swift] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:15:56.162468 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d24cd7-86d1-4b14-b7bd-b40af7215f07 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:15:56.170832 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d24cd7-86d1-4b14-b7bd-b40af7215f07 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:15:56.172334 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d24cd7-86d1-4b14-b7bd-b40af7215f07 service swift] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:15:56.180436 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1073/2143] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Oct 13 11:15:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 13 11:15:57.925432 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d71528a-9d63-4d8c-8d5e-c8ae26ae9245 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:15:57.926963 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-9d71528a-9d63-4d8c-8d5e-c8ae26ae9245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:15:57.944580 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d71528a-9d63-4d8c-8d5e-c8ae26ae9245 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:15:57.950683 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fccf8c-938c-4349-85ca-a84cd6967a06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78384fbffdd346578855e7214b335d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:15:57.951299 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fccf8c-938c-4349-85ca-a84cd6967a06 service nova] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:15:57.951577 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fccf8c-938c-4349-85ca-a84cd6967a06 service nova] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:15:57.951852 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fccf8c-938c-4349-85ca-a84cd6967a06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:15:57.953582 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-52fccf8c-938c-4349-85ca-a84cd6967a06 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:15:57.966969 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fccf8c-938c-4349-85ca-a84cd6967a06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:15:57.968291 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fccf8c-938c-4349-85ca-a84cd6967a06 service nova] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:15:57.991915 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1071/2144] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:15:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:16:06.177069 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=38 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:16:07.976316 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=31 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:16:12.248857 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185341d-f752-4639-9f42-cb91d585ea7f None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:16:12.249330 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185341d-f752-4639-9f42-cb91d585ea7f None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:16:12.249439 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185341d-f752-4639-9f42-cb91d585ea7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:16:12.268986 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-a185341d-f752-4639-9f42-cb91d585ea7f None None] MFA Rules not processed for user `6e803a9cc6114c4f93869e50bca313e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:16:12.270140 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-a185341d-f752-4639-9f42-cb91d585ea7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:16:12.277213 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1074/2145] 10.222.0.25 () {58 vars in 1009 bytes} [Thu Oct 13 11:16:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:16:12.288546 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fccf8c-938c-4349-85ca-a84cd6967a06 service nova] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:16:12.299631 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fccf8c-938c-4349-85ca-a84cd6967a06 service nova] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:16:12.304520 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cd1585-d983-4052-98a5-092c8e27e47d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e24c779d0a604ef28dfc1235ee76a711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:16:12.305102 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd1585-d983-4052-98a5-092c8e27e47d service swift] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:16:12.305880 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd1585-d983-4052-98a5-092c8e27e47d service swift] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:16:12.306180 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd1585-d983-4052-98a5-092c8e27e47d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:16:12.313930 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cd1585-d983-4052-98a5-092c8e27e47d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:16:12.315511 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cd1585-d983-4052-98a5-092c8e27e47d service swift] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:16:12.323979 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1072/2146] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Oct 13 11:16:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 13 11:16:22.264074 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=3 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:16:22.320154 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=6 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:16:27.068232 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a185341d-f752-4639-9f42-cb91d585ea7f None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:16:27.069659 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-a185341d-f752-4639-9f42-cb91d585ea7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:16:27.126495 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a185341d-f752-4639-9f42-cb91d585ea7f None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:16:27.130170 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed77c7f-bd15-4d32-a903-1a23de76d2a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f4c2fc51f54f0e977648b13efaed1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:16:27.130772 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed77c7f-bd15-4d32-a903-1a23de76d2a3 service cinder] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:16:27.131054 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed77c7f-bd15-4d32-a903-1a23de76d2a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:16:27.131327 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed77c7f-bd15-4d32-a903-1a23de76d2a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:16:27.132990 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-6ed77c7f-bd15-4d32-a903-1a23de76d2a3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:16:27.189634 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed77c7f-bd15-4d32-a903-1a23de76d2a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:16:27.191088 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed77c7f-bd15-4d32-a903-1a23de76d2a3 service cinder] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:16:27.199947 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1075/2147] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:16:27 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:16:27.565779 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf02c9-e9ff-4f9d-ab0b-28582e2a15fc None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:16:27.566291 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf02c9-e9ff-4f9d-ab0b-28582e2a15fc None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:16:27.566389 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf02c9-e9ff-4f9d-ab0b-28582e2a15fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:16:27.586972 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-aeaf02c9-e9ff-4f9d-ab0b-28582e2a15fc None None] MFA Rules not processed for user `6e803a9cc6114c4f93869e50bca313e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:16:27.588810 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-aeaf02c9-e9ff-4f9d-ab0b-28582e2a15fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:16:27.595843 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1073/2148] 10.222.0.25 () {58 vars in 967 bytes} [Thu Oct 13 11:16:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:16:27.608503 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed77c7f-bd15-4d32-a903-1a23de76d2a3 service cinder] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:16:27.620854 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed77c7f-bd15-4d32-a903-1a23de76d2a3 service cinder] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:16:27.625966 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfbb458-f6fc-4192-b12d-90d1225dc565 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e24c779d0a604ef28dfc1235ee76a711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:16:27.627486 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfbb458-f6fc-4192-b12d-90d1225dc565 service swift] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:16:27.627486 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfbb458-f6fc-4192-b12d-90d1225dc565 service swift] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:16:27.627734 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfbb458-f6fc-4192-b12d-90d1225dc565 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:16:27.636645 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfbb458-f6fc-4192-b12d-90d1225dc565 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:16:27.638232 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfbb458-f6fc-4192-b12d-90d1225dc565 service swift] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:16:27.646141 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1076/2149] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Oct 13 11:16:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 13 11:16:37.582267 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=3 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:16:37.642887 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=54 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:16:41.150447 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaf02c9-e9ff-4f9d-ab0b-28582e2a15fc None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:16:41.166180 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaf02c9-e9ff-4f9d-ab0b-28582e2a15fc None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:16:41.173013 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f9d635-d9ce-4cc3-91a6-798b3e32e20d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78384fbffdd346578855e7214b335d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:16:41.173672 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f9d635-d9ce-4cc3-91a6-798b3e32e20d service nova] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:16:41.173976 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f9d635-d9ce-4cc3-91a6-798b3e32e20d service nova] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:16:41.174421 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f9d635-d9ce-4cc3-91a6-798b3e32e20d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:16:41.176178 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-60f9d635-d9ce-4cc3-91a6-798b3e32e20d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:16:41.190638 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f9d635-d9ce-4cc3-91a6-798b3e32e20d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:16:41.192225 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f9d635-d9ce-4cc3-91a6-798b3e32e20d service nova] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:16:41.202946 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1074/2150] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:16:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:16:45.355385 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f2fe6-eead-4d38-bc67-dc3faf08546c None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:16:45.355875 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f2fe6-eead-4d38-bc67-dc3faf08546c None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:16:45.355999 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f2fe6-eead-4d38-bc67-dc3faf08546c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:16:45.375466 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-df9f2fe6-eead-4d38-bc67-dc3faf08546c None None] MFA Rules not processed for user `dd538e9a9b08439a84ae6e3a2c78d862`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:16:45.376904 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-df9f2fe6-eead-4d38-bc67-dc3faf08546c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:16:45.383852 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1077/2151] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:16:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:16:46.699147 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f9d635-d9ce-4cc3-91a6-798b3e32e20d service nova] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:16:46.708463 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f9d635-d9ce-4cc3-91a6-798b3e32e20d service nova] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:16:46.712402 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81e5e1c-b356-4811-923f-e9e232b33965 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:16:46.713049 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e5e1c-b356-4811-923f-e9e232b33965 service neutron] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:16:46.713338 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e5e1c-b356-4811-923f-e9e232b33965 service neutron] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:16:46.713636 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e5e1c-b356-4811-923f-e9e232b33965 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:16:46.715464 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-c81e5e1c-b356-4811-923f-e9e232b33965 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:16:46.727728 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81e5e1c-b356-4811-923f-e9e232b33965 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:16:46.729221 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81e5e1c-b356-4811-923f-e9e232b33965 service neutron] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:16:46.739478 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1075/2152] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:16:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:16:50.849905 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f2fe6-eead-4d38-bc67-dc3faf08546c None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:16:50.852265 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-df9f2fe6-eead-4d38-bc67-dc3faf08546c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:16:50.919492 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81e5e1c-b356-4811-923f-e9e232b33965 service neutron] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:16:50.921749 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-c81e5e1c-b356-4811-923f-e9e232b33965 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:16:50.937912 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81e5e1c-b356-4811-923f-e9e232b33965 service neutron] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:16:50.942060 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f2fe6-eead-4d38-bc67-dc3faf08546c None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:16:50.942784 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fef1e2-4ddf-4190-a040-26c285e7d817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:16:50.943845 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fef1e2-4ddf-4190-a040-26c285e7d817 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:16:50.944082 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fef1e2-4ddf-4190-a040-26c285e7d817 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:16:50.944556 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fef1e2-4ddf-4190-a040-26c285e7d817 admin admin] PATH_INFO: `/v3/users/d58260446c094b589b6500195c29f05f` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:16:50.945934 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fef1e2-4ddf-4190-a040-26c285e7d817 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d58260446c094b589b6500195c29f05f)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:16:50.948417 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fef1e2-4ddf-4190-a040-26c285e7d817 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:16:50.948889 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efcd99a-e9ba-4d20-9036-bdfb104d7483 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed4bb75e68a640fc92ddd47fad61a25a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:16:50.949601 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efcd99a-e9ba-4d20-9036-bdfb104d7483 service placement] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:16:50.950058 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efcd99a-e9ba-4d20-9036-bdfb104d7483 service placement] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:16:50.950410 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efcd99a-e9ba-4d20-9036-bdfb104d7483 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:16:50.952259 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-8efcd99a-e9ba-4d20-9036-bdfb104d7483 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:16:50.964825 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efcd99a-e9ba-4d20-9036-bdfb104d7483 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:16:50.966451 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efcd99a-e9ba-4d20-9036-bdfb104d7483 service placement] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:16:50.978130 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1078/2153] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:16:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:16:51.005285 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-d1fef1e2-4ddf-4190-a040-26c285e7d817 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd58260446c094b589b6500195c29f05f'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:16:51.012521 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-d1fef1e2-4ddf-4190-a040-26c285e7d817 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd58260446c094b589b6500195c29f05f'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:16:51.013231 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-d1fef1e2-4ddf-4190-a040-26c285e7d817 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd58260446c094b589b6500195c29f05f'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:16:51.013837 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-d1fef1e2-4ddf-4190-a040-26c285e7d817 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd58260446c094b589b6500195c29f05f'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:16:51.021932 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-d1fef1e2-4ddf-4190-a040-26c285e7d817 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd58260446c094b589b6500195c29f05f'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:16:51.040426 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1076/2154] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:16:50 2022] DELETE /identity/v3/users/d58260446c094b589b6500195c29f05f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 11:16:51.224592 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efcd99a-e9ba-4d20-9036-bdfb104d7483 service placement] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:16:51.237362 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efcd99a-e9ba-4d20-9036-bdfb104d7483 service placement] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:16:51.308427 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a23986-5f20-4e81-a9f1-24739155f6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:16:51.309017 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a23986-5f20-4e81-a9f1-24739155f6f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:16:51.309298 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a23986-5f20-4e81-a9f1-24739155f6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:16:51.309576 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a23986-5f20-4e81-a9f1-24739155f6f7 admin admin] PATH_INFO: `/v3/projects/096e5701d0f14029a62690f9cdbba37f` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:16:51.310766 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a23986-5f20-4e81-a9f1-24739155f6f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=096e5701d0f14029a62690f9cdbba37f)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:16:51.312665 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a23986-5f20-4e81-a9f1-24739155f6f7 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:16:51.362277 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-72a23986-5f20-4e81-a9f1-24739155f6f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '096e5701d0f14029a62690f9cdbba37f', 'request_id': 'req-72a23986-5f20-4e81-a9f1-24739155f6f7'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:16:51.369396 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-72a23986-5f20-4e81-a9f1-24739155f6f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '096e5701d0f14029a62690f9cdbba37f', 'request_id': 'req-72a23986-5f20-4e81-a9f1-24739155f6f7'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:16:51.375787 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-72a23986-5f20-4e81-a9f1-24739155f6f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '096e5701d0f14029a62690f9cdbba37f', 'request_id': 'req-72a23986-5f20-4e81-a9f1-24739155f6f7'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:16:51.386857 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-72a23986-5f20-4e81-a9f1-24739155f6f7 admin admin] The token cache is being invalidate because project 096e5701d0f14029a62690f9cdbba37f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:16:51.387144 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-72a23986-5f20-4e81-a9f1-24739155f6f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:16:51.387788 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-72a23986-5f20-4e81-a9f1-24739155f6f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:16:51.389270 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1079/2155] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:16:51 2022] DELETE /identity/v3/projects/096e5701d0f14029a62690f9cdbba37f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:16:51.394410 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f69848-c448-4abc-b350-ef7a747f0a65 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:16:51.394797 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f69848-c448-4abc-b350-ef7a747f0a65 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:16:51.395168 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f69848-c448-4abc-b350-ef7a747f0a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:16:51.417387 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-75f69848-c448-4abc-b350-ef7a747f0a65 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:16:51.418776 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-75f69848-c448-4abc-b350-ef7a747f0a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:16:51.485269 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1077/2156] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:16:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:16:51.494276 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bad77a-1536-43fe-8e09-e0b38560768c None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:16:51.494568 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bad77a-1536-43fe-8e09-e0b38560768c None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:16:51.494837 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bad77a-1536-43fe-8e09-e0b38560768c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:16:51.515209 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-50bad77a-1536-43fe-8e09-e0b38560768c None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:16:51.516430 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-50bad77a-1536-43fe-8e09-e0b38560768c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:16:51.524798 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1080/2157] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:16:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:16:51.529493 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f69848-c448-4abc-b350-ef7a747f0a65 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:16:51.539318 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f69848-c448-4abc-b350-ef7a747f0a65 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:16:51.544023 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da6663-68f4-4dd4-bb10-348e68aab8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:16:51.544691 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da6663-68f4-4dd4-bb10-348e68aab8f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:16:51.545040 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da6663-68f4-4dd4-bb10-348e68aab8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:16:51.545413 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da6663-68f4-4dd4-bb10-348e68aab8f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:16:51.546176 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58da6663-68f4-4dd4-bb10-348e68aab8f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:16:51.546618 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58da6663-68f4-4dd4-bb10-348e68aab8f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:16:51.548267 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58da6663-68f4-4dd4-bb10-348e68aab8f0 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:16:51.563132 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1078/2158] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 11:16:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:16:51.564194 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bad77a-1536-43fe-8e09-e0b38560768c None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:16:51.573882 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bad77a-1536-43fe-8e09-e0b38560768c None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:16:51.578643 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9800f18d-4462-4d9a-9a4a-0c71b5e77b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:16:51.579237 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9800f18d-4462-4d9a-9a4a-0c71b5e77b75 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:16:51.579514 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9800f18d-4462-4d9a-9a4a-0c71b5e77b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:16:51.579787 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9800f18d-4462-4d9a-9a4a-0c71b5e77b75 admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:16:51.580428 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9800f18d-4462-4d9a-9a4a-0c71b5e77b75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:16:51.582355 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9800f18d-4462-4d9a-9a4a-0c71b5e77b75 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:16:51.586962 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:16:51.615810 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1081/2159] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:16:51 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 11:16:51.617210 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da6663-68f4-4dd4-bb10-348e68aab8f0 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:16:51.627630 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da6663-68f4-4dd4-bb10-348e68aab8f0 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:16:51.660683 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:16:51.690059 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab9d5a-824c-4993-989f-e4dffafeed1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:16:51.690699 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab9d5a-824c-4993-989f-e4dffafeed1a admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:16:51.691085 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab9d5a-824c-4993-989f-e4dffafeed1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:16:51.691369 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab9d5a-824c-4993-989f-e4dffafeed1a admin admin] PATH_INFO: `/v3/users` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:16:51.692011 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ab9d5a-824c-4993-989f-e4dffafeed1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:16:51.693919 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ab9d5a-824c-4993-989f-e4dffafeed1a admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:16:51.716053 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1079/2160] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:16:51 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:16:51.720397 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9800f18d-4462-4d9a-9a4a-0c71b5e77b75 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:16:51.730858 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9800f18d-4462-4d9a-9a4a-0c71b5e77b75 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:16:51.735483 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf0fdc0-e49d-46e6-90cc-37206ba69c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:16:51.736072 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf0fdc0-e49d-46e6-90cc-37206ba69c62 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:16:51.736377 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf0fdc0-e49d-46e6-90cc-37206ba69c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:16:51.736646 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf0fdc0-e49d-46e6-90cc-37206ba69c62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:16:51.737278 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf0fdc0-e49d-46e6-90cc-37206ba69c62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:16:51.739021 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf0fdc0-e49d-46e6-90cc-37206ba69c62 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:16:51.748850 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1082/2161] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:16:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:16:51.753077 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab9d5a-824c-4993-989f-e4dffafeed1a admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:16:51.763665 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab9d5a-824c-4993-989f-e4dffafeed1a admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:16:51.768308 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a5fdd-a7ac-485b-9949-d4cb4c591dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:16:51.768894 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a5fdd-a7ac-485b-9949-d4cb4c591dba admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:16:51.769173 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a5fdd-a7ac-485b-9949-d4cb4c591dba admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:16:51.769446 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a5fdd-a7ac-485b-9949-d4cb4c591dba admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:16:51.770149 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3a5fdd-a7ac-485b-9949-d4cb4c591dba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:16:51.771718 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3a5fdd-a7ac-485b-9949-d4cb4c591dba admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:16:51.782070 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1080/2162] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:16:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:16:51.786465 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf0fdc0-e49d-46e6-90cc-37206ba69c62 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:16:51.796420 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf0fdc0-e49d-46e6-90cc-37206ba69c62 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:16:51.800985 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe7fccc-ccfa-4124-bcc3-2627f4fda05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:16:51.801626 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7fccc-ccfa-4124-bcc3-2627f4fda05a admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:16:51.801902 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7fccc-ccfa-4124-bcc3-2627f4fda05a admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:16:51.802209 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7fccc-ccfa-4124-bcc3-2627f4fda05a admin admin] PATH_INFO: `/v3/projects/5994bc0ec7f84b5d964b6454ed0dddad/users/8b86b7aea93c4f72b555296a812a6c56/roles/7c3871c0ab68438b9014489d50b53a22` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:16:51.817052 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe7fccc-ccfa-4124-bcc3-2627f4fda05a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5994bc0ec7f84b5d964b6454ed0dddad, user_id=8b86b7aea93c4f72b555296a812a6c56, role_id=7c3871c0ab68438b9014489d50b53a22)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:16:51.819756 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe7fccc-ccfa-4124-bcc3-2627f4fda05a admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:16:51.832754 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1083/2163] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:16:51 2022] PUT /identity/v3/projects/5994bc0ec7f84b5d964b6454ed0dddad/users/8b86b7aea93c4f72b555296a812a6c56/roles/7c3871c0ab68438b9014489d50b53a22 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 11:16:51.843008 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fff436-3e19-4208-86e3-e349acc6d333 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:16:51.843298 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fff436-3e19-4208-86e3-e349acc6d333 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:16:51.843573 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fff436-3e19-4208-86e3-e349acc6d333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:16:51.871949 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-55fff436-3e19-4208-86e3-e349acc6d333 None None] MFA Rules not processed for user `8b86b7aea93c4f72b555296a812a6c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:16:51.873089 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-55fff436-3e19-4208-86e3-e349acc6d333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:16:51.937840 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1081/2164] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:16:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:16:51.949601 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe7fccc-ccfa-4124-bcc3-2627f4fda05a admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:16:51.951342 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-5fe7fccc-ccfa-4124-bcc3-2627f4fda05a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:16:52.031116 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe7fccc-ccfa-4124-bcc3-2627f4fda05a admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:16:52.036695 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48851b36-bc25-4050-97ee-63950aeec78f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78384fbffdd346578855e7214b335d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:16:52.037307 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48851b36-bc25-4050-97ee-63950aeec78f service nova] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:16:52.037588 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48851b36-bc25-4050-97ee-63950aeec78f service nova] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:16:52.037865 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48851b36-bc25-4050-97ee-63950aeec78f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:16:52.045920 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48851b36-bc25-4050-97ee-63950aeec78f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:16:52.047531 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48851b36-bc25-4050-97ee-63950aeec78f service nova] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:16:52.056603 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1084/2165] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:16:51 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 13 11:16:57.234444 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fff436-3e19-4208-86e3-e349acc6d333 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:16:57.287916 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fff436-3e19-4208-86e3-e349acc6d333 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:16:57.293143 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8ccd26-172f-491a-a1e2-d8717d284031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:16:57.293762 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ccd26-172f-491a-a1e2-d8717d284031 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:16:57.294081 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ccd26-172f-491a-a1e2-d8717d284031 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:16:57.294358 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ccd26-172f-491a-a1e2-d8717d284031 admin admin] PATH_INFO: `/v3/users/8b86b7aea93c4f72b555296a812a6c56` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:16:57.295626 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8ccd26-172f-491a-a1e2-d8717d284031 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b86b7aea93c4f72b555296a812a6c56)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:16:57.297584 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8ccd26-172f-491a-a1e2-d8717d284031 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:16:57.340890 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:16:57.344081 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-aa8ccd26-172f-491a-a1e2-d8717d284031 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b86b7aea93c4f72b555296a812a6c56'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:16:57.352403 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-aa8ccd26-172f-491a-a1e2-d8717d284031 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b86b7aea93c4f72b555296a812a6c56'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:16:57.353077 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-aa8ccd26-172f-491a-a1e2-d8717d284031 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b86b7aea93c4f72b555296a812a6c56'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:16:57.353723 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-aa8ccd26-172f-491a-a1e2-d8717d284031 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b86b7aea93c4f72b555296a812a6c56'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:16:57.361966 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-aa8ccd26-172f-491a-a1e2-d8717d284031 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b86b7aea93c4f72b555296a812a6c56'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:16:57.379122 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1082/2166] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:16:57 2022] DELETE /identity/v3/users/8b86b7aea93c4f72b555296a812a6c56 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:16:57.383482 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d164e-c477-43ba-b3e1-9adec7ebae6d None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:16:57.383927 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d164e-c477-43ba-b3e1-9adec7ebae6d None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:16:57.384055 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d164e-c477-43ba-b3e1-9adec7ebae6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:16:57.403891 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-d64d164e-c477-43ba-b3e1-9adec7ebae6d None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:16:57.405087 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-d64d164e-c477-43ba-b3e1-9adec7ebae6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:16:57.461691 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1085/2167] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:16:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:16:57.471852 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8ccd26-172f-491a-a1e2-d8717d284031 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:16:57.473242 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-aa8ccd26-172f-491a-a1e2-d8717d284031 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:16:57.529154 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8ccd26-172f-491a-a1e2-d8717d284031 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:16:57.532913 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25708b9f-cca1-425a-b965-e1893e8b3994 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:16:57.533515 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25708b9f-cca1-425a-b965-e1893e8b3994 service neutron] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:16:57.533795 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25708b9f-cca1-425a-b965-e1893e8b3994 service neutron] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:16:57.534102 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25708b9f-cca1-425a-b965-e1893e8b3994 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:16:57.543012 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25708b9f-cca1-425a-b965-e1893e8b3994 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:16:57.544419 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25708b9f-cca1-425a-b965-e1893e8b3994 service neutron] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:16:57.553645 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1083/2168] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:16:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:16:57.836971 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64d164e-c477-43ba-b3e1-9adec7ebae6d None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:16:57.838420 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-d64d164e-c477-43ba-b3e1-9adec7ebae6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:16:57.850169 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64d164e-c477-43ba-b3e1-9adec7ebae6d None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:16:57.854973 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cffcdb6-7bea-47b3-9b9e-c47e344ea2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:16:57.855605 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cffcdb6-7bea-47b3-9b9e-c47e344ea2a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:16:57.855882 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cffcdb6-7bea-47b3-9b9e-c47e344ea2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:16:57.856154 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cffcdb6-7bea-47b3-9b9e-c47e344ea2a2 admin admin] PATH_INFO: `/v3/projects/5994bc0ec7f84b5d964b6454ed0dddad` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:16:57.857271 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cffcdb6-7bea-47b3-9b9e-c47e344ea2a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5994bc0ec7f84b5d964b6454ed0dddad)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:16:57.859209 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cffcdb6-7bea-47b3-9b9e-c47e344ea2a2 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:16:57.900068 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:16:57.915458 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-3cffcdb6-7bea-47b3-9b9e-c47e344ea2a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5994bc0ec7f84b5d964b6454ed0dddad', 'request_id': 'req-3cffcdb6-7bea-47b3-9b9e-c47e344ea2a2'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:16:57.924999 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-3cffcdb6-7bea-47b3-9b9e-c47e344ea2a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5994bc0ec7f84b5d964b6454ed0dddad', 'request_id': 'req-3cffcdb6-7bea-47b3-9b9e-c47e344ea2a2'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:16:57.932757 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-3cffcdb6-7bea-47b3-9b9e-c47e344ea2a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5994bc0ec7f84b5d964b6454ed0dddad', 'request_id': 'req-3cffcdb6-7bea-47b3-9b9e-c47e344ea2a2'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:16:57.943475 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-3cffcdb6-7bea-47b3-9b9e-c47e344ea2a2 admin admin] The token cache is being invalidate because project 5994bc0ec7f84b5d964b6454ed0dddad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:16:57.943760 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-3cffcdb6-7bea-47b3-9b9e-c47e344ea2a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:16:57.944394 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-3cffcdb6-7bea-47b3-9b9e-c47e344ea2a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:16:57.945854 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1086/2169] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:16:57 2022] DELETE /identity/v3/projects/5994bc0ec7f84b5d964b6454ed0dddad => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:16:57.951202 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb910ad-5ba9-4861-b5d6-e4bc13c87f94 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:16:57.951488 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb910ad-5ba9-4861-b5d6-e4bc13c87f94 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:16:57.951761 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb910ad-5ba9-4861-b5d6-e4bc13c87f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:16:57.971013 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-8fb910ad-5ba9-4861-b5d6-e4bc13c87f94 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:16:57.972199 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-8fb910ad-5ba9-4861-b5d6-e4bc13c87f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:16:58.033441 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1084/2170] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:16:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:16:58.041099 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00516cbf-2e47-433a-bd3d-2f6f8547c88d None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:16:58.041384 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00516cbf-2e47-433a-bd3d-2f6f8547c88d None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:16:58.041706 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00516cbf-2e47-433a-bd3d-2f6f8547c88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:16:58.062145 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-00516cbf-2e47-433a-bd3d-2f6f8547c88d None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:16:58.063379 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-00516cbf-2e47-433a-bd3d-2f6f8547c88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:16:58.071302 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1087/2171] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:16:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:16:58.076077 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb910ad-5ba9-4861-b5d6-e4bc13c87f94 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:16:58.086445 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb910ad-5ba9-4861-b5d6-e4bc13c87f94 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:16:58.091095 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a40bf3-036b-4e76-9614-66ea1ba79b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:16:58.091694 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a40bf3-036b-4e76-9614-66ea1ba79b03 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:16:58.091972 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a40bf3-036b-4e76-9614-66ea1ba79b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:16:58.092248 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a40bf3-036b-4e76-9614-66ea1ba79b03 admin admin] PATH_INFO: `/v3/domains` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:16:58.092895 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a40bf3-036b-4e76-9614-66ea1ba79b03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:16:58.093207 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a40bf3-036b-4e76-9614-66ea1ba79b03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:16:58.094811 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a40bf3-036b-4e76-9614-66ea1ba79b03 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:16:58.109898 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1085/2172] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 11:16:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:16:58.111151 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00516cbf-2e47-433a-bd3d-2f6f8547c88d None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:16:58.123041 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00516cbf-2e47-433a-bd3d-2f6f8547c88d None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:16:58.128222 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585238f-28b4-40bb-b832-5caa045b5b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:16:58.128921 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585238f-28b4-40bb-b832-5caa045b5b91 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:16:58.129313 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585238f-28b4-40bb-b832-5caa045b5b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:16:58.129665 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585238f-28b4-40bb-b832-5caa045b5b91 admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:16:58.130414 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9585238f-28b4-40bb-b832-5caa045b5b91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:16:58.132582 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9585238f-28b4-40bb-b832-5caa045b5b91 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:16:58.165177 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1088/2173] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:16:58 2022] POST /identity/v3/projects => generated 365 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:16:58.169681 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a40bf3-036b-4e76-9614-66ea1ba79b03 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:16:58.181347 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a40bf3-036b-4e76-9614-66ea1ba79b03 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:16:58.240555 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:16:58.253509 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6206000e-36aa-442c-99ff-a73eb67276e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:16:58.254256 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6206000e-36aa-442c-99ff-a73eb67276e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:16:58.254639 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6206000e-36aa-442c-99ff-a73eb67276e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:16:58.254985 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6206000e-36aa-442c-99ff-a73eb67276e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:16:58.255734 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6206000e-36aa-442c-99ff-a73eb67276e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:16:58.257726 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6206000e-36aa-442c-99ff-a73eb67276e7 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:16:58.282278 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1086/2174] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:16:58 2022] POST /identity/v3/users => generated 283 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 11:16:58.286835 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585238f-28b4-40bb-b832-5caa045b5b91 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:16:58.298758 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585238f-28b4-40bb-b832-5caa045b5b91 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:16:58.303575 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b78f9f4-0b98-46c9-9b3f-15fb8565d612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:16:58.304188 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78f9f4-0b98-46c9-9b3f-15fb8565d612 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:16:58.304472 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78f9f4-0b98-46c9-9b3f-15fb8565d612 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:16:58.304750 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78f9f4-0b98-46c9-9b3f-15fb8565d612 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:16:58.305405 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b78f9f4-0b98-46c9-9b3f-15fb8565d612 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:16:58.307050 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b78f9f4-0b98-46c9-9b3f-15fb8565d612 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:16:58.318420 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1089/2175] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:16:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:16:58.322375 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6206000e-36aa-442c-99ff-a73eb67276e7 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:16:58.332823 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6206000e-36aa-442c-99ff-a73eb67276e7 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:16:58.337556 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c30568f-9227-40f3-b4ce-ea736d066e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:16:58.338209 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c30568f-9227-40f3-b4ce-ea736d066e0a admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:16:58.338535 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c30568f-9227-40f3-b4ce-ea736d066e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:16:58.338813 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c30568f-9227-40f3-b4ce-ea736d066e0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:16:58.339472 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c30568f-9227-40f3-b4ce-ea736d066e0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:16:58.341085 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c30568f-9227-40f3-b4ce-ea736d066e0a admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:16:58.352535 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1087/2176] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:16:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:16:58.357155 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b78f9f4-0b98-46c9-9b3f-15fb8565d612 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:16:58.367129 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b78f9f4-0b98-46c9-9b3f-15fb8565d612 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:16:58.372277 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1472fb-b62b-4e19-9040-7545d84b2fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:16:58.372926 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1472fb-b62b-4e19-9040-7545d84b2fcf admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:16:58.373203 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1472fb-b62b-4e19-9040-7545d84b2fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:16:58.373479 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1472fb-b62b-4e19-9040-7545d84b2fcf admin admin] PATH_INFO: `/v3/projects/8279e884f52e4dbb9c0d59489b0cb4ab/users/fac23efe88c840aeb054399d7ea37e32/roles/7c3871c0ab68438b9014489d50b53a22` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:16:58.388610 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1472fb-b62b-4e19-9040-7545d84b2fcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=8279e884f52e4dbb9c0d59489b0cb4ab, user_id=fac23efe88c840aeb054399d7ea37e32, role_id=7c3871c0ab68438b9014489d50b53a22)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:16:58.391369 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1472fb-b62b-4e19-9040-7545d84b2fcf admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:16:58.404614 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1090/2177] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:16:58 2022] PUT /identity/v3/projects/8279e884f52e4dbb9c0d59489b0cb4ab/users/fac23efe88c840aeb054399d7ea37e32/roles/7c3871c0ab68438b9014489d50b53a22 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:16:58.416424 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905fde0-e97e-4bdc-93fc-3ee0eb76b4a8 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:16:58.417171 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905fde0-e97e-4bdc-93fc-3ee0eb76b4a8 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:16:58.417442 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905fde0-e97e-4bdc-93fc-3ee0eb76b4a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:16:58.445267 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-8905fde0-e97e-4bdc-93fc-3ee0eb76b4a8 None None] MFA Rules not processed for user `fac23efe88c840aeb054399d7ea37e32`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:16:58.446614 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-8905fde0-e97e-4bdc-93fc-3ee0eb76b4a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:16:58.511224 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1088/2178] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:16:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:16:58.516023 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1472fb-b62b-4e19-9040-7545d84b2fcf admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:16:58.586355 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1472fb-b62b-4e19-9040-7545d84b2fcf admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:16:58.591854 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb6ca63-055b-4ca0-9861-44d73a7d7552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:16:58.592455 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb6ca63-055b-4ca0-9861-44d73a7d7552 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:16:58.592851 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb6ca63-055b-4ca0-9861-44d73a7d7552 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:16:58.593120 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb6ca63-055b-4ca0-9861-44d73a7d7552 admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:16:58.593748 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb6ca63-055b-4ca0-9861-44d73a7d7552 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:16:58.595660 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb6ca63-055b-4ca0-9861-44d73a7d7552 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:16:58.623731 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1091/2179] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:16:58 2022] POST /identity/v3/projects => generated 365 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 11:16:58.628802 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8905fde0-e97e-4bdc-93fc-3ee0eb76b4a8 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:16:58.641785 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8905fde0-e97e-4bdc-93fc-3ee0eb76b4a8 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:16:58.699427 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f3d0b8-bc5d-49d6-b613-55e1bd2ddadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:16:58.700039 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f3d0b8-bc5d-49d6-b613-55e1bd2ddadc admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:16:58.700316 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f3d0b8-bc5d-49d6-b613-55e1bd2ddadc admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:16:58.700586 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f3d0b8-bc5d-49d6-b613-55e1bd2ddadc admin admin] PATH_INFO: `/v3/users` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:16:58.701216 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f3d0b8-bc5d-49d6-b613-55e1bd2ddadc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:16:58.703147 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f3d0b8-bc5d-49d6-b613-55e1bd2ddadc admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:16:58.725551 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1089/2180] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:16:58 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 11:16:58.730475 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb6ca63-055b-4ca0-9861-44d73a7d7552 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:16:58.740809 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb6ca63-055b-4ca0-9861-44d73a7d7552 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:16:58.745480 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57016bf0-f7b4-4485-85dc-ea85e1da1535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:16:58.746111 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57016bf0-f7b4-4485-85dc-ea85e1da1535 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:16:58.746390 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57016bf0-f7b4-4485-85dc-ea85e1da1535 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:16:58.746663 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57016bf0-f7b4-4485-85dc-ea85e1da1535 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:16:58.747304 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57016bf0-f7b4-4485-85dc-ea85e1da1535 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:16:58.748970 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57016bf0-f7b4-4485-85dc-ea85e1da1535 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:16:58.763308 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1092/2181] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:16:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:16:58.764596 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f3d0b8-bc5d-49d6-b613-55e1bd2ddadc admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:16:58.775083 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f3d0b8-bc5d-49d6-b613-55e1bd2ddadc admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:16:58.780248 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6ebe9d-5524-4fc1-8db0-902b6f8d9e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:16:58.780902 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ebe9d-5524-4fc1-8db0-902b6f8d9e40 admin admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:16:58.781179 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ebe9d-5524-4fc1-8db0-902b6f8d9e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:16:58.781451 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ebe9d-5524-4fc1-8db0-902b6f8d9e40 admin admin] PATH_INFO: `/v3/projects/e74ea33c78a04b1bb7199fbc56a543a2/users/40deeba279d643db94b3137453de7556/roles/ea564961b1db4eb4a1d4d880964611b2` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:16:58.798362 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6ebe9d-5524-4fc1-8db0-902b6f8d9e40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e74ea33c78a04b1bb7199fbc56a543a2, user_id=40deeba279d643db94b3137453de7556, role_id=ea564961b1db4eb4a1d4d880964611b2)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:16:58.801122 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6ebe9d-5524-4fc1-8db0-902b6f8d9e40 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:16:58.814487 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1090/2182] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:16:58 2022] PUT /identity/v3/projects/e74ea33c78a04b1bb7199fbc56a543a2/users/40deeba279d643db94b3137453de7556/roles/ea564961b1db4eb4a1d4d880964611b2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:16:58.818543 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57016bf0-f7b4-4485-85dc-ea85e1da1535 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:16:58.828497 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57016bf0-f7b4-4485-85dc-ea85e1da1535 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:16:58.855834 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:16:58.892571 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cea9b4-ba82-49e2-991a-9f377a79bf35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:16:58.893462 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cea9b4-ba82-49e2-991a-9f377a79bf35 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:16:58.893742 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cea9b4-ba82-49e2-991a-9f377a79bf35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:16:58.894065 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cea9b4-ba82-49e2-991a-9f377a79bf35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:16:58.894716 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cea9b4-ba82-49e2-991a-9f377a79bf35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:16:58.896329 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cea9b4-ba82-49e2-991a-9f377a79bf35 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:16:58.907265 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1093/2183] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:16:58 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:16:58.911344 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6ebe9d-5524-4fc1-8db0-902b6f8d9e40 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:16:58.922207 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6ebe9d-5524-4fc1-8db0-902b6f8d9e40 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:16:58.926911 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf53d1-fa35-4691-84e2-bc8d5eb9ce65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:16:58.927494 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf53d1-fa35-4691-84e2-bc8d5eb9ce65 admin admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:16:58.927775 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf53d1-fa35-4691-84e2-bc8d5eb9ce65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:16:58.928079 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf53d1-fa35-4691-84e2-bc8d5eb9ce65 admin admin] PATH_INFO: `/v3/projects/e74ea33c78a04b1bb7199fbc56a543a2/users/40deeba279d643db94b3137453de7556/roles/ea564961b1db4eb4a1d4d880964611b2` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:16:58.930015 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbf53d1-fa35-4691-84e2-bc8d5eb9ce65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e74ea33c78a04b1bb7199fbc56a543a2, user_id=40deeba279d643db94b3137453de7556, role_id=ea564961b1db4eb4a1d4d880964611b2)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:16:58.932645 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbf53d1-fa35-4691-84e2-bc8d5eb9ce65 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:16:58.942803 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1091/2184] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:16:58 2022] PUT /identity/v3/projects/e74ea33c78a04b1bb7199fbc56a543a2/users/40deeba279d643db94b3137453de7556/roles/ea564961b1db4eb4a1d4d880964611b2 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:16:58.953857 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9673c75-0473-4674-bd2d-72a0036c7ebc None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:16:58.954168 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9673c75-0473-4674-bd2d-72a0036c7ebc None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:16:58.954450 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9673c75-0473-4674-bd2d-72a0036c7ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:16:58.985468 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-d9673c75-0473-4674-bd2d-72a0036c7ebc None None] MFA Rules not processed for user `40deeba279d643db94b3137453de7556`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:16:58.986791 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-d9673c75-0473-4674-bd2d-72a0036c7ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:16:59.069747 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1094/2185] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:16:58 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:16:59.082166 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf53d1-fa35-4691-84e2-bc8d5eb9ce65 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:16:59.084240 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-4dbf53d1-fa35-4691-84e2-bc8d5eb9ce65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:16:59.099383 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:16:59.159125 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf53d1-fa35-4691-84e2-bc8d5eb9ce65 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:16:59.179008 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032f322-1682-434d-b677-ba071d74ea12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f4c2fc51f54f0e977648b13efaed1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:16:59.179563 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032f322-1682-434d-b677-ba071d74ea12 service cinder] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:16:59.179845 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032f322-1682-434d-b677-ba071d74ea12 service cinder] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:16:59.180116 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032f322-1682-434d-b677-ba071d74ea12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:16:59.191478 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0032f322-1682-434d-b677-ba071d74ea12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:16:59.193178 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0032f322-1682-434d-b677-ba071d74ea12 service cinder] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:16:59.205225 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1092/2186] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:16:59 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:16:59.722927 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9673c75-0473-4674-bd2d-72a0036c7ebc None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:16:59.793309 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9673c75-0473-4674-bd2d-72a0036c7ebc None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:16:59.804270 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44673c02-86a4-4a1e-a90b-c7d36e40dab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:16:59.805129 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44673c02-86a4-4a1e-a90b-c7d36e40dab0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:16:59.805506 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44673c02-86a4-4a1e-a90b-c7d36e40dab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:16:59.805817 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44673c02-86a4-4a1e-a90b-c7d36e40dab0 admin admin] PATH_INFO: `/v3/users/fac23efe88c840aeb054399d7ea37e32` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:16:59.807001 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44673c02-86a4-4a1e-a90b-c7d36e40dab0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fac23efe88c840aeb054399d7ea37e32)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:16:59.809556 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44673c02-86a4-4a1e-a90b-c7d36e40dab0 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:16:59.863564 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-44673c02-86a4-4a1e-a90b-c7d36e40dab0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fac23efe88c840aeb054399d7ea37e32'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:16:59.864524 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-44673c02-86a4-4a1e-a90b-c7d36e40dab0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fac23efe88c840aeb054399d7ea37e32'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:16:59.865434 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-44673c02-86a4-4a1e-a90b-c7d36e40dab0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fac23efe88c840aeb054399d7ea37e32'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:16:59.871444 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:16:59.884942 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-44673c02-86a4-4a1e-a90b-c7d36e40dab0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fac23efe88c840aeb054399d7ea37e32'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:16:59.896068 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-44673c02-86a4-4a1e-a90b-c7d36e40dab0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fac23efe88c840aeb054399d7ea37e32'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:16:59.909712 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1095/2187] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:16:59 2022] DELETE /identity/v3/users/fac23efe88c840aeb054399d7ea37e32 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:16:59.914259 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51326741-e8cf-4c50-88a1-a0b72fddda07 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:16:59.917680 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51326741-e8cf-4c50-88a1-a0b72fddda07 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:16:59.917980 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51326741-e8cf-4c50-88a1-a0b72fddda07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:16:59.942135 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-51326741-e8cf-4c50-88a1-a0b72fddda07 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:16:59.943370 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-51326741-e8cf-4c50-88a1-a0b72fddda07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:00.013661 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1093/2188] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:16:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:17:00.026889 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44673c02-86a4-4a1e-a90b-c7d36e40dab0 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:00.028460 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-44673c02-86a4-4a1e-a90b-c7d36e40dab0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:00.094834 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44673c02-86a4-4a1e-a90b-c7d36e40dab0 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:00.098861 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2798bc6b-f8bf-4274-852c-4a41cffb3c20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:00.099470 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2798bc6b-f8bf-4274-852c-4a41cffb3c20 service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:00.105156 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2798bc6b-f8bf-4274-852c-4a41cffb3c20 service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:00.105459 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2798bc6b-f8bf-4274-852c-4a41cffb3c20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:00.117409 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2798bc6b-f8bf-4274-852c-4a41cffb3c20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:00.119000 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2798bc6b-f8bf-4274-852c-4a41cffb3c20 service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:00.129096 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1096/2189] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:17:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:17:00.566427 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51326741-e8cf-4c50-88a1-a0b72fddda07 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:00.569492 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-51326741-e8cf-4c50-88a1-a0b72fddda07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:00.590283 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51326741-e8cf-4c50-88a1-a0b72fddda07 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:00.596924 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8721ab2b-4637-4226-9b66-19ed92d5a38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:00.597570 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8721ab2b-4637-4226-9b66-19ed92d5a38f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:00.597855 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8721ab2b-4637-4226-9b66-19ed92d5a38f admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:00.598169 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8721ab2b-4637-4226-9b66-19ed92d5a38f admin admin] PATH_INFO: `/v3/projects/8279e884f52e4dbb9c0d59489b0cb4ab` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:00.599314 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8721ab2b-4637-4226-9b66-19ed92d5a38f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8279e884f52e4dbb9c0d59489b0cb4ab)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:00.601282 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8721ab2b-4637-4226-9b66-19ed92d5a38f admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:00.666162 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-8721ab2b-4637-4226-9b66-19ed92d5a38f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8279e884f52e4dbb9c0d59489b0cb4ab', 'request_id': 'req-8721ab2b-4637-4226-9b66-19ed92d5a38f'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:00.679571 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-8721ab2b-4637-4226-9b66-19ed92d5a38f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8279e884f52e4dbb9c0d59489b0cb4ab', 'request_id': 'req-8721ab2b-4637-4226-9b66-19ed92d5a38f'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:00.687226 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-8721ab2b-4637-4226-9b66-19ed92d5a38f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8279e884f52e4dbb9c0d59489b0cb4ab', 'request_id': 'req-8721ab2b-4637-4226-9b66-19ed92d5a38f'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:00.705254 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-8721ab2b-4637-4226-9b66-19ed92d5a38f admin admin] The token cache is being invalidate because project 8279e884f52e4dbb9c0d59489b0cb4ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:17:00.705571 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-8721ab2b-4637-4226-9b66-19ed92d5a38f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:00.706436 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-8721ab2b-4637-4226-9b66-19ed92d5a38f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:00.708718 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1094/2190] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:17:00 2022] DELETE /identity/v3/projects/8279e884f52e4dbb9c0d59489b0cb4ab => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:17:00.712389 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2798bc6b-f8bf-4274-852c-4a41cffb3c20 service neutron] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:00.723053 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2798bc6b-f8bf-4274-852c-4a41cffb3c20 service neutron] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:00.790617 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f9218-f19d-4bbf-b56a-fde40bd4208d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:00.791273 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f9218-f19d-4bbf-b56a-fde40bd4208d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:00.791582 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f9218-f19d-4bbf-b56a-fde40bd4208d admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:00.791858 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f9218-f19d-4bbf-b56a-fde40bd4208d admin admin] PATH_INFO: `/v3/users/40deeba279d643db94b3137453de7556` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:00.793034 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41f9218-f19d-4bbf-b56a-fde40bd4208d admin admin] RBAC: Authorizing `identity:delete_user(user_id=40deeba279d643db94b3137453de7556)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:00.795522 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41f9218-f19d-4bbf-b56a-fde40bd4208d admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:00.851522 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-d41f9218-f19d-4bbf-b56a-fde40bd4208d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40deeba279d643db94b3137453de7556'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:00.852251 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-d41f9218-f19d-4bbf-b56a-fde40bd4208d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40deeba279d643db94b3137453de7556'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:00.852910 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-d41f9218-f19d-4bbf-b56a-fde40bd4208d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40deeba279d643db94b3137453de7556'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:00.868882 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-d41f9218-f19d-4bbf-b56a-fde40bd4208d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40deeba279d643db94b3137453de7556'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:00.881960 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-d41f9218-f19d-4bbf-b56a-fde40bd4208d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40deeba279d643db94b3137453de7556'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:00.886951 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:17:00.908022 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1097/2191] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:17:00 2022] DELETE /identity/v3/users/40deeba279d643db94b3137453de7556 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:17:01.224513 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8721ab2b-4637-4226-9b66-19ed92d5a38f admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:01.226302 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-8721ab2b-4637-4226-9b66-19ed92d5a38f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:01.255693 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8721ab2b-4637-4226-9b66-19ed92d5a38f admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:01.305507 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:17:01.335049 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0ce877-9958-4bb5-a577-1f52be198653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:01.335790 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ce877-9958-4bb5-a577-1f52be198653 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:01.336140 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ce877-9958-4bb5-a577-1f52be198653 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:01.337162 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ce877-9958-4bb5-a577-1f52be198653 admin admin] PATH_INFO: `/v3/projects/e74ea33c78a04b1bb7199fbc56a543a2` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:01.337859 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0ce877-9958-4bb5-a577-1f52be198653 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e74ea33c78a04b1bb7199fbc56a543a2)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:01.340208 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0ce877-9958-4bb5-a577-1f52be198653 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:01.398888 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-7e0ce877-9958-4bb5-a577-1f52be198653 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e74ea33c78a04b1bb7199fbc56a543a2', 'request_id': 'req-7e0ce877-9958-4bb5-a577-1f52be198653'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:01.405644 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-7e0ce877-9958-4bb5-a577-1f52be198653 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e74ea33c78a04b1bb7199fbc56a543a2', 'request_id': 'req-7e0ce877-9958-4bb5-a577-1f52be198653'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:01.412289 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-7e0ce877-9958-4bb5-a577-1f52be198653 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e74ea33c78a04b1bb7199fbc56a543a2', 'request_id': 'req-7e0ce877-9958-4bb5-a577-1f52be198653'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:01.428683 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-7e0ce877-9958-4bb5-a577-1f52be198653 admin admin] The token cache is being invalidate because project e74ea33c78a04b1bb7199fbc56a543a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:17:01.428978 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-7e0ce877-9958-4bb5-a577-1f52be198653 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:01.429623 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-7e0ce877-9958-4bb5-a577-1f52be198653 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:01.431748 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1095/2192] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:17:01 2022] DELETE /identity/v3/projects/e74ea33c78a04b1bb7199fbc56a543a2 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:17:01.437043 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56cb6d0-a0e1-4fbd-b303-8dce925e581b None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:01.437273 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56cb6d0-a0e1-4fbd-b303-8dce925e581b None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:01.437553 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56cb6d0-a0e1-4fbd-b303-8dce925e581b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:01.462646 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-a56cb6d0-a0e1-4fbd-b303-8dce925e581b None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:17:01.464081 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-a56cb6d0-a0e1-4fbd-b303-8dce925e581b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:01.532243 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1098/2193] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:17:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 11:17:01.540295 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce091d8a-5156-4ec5-b2c6-14237ca4d8b1 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:01.540601 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce091d8a-5156-4ec5-b2c6-14237ca4d8b1 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:01.540861 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce091d8a-5156-4ec5-b2c6-14237ca4d8b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:01.562475 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-ce091d8a-5156-4ec5-b2c6-14237ca4d8b1 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:17:01.563751 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-ce091d8a-5156-4ec5-b2c6-14237ca4d8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:01.576325 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56cb6d0-a0e1-4fbd-b303-8dce925e581b None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:01.576881 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1096/2194] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:17:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:17:01.586896 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56cb6d0-a0e1-4fbd-b303-8dce925e581b None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:01.592131 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a941cb36-fbed-4a84-bc95-35f8e06506f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:01.592743 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a941cb36-fbed-4a84-bc95-35f8e06506f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:01.593020 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a941cb36-fbed-4a84-bc95-35f8e06506f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:01.593471 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a941cb36-fbed-4a84-bc95-35f8e06506f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:01.594177 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a941cb36-fbed-4a84-bc95-35f8e06506f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:17:01.594791 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a941cb36-fbed-4a84-bc95-35f8e06506f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:01.596417 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a941cb36-fbed-4a84-bc95-35f8e06506f9 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:01.612846 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1099/2195] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 11:17:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:17:01.614388 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce091d8a-5156-4ec5-b2c6-14237ca4d8b1 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:01.624551 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce091d8a-5156-4ec5-b2c6-14237ca4d8b1 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:01.629567 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0766c64-5db2-4e82-b251-a80a87fe817d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:01.630219 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0766c64-5db2-4e82-b251-a80a87fe817d admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:01.630512 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0766c64-5db2-4e82-b251-a80a87fe817d admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:01.630775 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0766c64-5db2-4e82-b251-a80a87fe817d admin admin] PATH_INFO: `/v3/projects` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:01.631474 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0766c64-5db2-4e82-b251-a80a87fe817d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:01.633332 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0766c64-5db2-4e82-b251-a80a87fe817d admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:01.673230 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1097/2196] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:17:01 2022] POST /identity/v3/projects => generated 381 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 11:17:01.676603 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a941cb36-fbed-4a84-bc95-35f8e06506f9 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:01.687596 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a941cb36-fbed-4a84-bc95-35f8e06506f9 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:01.774521 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a636d3b5-169f-414e-9906-a665858bc662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:01.775622 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636d3b5-169f-414e-9906-a665858bc662 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:01.776431 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636d3b5-169f-414e-9906-a665858bc662 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:01.776711 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636d3b5-169f-414e-9906-a665858bc662 admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:01.777996 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a636d3b5-169f-414e-9906-a665858bc662 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:01.780075 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a636d3b5-169f-414e-9906-a665858bc662 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:01.821513 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1100/2197] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:17:01 2022] POST /identity/v3/users => generated 291 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:17:01.823379 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0766c64-5db2-4e82-b251-a80a87fe817d admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:01.835680 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0766c64-5db2-4e82-b251-a80a87fe817d admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:01.842510 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ffdeb6-3f8e-4acf-b314-5292e8c503f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:01.847118 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ffdeb6-3f8e-4acf-b314-5292e8c503f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:01.847288 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ffdeb6-3f8e-4acf-b314-5292e8c503f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:01.847528 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ffdeb6-3f8e-4acf-b314-5292e8c503f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:01.848166 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ffdeb6-3f8e-4acf-b314-5292e8c503f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:01.849800 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ffdeb6-3f8e-4acf-b314-5292e8c503f1 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:01.864137 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1098/2198] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:17:01 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:17:01.867969 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a636d3b5-169f-414e-9906-a665858bc662 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:01.878580 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a636d3b5-169f-414e-9906-a665858bc662 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:01.900516 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a4a8e2-faf9-4e29-a9da-e7bb8c231c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:01.902249 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4a8e2-faf9-4e29-a9da-e7bb8c231c91 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:01.902745 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4a8e2-faf9-4e29-a9da-e7bb8c231c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:01.903361 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4a8e2-faf9-4e29-a9da-e7bb8c231c91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:01.904233 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a4a8e2-faf9-4e29-a9da-e7bb8c231c91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:01.906263 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a4a8e2-faf9-4e29-a9da-e7bb8c231c91 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:01.930145 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1101/2199] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:17:01 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:17:01.930980 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ffdeb6-3f8e-4acf-b314-5292e8c503f1 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:01.942425 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ffdeb6-3f8e-4acf-b314-5292e8c503f1 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:01.949892 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0a2b78-29dd-4683-a55d-7ad95c3c1fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:01.950604 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a2b78-29dd-4683-a55d-7ad95c3c1fe6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:01.950891 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a2b78-29dd-4683-a55d-7ad95c3c1fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:01.951349 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a2b78-29dd-4683-a55d-7ad95c3c1fe6 admin admin] PATH_INFO: `/v3/projects/3e0e4212f85b42b49e62e40585aa446c/users/d73f908c9dad4dfa8eabe9633584ccf1/roles/7c3871c0ab68438b9014489d50b53a22` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:01.969244 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0a2b78-29dd-4683-a55d-7ad95c3c1fe6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e0e4212f85b42b49e62e40585aa446c, user_id=d73f908c9dad4dfa8eabe9633584ccf1, role_id=7c3871c0ab68438b9014489d50b53a22)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:01.971938 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0a2b78-29dd-4683-a55d-7ad95c3c1fe6 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:01.985502 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1099/2200] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:17:01 2022] PUT /identity/v3/projects/3e0e4212f85b42b49e62e40585aa446c/users/d73f908c9dad4dfa8eabe9633584ccf1/roles/7c3871c0ab68438b9014489d50b53a22 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:17:01.997165 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ebfa4c-1d6b-4bb5-9f7a-7240735cbab9 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:01.997358 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ebfa4c-1d6b-4bb5-9f7a-7240735cbab9 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:01.997593 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ebfa4c-1d6b-4bb5-9f7a-7240735cbab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:02.027604 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-97ebfa4c-1d6b-4bb5-9f7a-7240735cbab9 None None] MFA Rules not processed for user `d73f908c9dad4dfa8eabe9633584ccf1`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:17:02.028748 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-97ebfa4c-1d6b-4bb5-9f7a-7240735cbab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:02.074674 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:17:02.105072 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1102/2201] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:17:01 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:17:02.109495 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0a2b78-29dd-4683-a55d-7ad95c3c1fe6 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:02.179449 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0a2b78-29dd-4683-a55d-7ad95c3c1fe6 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:02.185567 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fc2775-81a4-49eb-86c1-8f2cfd1b5759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:02.186212 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc2775-81a4-49eb-86c1-8f2cfd1b5759 admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:02.186495 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc2775-81a4-49eb-86c1-8f2cfd1b5759 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:02.186771 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc2775-81a4-49eb-86c1-8f2cfd1b5759 admin admin] PATH_INFO: `/v3/projects` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:02.187565 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fc2775-81a4-49eb-86c1-8f2cfd1b5759 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:02.189583 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fc2775-81a4-49eb-86c1-8f2cfd1b5759 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:02.202585 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:17:02.228701 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1100/2202] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:17:02 2022] POST /identity/v3/projects => generated 383 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:17:02.230387 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ebfa4c-1d6b-4bb5-9f7a-7240735cbab9 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:02.241761 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ebfa4c-1d6b-4bb5-9f7a-7240735cbab9 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:02.308257 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1a6a52-7eb2-43f3-95d7-0c3bd39a5ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:02.309233 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a6a52-7eb2-43f3-95d7-0c3bd39a5ed8 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:02.309752 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a6a52-7eb2-43f3-95d7-0c3bd39a5ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:02.310066 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a6a52-7eb2-43f3-95d7-0c3bd39a5ed8 admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:02.310772 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1a6a52-7eb2-43f3-95d7-0c3bd39a5ed8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:02.313377 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1a6a52-7eb2-43f3-95d7-0c3bd39a5ed8 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:02.336848 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1103/2203] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:17:02 2022] POST /identity/v3/users => generated 298 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 11:17:02.339862 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fc2775-81a4-49eb-86c1-8f2cfd1b5759 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:02.350370 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fc2775-81a4-49eb-86c1-8f2cfd1b5759 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:02.355312 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fee34c-3e54-4b27-ad9d-03af0ed111f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:02.355923 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fee34c-3e54-4b27-ad9d-03af0ed111f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:02.356211 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fee34c-3e54-4b27-ad9d-03af0ed111f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:02.356486 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fee34c-3e54-4b27-ad9d-03af0ed111f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:02.357132 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fee34c-3e54-4b27-ad9d-03af0ed111f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:02.358836 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fee34c-3e54-4b27-ad9d-03af0ed111f4 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:02.371121 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1101/2204] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:17:02.375251 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1a6a52-7eb2-43f3-95d7-0c3bd39a5ed8 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:02.386654 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1a6a52-7eb2-43f3-95d7-0c3bd39a5ed8 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:02.391979 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcafb65-007c-46f4-af81-706dec997c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:02.392614 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcafb65-007c-46f4-af81-706dec997c58 admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:02.392893 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcafb65-007c-46f4-af81-706dec997c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:02.393166 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcafb65-007c-46f4-af81-706dec997c58 admin admin] PATH_INFO: `/v3/projects/6a7f3e214c124144a3d02f68ea9a0645/users/2f8ea5b763ab42489608bbd79ff201c8/roles/ea564961b1db4eb4a1d4d880964611b2` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:02.408699 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcafb65-007c-46f4-af81-706dec997c58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a7f3e214c124144a3d02f68ea9a0645, user_id=2f8ea5b763ab42489608bbd79ff201c8, role_id=ea564961b1db4eb4a1d4d880964611b2)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:02.411403 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcafb65-007c-46f4-af81-706dec997c58 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:02.423745 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1104/2205] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:17:02 2022] PUT /identity/v3/projects/6a7f3e214c124144a3d02f68ea9a0645/users/2f8ea5b763ab42489608bbd79ff201c8/roles/ea564961b1db4eb4a1d4d880964611b2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:17:02.429162 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fee34c-3e54-4b27-ad9d-03af0ed111f4 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:02.440381 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fee34c-3e54-4b27-ad9d-03af0ed111f4 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:02.498564 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa694363-cb2d-4b7e-a6df-9d2e29d3e0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:02.499180 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa694363-cb2d-4b7e-a6df-9d2e29d3e0b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:02.499464 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa694363-cb2d-4b7e-a6df-9d2e29d3e0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:02.499829 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa694363-cb2d-4b7e-a6df-9d2e29d3e0b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:02.500389 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa694363-cb2d-4b7e-a6df-9d2e29d3e0b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:02.502252 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa694363-cb2d-4b7e-a6df-9d2e29d3e0b9 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:02.516378 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1102/2206] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:17:02.517543 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcafb65-007c-46f4-af81-706dec997c58 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:02.528841 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcafb65-007c-46f4-af81-706dec997c58 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:02.535485 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12871244-53ff-4d62-a820-0052128a59a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:02.536166 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12871244-53ff-4d62-a820-0052128a59a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:02.536444 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12871244-53ff-4d62-a820-0052128a59a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:02.536742 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12871244-53ff-4d62-a820-0052128a59a7 admin admin] PATH_INFO: `/v3/projects/6a7f3e214c124144a3d02f68ea9a0645/users/2f8ea5b763ab42489608bbd79ff201c8/roles/ea564961b1db4eb4a1d4d880964611b2` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:02.538742 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12871244-53ff-4d62-a820-0052128a59a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a7f3e214c124144a3d02f68ea9a0645, user_id=2f8ea5b763ab42489608bbd79ff201c8, role_id=ea564961b1db4eb4a1d4d880964611b2)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:02.541452 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12871244-53ff-4d62-a820-0052128a59a7 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:02.552604 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1105/2207] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:17:02 2022] PUT /identity/v3/projects/6a7f3e214c124144a3d02f68ea9a0645/users/2f8ea5b763ab42489608bbd79ff201c8/roles/ea564961b1db4eb4a1d4d880964611b2 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:17:02.563579 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef677002-1334-49b2-80fd-f63a5cbd977e None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:02.563862 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef677002-1334-49b2-80fd-f63a5cbd977e None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:02.564141 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef677002-1334-49b2-80fd-f63a5cbd977e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:02.621245 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-ef677002-1334-49b2-80fd-f63a5cbd977e None None] MFA Rules not processed for user `2f8ea5b763ab42489608bbd79ff201c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:17:02.623218 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-ef677002-1334-49b2-80fd-f63a5cbd977e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:02.722214 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1103/2208] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:17:02 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:17:02.733671 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12871244-53ff-4d62-a820-0052128a59a7 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:02.735396 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-12871244-53ff-4d62-a820-0052128a59a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:02.793898 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12871244-53ff-4d62-a820-0052128a59a7 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:02.797592 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea65a26-03fd-417e-9020-59acb958e006 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f4c2fc51f54f0e977648b13efaed1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:02.798228 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea65a26-03fd-417e-9020-59acb958e006 service cinder] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:02.798512 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea65a26-03fd-417e-9020-59acb958e006 service cinder] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:02.798791 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea65a26-03fd-417e-9020-59acb958e006 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:02.809446 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea65a26-03fd-417e-9020-59acb958e006 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:02.810914 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea65a26-03fd-417e-9020-59acb958e006 service cinder] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:02.820425 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1106/2209] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:17:02 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:17:02.927346 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef677002-1334-49b2-80fd-f63a5cbd977e None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:02.937535 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef677002-1334-49b2-80fd-f63a5cbd977e None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:02.941268 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76133290-8db0-4449-8585-ad9a28204eb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f4c2fc51f54f0e977648b13efaed1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:02.941877 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76133290-8db0-4449-8585-ad9a28204eb4 service cinder] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:02.942202 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76133290-8db0-4449-8585-ad9a28204eb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:02.942478 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76133290-8db0-4449-8585-ad9a28204eb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:02.999188 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76133290-8db0-4449-8585-ad9a28204eb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:03.000625 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76133290-8db0-4449-8585-ad9a28204eb4 service cinder] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:03.004585 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:17:03.012099 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1104/2210] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:17:02 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:17:04.277775 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea65a26-03fd-417e-9020-59acb958e006 service cinder] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:04.279200 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-7ea65a26-03fd-417e-9020-59acb958e006 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:04.325957 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:17:04.338822 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea65a26-03fd-417e-9020-59acb958e006 service cinder] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:04.342539 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a0c774-875e-4fa5-a9a1-fbf3c2e56677 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:04.343143 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a0c774-875e-4fa5-a9a1-fbf3c2e56677 service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:04.343420 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a0c774-875e-4fa5-a9a1-fbf3c2e56677 service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:04.343691 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a0c774-875e-4fa5-a9a1-fbf3c2e56677 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:04.345410 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-19a0c774-875e-4fa5-a9a1-fbf3c2e56677 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:04.411452 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a0c774-875e-4fa5-a9a1-fbf3c2e56677 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:04.412875 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a0c774-875e-4fa5-a9a1-fbf3c2e56677 service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:04.424257 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1107/2211] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:17:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:17:05.608552 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76133290-8db0-4449-8585-ad9a28204eb4 service cinder] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:05.622782 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76133290-8db0-4449-8585-ad9a28204eb4 service cinder] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:05.627821 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d65c72-13ea-4444-bb12-a3aaa92f4c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:05.628712 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d65c72-13ea-4444-bb12-a3aaa92f4c21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:05.629084 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d65c72-13ea-4444-bb12-a3aaa92f4c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:05.629461 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d65c72-13ea-4444-bb12-a3aaa92f4c21 admin admin] PATH_INFO: `/v3/users/d73f908c9dad4dfa8eabe9633584ccf1` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:05.630925 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d65c72-13ea-4444-bb12-a3aaa92f4c21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d73f908c9dad4dfa8eabe9633584ccf1)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:05.633108 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d65c72-13ea-4444-bb12-a3aaa92f4c21 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:05.697393 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-30d65c72-13ea-4444-bb12-a3aaa92f4c21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd73f908c9dad4dfa8eabe9633584ccf1'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:05.707552 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-30d65c72-13ea-4444-bb12-a3aaa92f4c21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd73f908c9dad4dfa8eabe9633584ccf1'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:05.708274 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-30d65c72-13ea-4444-bb12-a3aaa92f4c21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd73f908c9dad4dfa8eabe9633584ccf1'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:05.708932 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-30d65c72-13ea-4444-bb12-a3aaa92f4c21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd73f908c9dad4dfa8eabe9633584ccf1'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:05.717141 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-30d65c72-13ea-4444-bb12-a3aaa92f4c21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd73f908c9dad4dfa8eabe9633584ccf1'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:05.743606 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1105/2212] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:17:05 2022] DELETE /identity/v3/users/d73f908c9dad4dfa8eabe9633584ccf1 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:17:05.748426 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55d1c6-d0dc-4fcc-a142-1f1feb1ca11a None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:05.749339 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55d1c6-d0dc-4fcc-a142-1f1feb1ca11a None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:05.749771 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55d1c6-d0dc-4fcc-a142-1f1feb1ca11a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:05.777383 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-ed55d1c6-d0dc-4fcc-a142-1f1feb1ca11a None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:17:05.778953 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-ed55d1c6-d0dc-4fcc-a142-1f1feb1ca11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:05.848750 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1108/2213] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:17:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:17:05.858870 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d65c72-13ea-4444-bb12-a3aaa92f4c21 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:05.860757 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-30d65c72-13ea-4444-bb12-a3aaa92f4c21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:05.934141 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d65c72-13ea-4444-bb12-a3aaa92f4c21 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:05.938522 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec6b9fa-88b8-4747-9def-7c6cf0d0cbe5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:05.939348 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec6b9fa-88b8-4747-9def-7c6cf0d0cbe5 service neutron] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:05.939630 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec6b9fa-88b8-4747-9def-7c6cf0d0cbe5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:05.939905 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec6b9fa-88b8-4747-9def-7c6cf0d0cbe5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:05.951173 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec6b9fa-88b8-4747-9def-7c6cf0d0cbe5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:05.952795 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec6b9fa-88b8-4747-9def-7c6cf0d0cbe5 service neutron] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:05.966120 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1106/2214] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:17:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:17:06.342118 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed55d1c6-d0dc-4fcc-a142-1f1feb1ca11a None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:06.343623 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-ed55d1c6-d0dc-4fcc-a142-1f1feb1ca11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:06.365798 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed55d1c6-d0dc-4fcc-a142-1f1feb1ca11a None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:06.381621 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9066009-8464-4006-8bf4-36731678b3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:06.382293 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9066009-8464-4006-8bf4-36731678b3f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:06.382569 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9066009-8464-4006-8bf4-36731678b3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:06.383199 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9066009-8464-4006-8bf4-36731678b3f4 admin admin] PATH_INFO: `/v3/projects/3e0e4212f85b42b49e62e40585aa446c` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:06.384012 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9066009-8464-4006-8bf4-36731678b3f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e0e4212f85b42b49e62e40585aa446c)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:06.386415 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9066009-8464-4006-8bf4-36731678b3f4 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:06.443878 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-d9066009-8464-4006-8bf4-36731678b3f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e0e4212f85b42b49e62e40585aa446c', 'request_id': 'req-d9066009-8464-4006-8bf4-36731678b3f4'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:06.459344 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-d9066009-8464-4006-8bf4-36731678b3f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e0e4212f85b42b49e62e40585aa446c', 'request_id': 'req-d9066009-8464-4006-8bf4-36731678b3f4'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:06.468525 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-d9066009-8464-4006-8bf4-36731678b3f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e0e4212f85b42b49e62e40585aa446c', 'request_id': 'req-d9066009-8464-4006-8bf4-36731678b3f4'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:06.480043 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-d9066009-8464-4006-8bf4-36731678b3f4 admin admin] The token cache is being invalidate because project 3e0e4212f85b42b49e62e40585aa446c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:17:06.480338 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-d9066009-8464-4006-8bf4-36731678b3f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:06.481136 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-d9066009-8464-4006-8bf4-36731678b3f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:06.483188 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1109/2215] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:17:06 2022] DELETE /identity/v3/projects/3e0e4212f85b42b49e62e40585aa446c => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:17:06.487218 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec6b9fa-88b8-4747-9def-7c6cf0d0cbe5 service neutron] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:06.498371 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec6b9fa-88b8-4747-9def-7c6cf0d0cbe5 service neutron] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:06.566839 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddca212-de69-4048-b6b5-cce1cff84c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:06.567502 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddca212-de69-4048-b6b5-cce1cff84c51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:06.567784 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddca212-de69-4048-b6b5-cce1cff84c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:06.568059 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddca212-de69-4048-b6b5-cce1cff84c51 admin admin] PATH_INFO: `/v3/users/2f8ea5b763ab42489608bbd79ff201c8` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:06.569181 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddca212-de69-4048-b6b5-cce1cff84c51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f8ea5b763ab42489608bbd79ff201c8)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:06.571115 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddca212-de69-4048-b6b5-cce1cff84c51 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:06.585306 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:17:06.621827 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-dddca212-de69-4048-b6b5-cce1cff84c51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f8ea5b763ab42489608bbd79ff201c8'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:06.629263 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-dddca212-de69-4048-b6b5-cce1cff84c51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f8ea5b763ab42489608bbd79ff201c8'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:06.630145 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-dddca212-de69-4048-b6b5-cce1cff84c51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f8ea5b763ab42489608bbd79ff201c8'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:06.630926 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-dddca212-de69-4048-b6b5-cce1cff84c51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f8ea5b763ab42489608bbd79ff201c8'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:06.640826 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-dddca212-de69-4048-b6b5-cce1cff84c51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f8ea5b763ab42489608bbd79ff201c8'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:06.659722 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1107/2216] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:17:06 2022] DELETE /identity/v3/users/2f8ea5b763ab42489608bbd79ff201c8 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:17:07.019172 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9066009-8464-4006-8bf4-36731678b3f4 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:07.021454 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-d9066009-8464-4006-8bf4-36731678b3f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:07.039557 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9066009-8464-4006-8bf4-36731678b3f4 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:07.052452 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:17:07.102590 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c4f47-890b-4b45-aa70-ec473adf062f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:07.103240 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c4f47-890b-4b45-aa70-ec473adf062f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:07.103520 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c4f47-890b-4b45-aa70-ec473adf062f admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:07.103833 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c4f47-890b-4b45-aa70-ec473adf062f admin admin] PATH_INFO: `/v3/projects/6a7f3e214c124144a3d02f68ea9a0645` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:07.104993 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2c4f47-890b-4b45-aa70-ec473adf062f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a7f3e214c124144a3d02f68ea9a0645)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:07.106953 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2c4f47-890b-4b45-aa70-ec473adf062f admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:07.176396 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-1a2c4f47-890b-4b45-aa70-ec473adf062f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a7f3e214c124144a3d02f68ea9a0645', 'request_id': 'req-1a2c4f47-890b-4b45-aa70-ec473adf062f'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:07.191572 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-1a2c4f47-890b-4b45-aa70-ec473adf062f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a7f3e214c124144a3d02f68ea9a0645', 'request_id': 'req-1a2c4f47-890b-4b45-aa70-ec473adf062f'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:07.202337 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-1a2c4f47-890b-4b45-aa70-ec473adf062f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a7f3e214c124144a3d02f68ea9a0645', 'request_id': 'req-1a2c4f47-890b-4b45-aa70-ec473adf062f'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:07.227894 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-1a2c4f47-890b-4b45-aa70-ec473adf062f admin admin] The token cache is being invalidate because project 6a7f3e214c124144a3d02f68ea9a0645 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:17:07.228282 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-1a2c4f47-890b-4b45-aa70-ec473adf062f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:07.229505 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-1a2c4f47-890b-4b45-aa70-ec473adf062f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:07.231774 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1110/2217] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:17:07 2022] DELETE /identity/v3/projects/6a7f3e214c124144a3d02f68ea9a0645 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:17:07.236313 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b5bd3-8f79-4fce-8b33-531b46f6d2cc None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:07.236608 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b5bd3-8f79-4fce-8b33-531b46f6d2cc None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:07.236911 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b5bd3-8f79-4fce-8b33-531b46f6d2cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:07.263739 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-540b5bd3-8f79-4fce-8b33-531b46f6d2cc None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:17:07.265387 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-540b5bd3-8f79-4fce-8b33-531b46f6d2cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:07.354350 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1108/2218] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:17:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:17:07.362380 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c77f8-2961-432c-9b0f-70f7850eb030 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:07.362613 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c77f8-2961-432c-9b0f-70f7850eb030 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:07.362823 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c77f8-2961-432c-9b0f-70f7850eb030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:07.395896 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-b09c77f8-2961-432c-9b0f-70f7850eb030 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:17:07.397670 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-b09c77f8-2961-432c-9b0f-70f7850eb030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:07.417921 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1111/2219] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:17:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:17:07.421869 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b5bd3-8f79-4fce-8b33-531b46f6d2cc None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:07.434251 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b5bd3-8f79-4fce-8b33-531b46f6d2cc None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:07.439290 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2a301d-6f06-4829-b361-1ca41cc7ebcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:07.440114 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a301d-6f06-4829-b361-1ca41cc7ebcc admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:07.440487 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a301d-6f06-4829-b361-1ca41cc7ebcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:07.440846 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a301d-6f06-4829-b361-1ca41cc7ebcc admin admin] PATH_INFO: `/v3/domains` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:07.441694 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2a301d-6f06-4829-b361-1ca41cc7ebcc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:17:07.442169 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2a301d-6f06-4829-b361-1ca41cc7ebcc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:07.443860 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2a301d-6f06-4829-b361-1ca41cc7ebcc admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:07.459622 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1109/2220] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 11:17:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:17:07.460957 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c77f8-2961-432c-9b0f-70f7850eb030 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:07.471036 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c77f8-2961-432c-9b0f-70f7850eb030 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:07.475980 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a14ca2-1834-4d43-b780-a45a411d7179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:07.476982 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a14ca2-1834-4d43-b780-a45a411d7179 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:07.477170 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a14ca2-1834-4d43-b780-a45a411d7179 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:07.477505 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a14ca2-1834-4d43-b780-a45a411d7179 admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:07.478290 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a14ca2-1834-4d43-b780-a45a411d7179 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:07.480800 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a14ca2-1834-4d43-b780-a45a411d7179 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:07.514404 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1112/2221] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:17:07 2022] POST /identity/v3/projects => generated 367 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:17:07.516015 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2a301d-6f06-4829-b361-1ca41cc7ebcc admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:07.535591 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2a301d-6f06-4829-b361-1ca41cc7ebcc admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:07.616769 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be9eaf3-10e4-402f-b48c-80695256ad1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:07.617690 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be9eaf3-10e4-402f-b48c-80695256ad1c admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:07.618150 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be9eaf3-10e4-402f-b48c-80695256ad1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:07.618711 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be9eaf3-10e4-402f-b48c-80695256ad1c admin admin] PATH_INFO: `/v3/users` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:07.619596 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be9eaf3-10e4-402f-b48c-80695256ad1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:07.622440 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be9eaf3-10e4-402f-b48c-80695256ad1c admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:07.657795 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1110/2222] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:17:07 2022] POST /identity/v3/users => generated 284 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:17:07.663224 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a14ca2-1834-4d43-b780-a45a411d7179 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:07.686974 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a14ca2-1834-4d43-b780-a45a411d7179 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:07.692611 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a873c847-65ae-49b1-a37b-413af31a7dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:07.693236 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a873c847-65ae-49b1-a37b-413af31a7dc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:07.693501 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a873c847-65ae-49b1-a37b-413af31a7dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:07.693778 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a873c847-65ae-49b1-a37b-413af31a7dc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:07.694548 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a873c847-65ae-49b1-a37b-413af31a7dc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:07.697932 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a873c847-65ae-49b1-a37b-413af31a7dc8 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:07.709004 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1113/2223] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:17:07 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:17:07.714658 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be9eaf3-10e4-402f-b48c-80695256ad1c admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:07.730087 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be9eaf3-10e4-402f-b48c-80695256ad1c admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:07.736015 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d776e0-b91d-4c52-9666-ad9c5778005d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:07.736860 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d776e0-b91d-4c52-9666-ad9c5778005d admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:07.737252 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d776e0-b91d-4c52-9666-ad9c5778005d admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:07.737601 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d776e0-b91d-4c52-9666-ad9c5778005d admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:07.738526 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d776e0-b91d-4c52-9666-ad9c5778005d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:07.740245 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d776e0-b91d-4c52-9666-ad9c5778005d admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:07.742972 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:17:07.760053 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a873c847-65ae-49b1-a37b-413af31a7dc8 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:07.765478 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1111/2224] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:17:07 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:17:07.770855 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a873c847-65ae-49b1-a37b-413af31a7dc8 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:07.783350 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff2e3cd-2537-40d7-9100-70b8396147a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:07.783707 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2e3cd-2537-40d7-9100-70b8396147a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:07.783984 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2e3cd-2537-40d7-9100-70b8396147a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:07.784250 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2e3cd-2537-40d7-9100-70b8396147a6 admin admin] PATH_INFO: `/v3/projects/e5c492878a4d427b8a0f51483bcf9f70/users/b20c1f948ede4f81a6d27eaf1f72d92b/roles/7c3871c0ab68438b9014489d50b53a22` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:07.803461 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff2e3cd-2537-40d7-9100-70b8396147a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5c492878a4d427b8a0f51483bcf9f70, user_id=b20c1f948ede4f81a6d27eaf1f72d92b, role_id=7c3871c0ab68438b9014489d50b53a22)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:07.806474 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff2e3cd-2537-40d7-9100-70b8396147a6 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:07.826246 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1114/2225] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:17:07 2022] PUT /identity/v3/projects/e5c492878a4d427b8a0f51483bcf9f70/users/b20c1f948ede4f81a6d27eaf1f72d92b/roles/7c3871c0ab68438b9014489d50b53a22 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:17:07.837624 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8248acb3-b935-423c-8913-fb2360525948 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:07.837918 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8248acb3-b935-423c-8913-fb2360525948 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:07.838709 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8248acb3-b935-423c-8913-fb2360525948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:07.848270 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff2e3cd-2537-40d7-9100-70b8396147a6 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:07.850019 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-1ff2e3cd-2537-40d7-9100-70b8396147a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:07.886030 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-8248acb3-b935-423c-8913-fb2360525948 None None] MFA Rules not processed for user `b20c1f948ede4f81a6d27eaf1f72d92b`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:17:07.892980 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-8248acb3-b935-423c-8913-fb2360525948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:07.928549 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:17:07.964854 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff2e3cd-2537-40d7-9100-70b8396147a6 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:07.977544 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed35cd3-9a82-4c48-a058-429dcbfd3fb3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed4bb75e68a640fc92ddd47fad61a25a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:07.978339 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed35cd3-9a82-4c48-a058-429dcbfd3fb3 service placement] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:07.978865 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed35cd3-9a82-4c48-a058-429dcbfd3fb3 service placement] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:07.979298 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed35cd3-9a82-4c48-a058-429dcbfd3fb3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:07.981304 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-1ed35cd3-9a82-4c48-a058-429dcbfd3fb3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:07.990879 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1112/2226] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:17:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:17:07.995336 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8248acb3-b935-423c-8913-fb2360525948 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:07.995482 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed35cd3-9a82-4c48-a058-429dcbfd3fb3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:07.997161 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed35cd3-9a82-4c48-a058-429dcbfd3fb3 service placement] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:08.008499 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1115/2227] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:17:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 13 11:17:08.073197 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8248acb3-b935-423c-8913-fb2360525948 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:08.078310 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a146f20e-ba01-4a3d-87df-4234c3279ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:08.078917 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146f20e-ba01-4a3d-87df-4234c3279ef1 admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:08.079193 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146f20e-ba01-4a3d-87df-4234c3279ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:08.079467 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146f20e-ba01-4a3d-87df-4234c3279ef1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:08.080105 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a146f20e-ba01-4a3d-87df-4234c3279ef1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:08.082073 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a146f20e-ba01-4a3d-87df-4234c3279ef1 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:08.112695 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1113/2228] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:17:07 2022] POST /identity/v3/projects => generated 367 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 11:17:08.113896 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed35cd3-9a82-4c48-a058-429dcbfd3fb3 service placement] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:08.124721 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed35cd3-9a82-4c48-a058-429dcbfd3fb3 service placement] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:08.182890 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a347823-158c-468d-9eb6-b92a12fecd6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:08.183506 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a347823-158c-468d-9eb6-b92a12fecd6a admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:08.183786 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a347823-158c-468d-9eb6-b92a12fecd6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:08.184059 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a347823-158c-468d-9eb6-b92a12fecd6a admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:08.184720 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a347823-158c-468d-9eb6-b92a12fecd6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:08.186696 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a347823-158c-468d-9eb6-b92a12fecd6a admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:08.209193 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1116/2229] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:17:08 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 11:17:08.214159 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a146f20e-ba01-4a3d-87df-4234c3279ef1 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:08.224372 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a146f20e-ba01-4a3d-87df-4234c3279ef1 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:08.229001 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92557c7-baaa-4797-b659-878d5b8d3d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:08.229598 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92557c7-baaa-4797-b659-878d5b8d3d86 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:08.229878 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92557c7-baaa-4797-b659-878d5b8d3d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:08.230180 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92557c7-baaa-4797-b659-878d5b8d3d86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:08.230821 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92557c7-baaa-4797-b659-878d5b8d3d86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:08.232408 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92557c7-baaa-4797-b659-878d5b8d3d86 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:08.242530 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1114/2230] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:17:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:17:08.246499 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a347823-158c-468d-9eb6-b92a12fecd6a admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:08.256850 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a347823-158c-468d-9eb6-b92a12fecd6a admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:08.262830 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7ed7c7-a94e-435e-adda-4a6bce710a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:08.263577 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ed7c7-a94e-435e-adda-4a6bce710a7c admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:08.263928 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ed7c7-a94e-435e-adda-4a6bce710a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:08.264271 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ed7c7-a94e-435e-adda-4a6bce710a7c admin admin] PATH_INFO: `/v3/projects/dd67767f4094452e9a993956d298efdf/users/5014142fa3c94fb5ab014cb7bbb21117/roles/ea564961b1db4eb4a1d4d880964611b2` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:08.279670 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7ed7c7-a94e-435e-adda-4a6bce710a7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd67767f4094452e9a993956d298efdf, user_id=5014142fa3c94fb5ab014cb7bbb21117, role_id=ea564961b1db4eb4a1d4d880964611b2)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:08.282526 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7ed7c7-a94e-435e-adda-4a6bce710a7c admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:08.295479 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1117/2231] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:17:08 2022] PUT /identity/v3/projects/dd67767f4094452e9a993956d298efdf/users/5014142fa3c94fb5ab014cb7bbb21117/roles/ea564961b1db4eb4a1d4d880964611b2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:17:08.299479 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92557c7-baaa-4797-b659-878d5b8d3d86 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:08.310580 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92557c7-baaa-4797-b659-878d5b8d3d86 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:08.368141 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c74847-7e76-4233-87f1-952474156fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:08.368753 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c74847-7e76-4233-87f1-952474156fb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:08.369029 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c74847-7e76-4233-87f1-952474156fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:08.369800 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c74847-7e76-4233-87f1-952474156fb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:08.370605 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c74847-7e76-4233-87f1-952474156fb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:08.372183 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c74847-7e76-4233-87f1-952474156fb4 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:08.374208 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:17:08.383149 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1115/2232] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:17:08 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:17:08.387793 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7ed7c7-a94e-435e-adda-4a6bce710a7c admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:08.398083 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7ed7c7-a94e-435e-adda-4a6bce710a7c admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:08.402784 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ef3d61-df3e-4332-a2e1-d662b675a443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:08.403431 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ef3d61-df3e-4332-a2e1-d662b675a443 admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:08.403709 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ef3d61-df3e-4332-a2e1-d662b675a443 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:08.403982 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ef3d61-df3e-4332-a2e1-d662b675a443 admin admin] PATH_INFO: `/v3/projects/dd67767f4094452e9a993956d298efdf/users/5014142fa3c94fb5ab014cb7bbb21117/roles/ea564961b1db4eb4a1d4d880964611b2` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:08.405926 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ef3d61-df3e-4332-a2e1-d662b675a443 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd67767f4094452e9a993956d298efdf, user_id=5014142fa3c94fb5ab014cb7bbb21117, role_id=ea564961b1db4eb4a1d4d880964611b2)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:08.408581 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ef3d61-df3e-4332-a2e1-d662b675a443 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:08.419446 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1118/2233] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:17:08 2022] PUT /identity/v3/projects/dd67767f4094452e9a993956d298efdf/users/5014142fa3c94fb5ab014cb7bbb21117/roles/ea564961b1db4eb4a1d4d880964611b2 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:17:08.429506 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d742a6-7ffe-476b-a222-49c24ed10343 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:08.429816 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d742a6-7ffe-476b-a222-49c24ed10343 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:08.430174 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d742a6-7ffe-476b-a222-49c24ed10343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:08.459303 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-e4d742a6-7ffe-476b-a222-49c24ed10343 None None] MFA Rules not processed for user `5014142fa3c94fb5ab014cb7bbb21117`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:17:08.460545 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-e4d742a6-7ffe-476b-a222-49c24ed10343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:08.530247 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1116/2234] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:17:08 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 11:17:08.541767 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ef3d61-df3e-4332-a2e1-d662b675a443 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:08.543617 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-82ef3d61-df3e-4332-a2e1-d662b675a443 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:08.606327 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ef3d61-df3e-4332-a2e1-d662b675a443 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:08.610175 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f3dcdd-7f56-4da0-9f02-84d8704aff65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f4c2fc51f54f0e977648b13efaed1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:08.610781 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f3dcdd-7f56-4da0-9f02-84d8704aff65 service cinder] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:08.611057 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f3dcdd-7f56-4da0-9f02-84d8704aff65 service cinder] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:08.611331 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f3dcdd-7f56-4da0-9f02-84d8704aff65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:08.620842 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f3dcdd-7f56-4da0-9f02-84d8704aff65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:08.622208 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f3dcdd-7f56-4da0-9f02-84d8704aff65 service cinder] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:08.632762 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1119/2235] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:17:08 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 13 11:17:08.714760 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d742a6-7ffe-476b-a222-49c24ed10343 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:08.725280 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d742a6-7ffe-476b-a222-49c24ed10343 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:08.729693 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b40031-b0f4-4f79-9a1b-0a86eadf7c5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f4c2fc51f54f0e977648b13efaed1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:08.730329 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b40031-b0f4-4f79-9a1b-0a86eadf7c5a service cinder] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:08.730614 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b40031-b0f4-4f79-9a1b-0a86eadf7c5a service cinder] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:08.730890 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b40031-b0f4-4f79-9a1b-0a86eadf7c5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:08.788898 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b40031-b0f4-4f79-9a1b-0a86eadf7c5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:08.790407 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b40031-b0f4-4f79-9a1b-0a86eadf7c5a service cinder] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:08.800307 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1117/2236] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:17:08 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:17:12.178146 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f3dcdd-7f56-4da0-9f02-84d8704aff65 service cinder] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:12.180762 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-d7f3dcdd-7f56-4da0-9f02-84d8704aff65 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:12.227887 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:17:12.260737 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f3dcdd-7f56-4da0-9f02-84d8704aff65 service cinder] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:12.266107 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b53b32f-b860-4107-adf0-e68663e60821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:12.267769 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53b32f-b860-4107-adf0-e68663e60821 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:12.268207 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53b32f-b860-4107-adf0-e68663e60821 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:12.268685 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53b32f-b860-4107-adf0-e68663e60821 admin admin] PATH_INFO: `/v3/users/54e3ec4a20454c2d8d65bef20b322782` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:12.270011 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b53b32f-b860-4107-adf0-e68663e60821 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54e3ec4a20454c2d8d65bef20b322782)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:12.272789 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b53b32f-b860-4107-adf0-e68663e60821 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:12.332165 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-8b53b32f-b860-4107-adf0-e68663e60821 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54e3ec4a20454c2d8d65bef20b322782'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:12.332857 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-8b53b32f-b860-4107-adf0-e68663e60821 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54e3ec4a20454c2d8d65bef20b322782'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:12.333890 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-8b53b32f-b860-4107-adf0-e68663e60821 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54e3ec4a20454c2d8d65bef20b322782'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:12.351715 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-8b53b32f-b860-4107-adf0-e68663e60821 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54e3ec4a20454c2d8d65bef20b322782'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:12.360065 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-8b53b32f-b860-4107-adf0-e68663e60821 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54e3ec4a20454c2d8d65bef20b322782'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:12.375532 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1120/2237] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:17:12 2022] DELETE /identity/v3/users/54e3ec4a20454c2d8d65bef20b322782 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:17:12.561283 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b40031-b0f4-4f79-9a1b-0a86eadf7c5a service cinder] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:12.573033 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b40031-b0f4-4f79-9a1b-0a86eadf7c5a service cinder] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:12.678460 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0665322c-012e-4f73-9abb-e6ed884488a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:12.679101 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0665322c-012e-4f73-9abb-e6ed884488a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:12.679524 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0665322c-012e-4f73-9abb-e6ed884488a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:12.679809 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0665322c-012e-4f73-9abb-e6ed884488a8 admin admin] PATH_INFO: `/v3/projects/363cc01a748f4031b0d7b79675108caf` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:12.681165 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0665322c-012e-4f73-9abb-e6ed884488a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=363cc01a748f4031b0d7b79675108caf)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:12.683273 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0665322c-012e-4f73-9abb-e6ed884488a8 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:12.712206 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:17:12.739969 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-0665322c-012e-4f73-9abb-e6ed884488a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '363cc01a748f4031b0d7b79675108caf', 'request_id': 'req-0665322c-012e-4f73-9abb-e6ed884488a8'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:12.746917 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-0665322c-012e-4f73-9abb-e6ed884488a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '363cc01a748f4031b0d7b79675108caf', 'request_id': 'req-0665322c-012e-4f73-9abb-e6ed884488a8'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:12.753245 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-0665322c-012e-4f73-9abb-e6ed884488a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '363cc01a748f4031b0d7b79675108caf', 'request_id': 'req-0665322c-012e-4f73-9abb-e6ed884488a8'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:12.767529 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-0665322c-012e-4f73-9abb-e6ed884488a8 admin admin] The token cache is being invalidate because project 363cc01a748f4031b0d7b79675108caf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:17:12.767827 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-0665322c-012e-4f73-9abb-e6ed884488a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:12.768563 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-0665322c-012e-4f73-9abb-e6ed884488a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:12.770083 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1118/2238] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:17:12 2022] DELETE /identity/v3/projects/363cc01a748f4031b0d7b79675108caf => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:17:12.774173 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b53b32f-b860-4107-adf0-e68663e60821 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:12.776170 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-8b53b32f-b860-4107-adf0-e68663e60821 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:12.789257 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b53b32f-b860-4107-adf0-e68663e60821 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:12.862798 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac5946e-3eb6-4265-ab6b-f89a0e9dfa5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:12.863490 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5946e-3eb6-4265-ab6b-f89a0e9dfa5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:12.863761 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5946e-3eb6-4265-ab6b-f89a0e9dfa5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:12.864032 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5946e-3eb6-4265-ab6b-f89a0e9dfa5f admin admin] PATH_INFO: `/v3/users/2fc74ffec6e94364aac6385f6bc5445a` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:12.865414 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac5946e-3eb6-4265-ab6b-f89a0e9dfa5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fc74ffec6e94364aac6385f6bc5445a)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:12.867956 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac5946e-3eb6-4265-ab6b-f89a0e9dfa5f admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:12.922794 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-6ac5946e-3eb6-4265-ab6b-f89a0e9dfa5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fc74ffec6e94364aac6385f6bc5445a'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:12.923661 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-6ac5946e-3eb6-4265-ab6b-f89a0e9dfa5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fc74ffec6e94364aac6385f6bc5445a'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:12.924279 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-6ac5946e-3eb6-4265-ab6b-f89a0e9dfa5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fc74ffec6e94364aac6385f6bc5445a'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:12.925535 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:17:12.939768 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-6ac5946e-3eb6-4265-ab6b-f89a0e9dfa5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fc74ffec6e94364aac6385f6bc5445a'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:12.948863 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-6ac5946e-3eb6-4265-ab6b-f89a0e9dfa5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fc74ffec6e94364aac6385f6bc5445a'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:12.961258 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1121/2239] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:17:12 2022] DELETE /identity/v3/users/2fc74ffec6e94364aac6385f6bc5445a => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:17:13.132570 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0665322c-012e-4f73-9abb-e6ed884488a8 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:13.134496 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-0665322c-012e-4f73-9abb-e6ed884488a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:13.150988 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0665322c-012e-4f73-9abb-e6ed884488a8 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:13.222567 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7395f964-cd1c-45b4-b9cd-d19abf882bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:13.223217 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7395f964-cd1c-45b4-b9cd-d19abf882bdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:13.223496 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7395f964-cd1c-45b4-b9cd-d19abf882bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:13.223790 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7395f964-cd1c-45b4-b9cd-d19abf882bdf admin admin] PATH_INFO: `/v3/projects/ef281dd43a3d470284eb261c5fcd4b04` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:13.225161 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7395f964-cd1c-45b4-b9cd-d19abf882bdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef281dd43a3d470284eb261c5fcd4b04)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:13.227136 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7395f964-cd1c-45b4-b9cd-d19abf882bdf admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:13.276612 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-7395f964-cd1c-45b4-b9cd-d19abf882bdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef281dd43a3d470284eb261c5fcd4b04', 'request_id': 'req-7395f964-cd1c-45b4-b9cd-d19abf882bdf'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:13.282724 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-7395f964-cd1c-45b4-b9cd-d19abf882bdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef281dd43a3d470284eb261c5fcd4b04', 'request_id': 'req-7395f964-cd1c-45b4-b9cd-d19abf882bdf'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:13.288806 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-7395f964-cd1c-45b4-b9cd-d19abf882bdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef281dd43a3d470284eb261c5fcd4b04', 'request_id': 'req-7395f964-cd1c-45b4-b9cd-d19abf882bdf'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:13.302450 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-7395f964-cd1c-45b4-b9cd-d19abf882bdf admin admin] The token cache is being invalidate because project ef281dd43a3d470284eb261c5fcd4b04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:17:13.302675 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-7395f964-cd1c-45b4-b9cd-d19abf882bdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:13.303307 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-7395f964-cd1c-45b4-b9cd-d19abf882bdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:13.304934 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1119/2240] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:17:13 2022] DELETE /identity/v3/projects/ef281dd43a3d470284eb261c5fcd4b04 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:17:13.895742 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac5946e-3eb6-4265-ab6b-f89a0e9dfa5f admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:13.897152 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-6ac5946e-3eb6-4265-ab6b-f89a0e9dfa5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:13.910477 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac5946e-3eb6-4265-ab6b-f89a0e9dfa5f admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:13.965722 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5388b3b9-d055-4bc1-9256-de9d35144253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:13.966366 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388b3b9-d055-4bc1-9256-de9d35144253 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:13.966643 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388b3b9-d055-4bc1-9256-de9d35144253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:13.966917 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388b3b9-d055-4bc1-9256-de9d35144253 admin admin] PATH_INFO: `/v3/users/b20c1f948ede4f81a6d27eaf1f72d92b` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:13.968025 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5388b3b9-d055-4bc1-9256-de9d35144253 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b20c1f948ede4f81a6d27eaf1f72d92b)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:13.969950 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5388b3b9-d055-4bc1-9256-de9d35144253 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:14.014348 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-5388b3b9-d055-4bc1-9256-de9d35144253 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b20c1f948ede4f81a6d27eaf1f72d92b'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:14.014923 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-5388b3b9-d055-4bc1-9256-de9d35144253 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b20c1f948ede4f81a6d27eaf1f72d92b'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:14.015531 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-5388b3b9-d055-4bc1-9256-de9d35144253 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b20c1f948ede4f81a6d27eaf1f72d92b'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:14.028200 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-5388b3b9-d055-4bc1-9256-de9d35144253 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b20c1f948ede4f81a6d27eaf1f72d92b'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:14.034909 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-5388b3b9-d055-4bc1-9256-de9d35144253 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b20c1f948ede4f81a6d27eaf1f72d92b'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:14.046875 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1122/2241] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:17:13 2022] DELETE /identity/v3/users/b20c1f948ede4f81a6d27eaf1f72d92b => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:17:14.051432 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ddc12f-059c-4893-8d93-44eb01a8dd87 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:14.051915 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ddc12f-059c-4893-8d93-44eb01a8dd87 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:14.052021 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ddc12f-059c-4893-8d93-44eb01a8dd87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:14.070376 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-53ddc12f-059c-4893-8d93-44eb01a8dd87 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:17:14.071595 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-53ddc12f-059c-4893-8d93-44eb01a8dd87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:14.108966 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:17:14.131525 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1120/2242] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:17:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:17:14.141591 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5388b3b9-d055-4bc1-9256-de9d35144253 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:14.143192 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-5388b3b9-d055-4bc1-9256-de9d35144253 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:14.189623 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:17:14.201558 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5388b3b9-d055-4bc1-9256-de9d35144253 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:14.205532 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87368a5c-06d7-4eda-bc3d-0e3005f89dde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:14.206161 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87368a5c-06d7-4eda-bc3d-0e3005f89dde service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:14.206439 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87368a5c-06d7-4eda-bc3d-0e3005f89dde service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:14.206710 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87368a5c-06d7-4eda-bc3d-0e3005f89dde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:14.216295 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87368a5c-06d7-4eda-bc3d-0e3005f89dde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:14.217720 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87368a5c-06d7-4eda-bc3d-0e3005f89dde service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:14.227246 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1123/2243] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:17:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:17:14.510804 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ddc12f-059c-4893-8d93-44eb01a8dd87 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:14.511224 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-53ddc12f-059c-4893-8d93-44eb01a8dd87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:14.524689 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ddc12f-059c-4893-8d93-44eb01a8dd87 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:14.529144 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f15b9-ac5c-4afd-af71-729982822d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:14.529856 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f15b9-ac5c-4afd-af71-729982822d38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:14.530115 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f15b9-ac5c-4afd-af71-729982822d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:14.530392 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f15b9-ac5c-4afd-af71-729982822d38 admin admin] PATH_INFO: `/v3/projects/e5c492878a4d427b8a0f51483bcf9f70` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:14.531517 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642f15b9-ac5c-4afd-af71-729982822d38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5c492878a4d427b8a0f51483bcf9f70)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:14.533606 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642f15b9-ac5c-4afd-af71-729982822d38 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:14.584806 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-642f15b9-ac5c-4afd-af71-729982822d38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5c492878a4d427b8a0f51483bcf9f70', 'request_id': 'req-642f15b9-ac5c-4afd-af71-729982822d38'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:14.591360 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-642f15b9-ac5c-4afd-af71-729982822d38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5c492878a4d427b8a0f51483bcf9f70', 'request_id': 'req-642f15b9-ac5c-4afd-af71-729982822d38'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:14.597452 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-642f15b9-ac5c-4afd-af71-729982822d38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5c492878a4d427b8a0f51483bcf9f70', 'request_id': 'req-642f15b9-ac5c-4afd-af71-729982822d38'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:14.610267 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-642f15b9-ac5c-4afd-af71-729982822d38 admin admin] The token cache is being invalidate because project e5c492878a4d427b8a0f51483bcf9f70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:17:14.610715 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-642f15b9-ac5c-4afd-af71-729982822d38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:14.611173 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-642f15b9-ac5c-4afd-af71-729982822d38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:14.613974 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1121/2244] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:17:14 2022] DELETE /identity/v3/projects/e5c492878a4d427b8a0f51483bcf9f70 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:17:14.616555 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87368a5c-06d7-4eda-bc3d-0e3005f89dde service neutron] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:14.627346 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87368a5c-06d7-4eda-bc3d-0e3005f89dde service neutron] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:14.687473 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f0187f-37e3-4218-b340-ebafabab57d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:14.688096 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f0187f-37e3-4218-b340-ebafabab57d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:14.688372 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f0187f-37e3-4218-b340-ebafabab57d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:14.688640 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f0187f-37e3-4218-b340-ebafabab57d7 admin admin] PATH_INFO: `/v3/users/5014142fa3c94fb5ab014cb7bbb21117` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:14.689775 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f0187f-37e3-4218-b340-ebafabab57d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5014142fa3c94fb5ab014cb7bbb21117)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:14.691696 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f0187f-37e3-4218-b340-ebafabab57d7 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:14.737361 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-72f0187f-37e3-4218-b340-ebafabab57d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5014142fa3c94fb5ab014cb7bbb21117'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:14.738039 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-72f0187f-37e3-4218-b340-ebafabab57d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5014142fa3c94fb5ab014cb7bbb21117'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:14.738643 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-72f0187f-37e3-4218-b340-ebafabab57d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5014142fa3c94fb5ab014cb7bbb21117'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:14.751664 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-72f0187f-37e3-4218-b340-ebafabab57d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5014142fa3c94fb5ab014cb7bbb21117'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:14.760025 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-72f0187f-37e3-4218-b340-ebafabab57d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5014142fa3c94fb5ab014cb7bbb21117'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:14.772017 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1124/2245] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:17:14 2022] DELETE /identity/v3/users/5014142fa3c94fb5ab014cb7bbb21117 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:17:15.045863 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f15b9-ac5c-4afd-af71-729982822d38 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:15.047353 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-642f15b9-ac5c-4afd-af71-729982822d38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:15.066302 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f15b9-ac5c-4afd-af71-729982822d38 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:15.121759 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c33aae4-64c6-47ee-9640-43c7394100cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:15.122435 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33aae4-64c6-47ee-9640-43c7394100cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:15.122715 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33aae4-64c6-47ee-9640-43c7394100cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:15.122991 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33aae4-64c6-47ee-9640-43c7394100cb admin admin] PATH_INFO: `/v3/projects/dd67767f4094452e9a993956d298efdf` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:15.124196 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c33aae4-64c6-47ee-9640-43c7394100cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd67767f4094452e9a993956d298efdf)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:15.126028 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c33aae4-64c6-47ee-9640-43c7394100cb admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:15.171928 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-6c33aae4-64c6-47ee-9640-43c7394100cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd67767f4094452e9a993956d298efdf', 'request_id': 'req-6c33aae4-64c6-47ee-9640-43c7394100cb'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:15.177958 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-6c33aae4-64c6-47ee-9640-43c7394100cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd67767f4094452e9a993956d298efdf', 'request_id': 'req-6c33aae4-64c6-47ee-9640-43c7394100cb'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:15.183461 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-6c33aae4-64c6-47ee-9640-43c7394100cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd67767f4094452e9a993956d298efdf', 'request_id': 'req-6c33aae4-64c6-47ee-9640-43c7394100cb'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:15.186981 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:17:15.199321 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-6c33aae4-64c6-47ee-9640-43c7394100cb admin admin] The token cache is being invalidate because project dd67767f4094452e9a993956d298efdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:17:15.199626 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-6c33aae4-64c6-47ee-9640-43c7394100cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:15.200231 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-6c33aae4-64c6-47ee-9640-43c7394100cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:15.201765 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1122/2246] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:17:15 2022] DELETE /identity/v3/projects/dd67767f4094452e9a993956d298efdf => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:17:15.206666 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e1256-5431-456a-95ae-55c91e128d4a None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:15.207137 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e1256-5431-456a-95ae-55c91e128d4a None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:15.207234 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e1256-5431-456a-95ae-55c91e128d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:15.227100 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-3d5e1256-5431-456a-95ae-55c91e128d4a None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:17:15.228310 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-3d5e1256-5431-456a-95ae-55c91e128d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:15.286238 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1125/2247] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:17:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:17:15.294793 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86f75a-5150-425b-9514-08981a509ebf None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:15.295016 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86f75a-5150-425b-9514-08981a509ebf None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:15.295287 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86f75a-5150-425b-9514-08981a509ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:15.314545 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-8d86f75a-5150-425b-9514-08981a509ebf None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:17:15.315772 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-8d86f75a-5150-425b-9514-08981a509ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:15.323583 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1123/2248] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:17:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 11:17:15.327662 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5e1256-5431-456a-95ae-55c91e128d4a None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:15.337303 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5e1256-5431-456a-95ae-55c91e128d4a None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:15.342339 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf06921-64a5-4f10-a616-e652d045f47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:15.342928 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf06921-64a5-4f10-a616-e652d045f47a admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:15.343208 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf06921-64a5-4f10-a616-e652d045f47a admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:15.343484 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf06921-64a5-4f10-a616-e652d045f47a admin admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:15.344157 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf06921-64a5-4f10-a616-e652d045f47a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:17:15.344463 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf06921-64a5-4f10-a616-e652d045f47a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:15.346085 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf06921-64a5-4f10-a616-e652d045f47a admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:15.347516 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:17:15.360436 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1126/2249] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 11:17:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:17:15.364438 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d86f75a-5150-425b-9514-08981a509ebf None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:15.373543 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d86f75a-5150-425b-9514-08981a509ebf None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:15.378409 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bcfa78-6ceb-4e44-8f9d-bac471821cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:15.378990 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bcfa78-6ceb-4e44-8f9d-bac471821cf3 admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:15.379267 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bcfa78-6ceb-4e44-8f9d-bac471821cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:15.379537 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bcfa78-6ceb-4e44-8f9d-bac471821cf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:15.380169 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bcfa78-6ceb-4e44-8f9d-bac471821cf3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:15.382073 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bcfa78-6ceb-4e44-8f9d-bac471821cf3 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:15.409111 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1124/2250] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:17:15 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:17:15.412538 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf06921-64a5-4f10-a616-e652d045f47a admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:15.423007 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf06921-64a5-4f10-a616-e652d045f47a admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:15.477296 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14040b54-4f58-4ef5-992e-ffe5681282fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:15.477892 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14040b54-4f58-4ef5-992e-ffe5681282fe admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:15.478197 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14040b54-4f58-4ef5-992e-ffe5681282fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:15.478473 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14040b54-4f58-4ef5-992e-ffe5681282fe admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:15.479119 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14040b54-4f58-4ef5-992e-ffe5681282fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:15.481040 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14040b54-4f58-4ef5-992e-ffe5681282fe admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:15.502033 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1127/2251] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:17:15 2022] POST /identity/v3/users => generated 288 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:17:15.505809 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bcfa78-6ceb-4e44-8f9d-bac471821cf3 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:15.516623 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bcfa78-6ceb-4e44-8f9d-bac471821cf3 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:15.521347 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add56090-0d2a-4982-af4e-6c7cdaaa6750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:15.521955 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add56090-0d2a-4982-af4e-6c7cdaaa6750 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:15.522244 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add56090-0d2a-4982-af4e-6c7cdaaa6750 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:15.522517 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add56090-0d2a-4982-af4e-6c7cdaaa6750 admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:15.523157 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add56090-0d2a-4982-af4e-6c7cdaaa6750 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:15.524769 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add56090-0d2a-4982-af4e-6c7cdaaa6750 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:15.535087 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1125/2252] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:17:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:17:15.538873 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14040b54-4f58-4ef5-992e-ffe5681282fe admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:15.548647 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14040b54-4f58-4ef5-992e-ffe5681282fe admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:15.553071 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e1321a-1f8a-4769-b7e6-bdc7d4d9d01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:15.553648 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1321a-1f8a-4769-b7e6-bdc7d4d9d01f admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:15.553921 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1321a-1f8a-4769-b7e6-bdc7d4d9d01f admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:15.554222 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1321a-1f8a-4769-b7e6-bdc7d4d9d01f admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:15.554847 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e1321a-1f8a-4769-b7e6-bdc7d4d9d01f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:15.556414 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e1321a-1f8a-4769-b7e6-bdc7d4d9d01f admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:15.566622 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1128/2253] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:17:15 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:17:15.570511 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add56090-0d2a-4982-af4e-6c7cdaaa6750 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:15.580839 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add56090-0d2a-4982-af4e-6c7cdaaa6750 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:15.585397 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b701e92c-4dc4-49d7-9290-88c1290ce192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:15.586059 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b701e92c-4dc4-49d7-9290-88c1290ce192 admin admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:15.586340 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b701e92c-4dc4-49d7-9290-88c1290ce192 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:15.586615 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b701e92c-4dc4-49d7-9290-88c1290ce192 admin admin] PATH_INFO: `/v3/projects/367b8e8368904cf993c55ff227a1efcc/users/fa340df106ed4f6ebf61991cf7217a66/roles/7c3871c0ab68438b9014489d50b53a22` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:15.601505 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b701e92c-4dc4-49d7-9290-88c1290ce192 admin admin] RBAC: Authorizing `identity:create_grant(project_id=367b8e8368904cf993c55ff227a1efcc, user_id=fa340df106ed4f6ebf61991cf7217a66, role_id=7c3871c0ab68438b9014489d50b53a22)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:15.604154 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b701e92c-4dc4-49d7-9290-88c1290ce192 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:15.616655 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1126/2254] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:17:15 2022] PUT /identity/v3/projects/367b8e8368904cf993c55ff227a1efcc/users/fa340df106ed4f6ebf61991cf7217a66/roles/7c3871c0ab68438b9014489d50b53a22 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:17:15.627455 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7227e-f70e-4e59-a4da-dbd98379c9a3 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:15.627742 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7227e-f70e-4e59-a4da-dbd98379c9a3 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:15.628042 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7227e-f70e-4e59-a4da-dbd98379c9a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:15.657744 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-8cb7227e-f70e-4e59-a4da-dbd98379c9a3 None None] MFA Rules not processed for user `fa340df106ed4f6ebf61991cf7217a66`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:17:15.658997 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-8cb7227e-f70e-4e59-a4da-dbd98379c9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:15.732120 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1129/2255] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:17:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:17:15.732493 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b701e92c-4dc4-49d7-9290-88c1290ce192 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:15.776273 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb7227e-f70e-4e59-a4da-dbd98379c9a3 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:15.777677 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-8cb7227e-f70e-4e59-a4da-dbd98379c9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:15.799204 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b701e92c-4dc4-49d7-9290-88c1290ce192 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:15.803826 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c95541d-2d68-442c-93b6-cc4ba43949ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:15.804426 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95541d-2d68-442c-93b6-cc4ba43949ce admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:15.804705 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95541d-2d68-442c-93b6-cc4ba43949ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:15.804974 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95541d-2d68-442c-93b6-cc4ba43949ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:15.805626 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c95541d-2d68-442c-93b6-cc4ba43949ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:15.808756 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c95541d-2d68-442c-93b6-cc4ba43949ce admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:15.835973 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1127/2256] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:17:15 2022] POST /identity/v3/projects => generated 377 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:17:15.836756 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb7227e-f70e-4e59-a4da-dbd98379c9a3 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:15.839982 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c95541d-2d68-442c-93b6-cc4ba43949ce admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:15.849390 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:17:15.895846 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9a7b08-30db-410f-9d9b-e2fe2d6e84c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:15.896460 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a7b08-30db-410f-9d9b-e2fe2d6e84c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:15.896738 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a7b08-30db-410f-9d9b-e2fe2d6e84c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:15.897080 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a7b08-30db-410f-9d9b-e2fe2d6e84c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:15.898879 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-2a9a7b08-30db-410f-9d9b-e2fe2d6e84c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:15.912055 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c95541d-2d68-442c-93b6-cc4ba43949ce admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:15.917089 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b719d25-33fa-4322-89ac-e96b36eac3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:15.917693 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b719d25-33fa-4322-89ac-e96b36eac3c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:15.917995 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b719d25-33fa-4322-89ac-e96b36eac3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:15.918272 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b719d25-33fa-4322-89ac-e96b36eac3c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:15.918905 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b719d25-33fa-4322-89ac-e96b36eac3c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:15.920799 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b719d25-33fa-4322-89ac-e96b36eac3c4 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:15.943165 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1128/2257] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:17:15 2022] POST /identity/v3/users => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 11:17:15.947251 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b719d25-33fa-4322-89ac-e96b36eac3c4 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:15.957612 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b719d25-33fa-4322-89ac-e96b36eac3c4 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:15.962207 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cccb701-6b96-43ca-8640-b7ccb0d26788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:15.962782 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cccb701-6b96-43ca-8640-b7ccb0d26788 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:15.963097 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cccb701-6b96-43ca-8640-b7ccb0d26788 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:15.963351 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cccb701-6b96-43ca-8640-b7ccb0d26788 admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:15.963980 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cccb701-6b96-43ca-8640-b7ccb0d26788 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:15.965534 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cccb701-6b96-43ca-8640-b7ccb0d26788 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:15.966810 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9a7b08-30db-410f-9d9b-e2fe2d6e84c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:15.966947 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:17:15.968418 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9a7b08-30db-410f-9d9b-e2fe2d6e84c6 service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:15.976687 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1129/2258] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:17:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 13 11:17:15.979778 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1130/2259] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:17:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 13 11:17:15.980399 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cccb701-6b96-43ca-8640-b7ccb0d26788 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:15.989985 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cccb701-6b96-43ca-8640-b7ccb0d26788 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:15.995299 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd8aa9-fa7b-4db5-ad0f-30ba864872e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:15.995891 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd8aa9-fa7b-4db5-ad0f-30ba864872e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:15.996166 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd8aa9-fa7b-4db5-ad0f-30ba864872e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:15.996435 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd8aa9-fa7b-4db5-ad0f-30ba864872e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:15.997100 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dd8aa9-fa7b-4db5-ad0f-30ba864872e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:15.998698 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dd8aa9-fa7b-4db5-ad0f-30ba864872e8 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:16.009251 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1130/2260] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:17:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 13 11:17:16.013898 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9a7b08-30db-410f-9d9b-e2fe2d6e84c6 service neutron] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:16.028445 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9a7b08-30db-410f-9d9b-e2fe2d6e84c6 service neutron] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:16.033566 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a658ea-962d-48d9-926b-4b7a08054cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:16.034342 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a658ea-962d-48d9-926b-4b7a08054cc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:16.034692 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a658ea-962d-48d9-926b-4b7a08054cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:16.035069 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a658ea-962d-48d9-926b-4b7a08054cc9 admin admin] PATH_INFO: `/v3/projects/3cb63d2ab2634725a1aea7af62557820/users/1ca8bc4d044f4a029c4abc8759967786/roles/7c3871c0ab68438b9014489d50b53a22` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:16.050894 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a658ea-962d-48d9-926b-4b7a08054cc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cb63d2ab2634725a1aea7af62557820, user_id=1ca8bc4d044f4a029c4abc8759967786, role_id=7c3871c0ab68438b9014489d50b53a22)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:16.053533 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a658ea-962d-48d9-926b-4b7a08054cc9 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:16.067100 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1131/2261] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:17:16 2022] PUT /identity/v3/projects/3cb63d2ab2634725a1aea7af62557820/users/1ca8bc4d044f4a029c4abc8759967786/roles/7c3871c0ab68438b9014489d50b53a22 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:17:16.136352 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b7785-896f-4e53-b22f-42444d57bc90 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:16.136924 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b7785-896f-4e53-b22f-42444d57bc90 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:16.136924 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b7785-896f-4e53-b22f-42444d57bc90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:16.164749 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-647b7785-896f-4e53-b22f-42444d57bc90 None None] MFA Rules not processed for user `1ca8bc4d044f4a029c4abc8759967786`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:17:16.165996 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-647b7785-896f-4e53-b22f-42444d57bc90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:16.231398 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1131/2262] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:17:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:17:16.235658 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a658ea-962d-48d9-926b-4b7a08054cc9 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:16.299751 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a658ea-962d-48d9-926b-4b7a08054cc9 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:16.305010 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2166323f-d1b1-446a-9a18-0920dbc7e31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:16.305544 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2166323f-d1b1-446a-9a18-0920dbc7e31d admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:16.305824 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2166323f-d1b1-446a-9a18-0920dbc7e31d admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:16.306277 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2166323f-d1b1-446a-9a18-0920dbc7e31d admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:16.307531 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2166323f-d1b1-446a-9a18-0920dbc7e31d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:16.309426 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2166323f-d1b1-446a-9a18-0920dbc7e31d admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:16.339359 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1132/2263] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:17:16 2022] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 11:17:16.340511 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647b7785-896f-4e53-b22f-42444d57bc90 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:16.351410 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647b7785-896f-4e53-b22f-42444d57bc90 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:16.412353 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e778ce-03f8-43b2-bcbe-2c8e79ca71e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:16.412977 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e778ce-03f8-43b2-bcbe-2c8e79ca71e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:16.413259 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e778ce-03f8-43b2-bcbe-2c8e79ca71e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:16.413534 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e778ce-03f8-43b2-bcbe-2c8e79ca71e0 admin admin] PATH_INFO: `/v3/users` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:16.414245 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e778ce-03f8-43b2-bcbe-2c8e79ca71e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:16.416668 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e778ce-03f8-43b2-bcbe-2c8e79ca71e0 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:16.440768 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1132/2264] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:17:16 2022] POST /identity/v3/users => generated 295 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 11:17:16.441977 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2166323f-d1b1-446a-9a18-0920dbc7e31d admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:16.452698 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2166323f-d1b1-446a-9a18-0920dbc7e31d admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:16.457568 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ddaa5c-ba49-467b-88b8-66c5b72f5a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:16.458211 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ddaa5c-ba49-467b-88b8-66c5b72f5a0a admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:16.458495 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ddaa5c-ba49-467b-88b8-66c5b72f5a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:16.458772 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ddaa5c-ba49-467b-88b8-66c5b72f5a0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:16.459417 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ddaa5c-ba49-467b-88b8-66c5b72f5a0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:16.461033 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ddaa5c-ba49-467b-88b8-66c5b72f5a0a admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:16.471808 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1133/2265] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:17:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:17:16.476454 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e778ce-03f8-43b2-bcbe-2c8e79ca71e0 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:16.487168 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e778ce-03f8-43b2-bcbe-2c8e79ca71e0 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:16.491855 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d8574c-57bb-4d7c-a8a9-05a54532272d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:16.492510 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d8574c-57bb-4d7c-a8a9-05a54532272d admin admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:16.492793 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d8574c-57bb-4d7c-a8a9-05a54532272d admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:16.493069 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d8574c-57bb-4d7c-a8a9-05a54532272d admin admin] PATH_INFO: `/v3/projects/c5da192536e44088a8b53bb7379228ed/users/1ee48c3db47148febaa52d5d40a60f06/roles/ea564961b1db4eb4a1d4d880964611b2` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:16.509365 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d8574c-57bb-4d7c-a8a9-05a54532272d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5da192536e44088a8b53bb7379228ed, user_id=1ee48c3db47148febaa52d5d40a60f06, role_id=ea564961b1db4eb4a1d4d880964611b2)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:16.512148 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d8574c-57bb-4d7c-a8a9-05a54532272d admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:16.526199 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1133/2266] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:17:16 2022] PUT /identity/v3/projects/c5da192536e44088a8b53bb7379228ed/users/1ee48c3db47148febaa52d5d40a60f06/roles/ea564961b1db4eb4a1d4d880964611b2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 11:17:16.530294 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ddaa5c-ba49-467b-88b8-66c5b72f5a0a admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:16.540859 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ddaa5c-ba49-467b-88b8-66c5b72f5a0a admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:16.554448 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:17:16.601325 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20731a98-8ca8-4020-a05a-8300330a9d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:16.602223 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20731a98-8ca8-4020-a05a-8300330a9d1a admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:16.602506 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20731a98-8ca8-4020-a05a-8300330a9d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:16.602787 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20731a98-8ca8-4020-a05a-8300330a9d1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:16.603439 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20731a98-8ca8-4020-a05a-8300330a9d1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:16.605709 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20731a98-8ca8-4020-a05a-8300330a9d1a admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:16.618795 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1134/2267] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:17:16 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:17:16.620026 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d8574c-57bb-4d7c-a8a9-05a54532272d admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:16.630947 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d8574c-57bb-4d7c-a8a9-05a54532272d admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:16.637089 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4488d570-ad5f-4e56-ad40-b1c516c22ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:16.637826 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488d570-ad5f-4e56-ad40-b1c516c22ac2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:16.638226 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488d570-ad5f-4e56-ad40-b1c516c22ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:16.638559 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488d570-ad5f-4e56-ad40-b1c516c22ac2 admin admin] PATH_INFO: `/v3/projects/c5da192536e44088a8b53bb7379228ed/users/1ee48c3db47148febaa52d5d40a60f06/roles/ea564961b1db4eb4a1d4d880964611b2` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:16.640947 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4488d570-ad5f-4e56-ad40-b1c516c22ac2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5da192536e44088a8b53bb7379228ed, user_id=1ee48c3db47148febaa52d5d40a60f06, role_id=ea564961b1db4eb4a1d4d880964611b2)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:16.643811 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4488d570-ad5f-4e56-ad40-b1c516c22ac2 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:16.655069 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1134/2268] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:17:16 2022] PUT /identity/v3/projects/c5da192536e44088a8b53bb7379228ed/users/1ee48c3db47148febaa52d5d40a60f06/roles/ea564961b1db4eb4a1d4d880964611b2 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:17:16.665104 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18402470-5cc1-4746-97ac-e3b3423dd335 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:16.665397 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18402470-5cc1-4746-97ac-e3b3423dd335 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:16.665679 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18402470-5cc1-4746-97ac-e3b3423dd335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:16.694392 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-18402470-5cc1-4746-97ac-e3b3423dd335 None None] MFA Rules not processed for user `1ee48c3db47148febaa52d5d40a60f06`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:17:16.695628 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-18402470-5cc1-4746-97ac-e3b3423dd335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:16.763760 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1135/2269] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:17:16 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:17:16.776497 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4488d570-ad5f-4e56-ad40-b1c516c22ac2 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:16.778380 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-4488d570-ad5f-4e56-ad40-b1c516c22ac2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:16.809278 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:17:16.839946 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4488d570-ad5f-4e56-ad40-b1c516c22ac2 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:16.843647 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a034f3-c206-43f7-913e-cbf4cf693cfa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f4c2fc51f54f0e977648b13efaed1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:16.844192 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a034f3-c206-43f7-913e-cbf4cf693cfa service cinder] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:16.844467 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a034f3-c206-43f7-913e-cbf4cf693cfa service cinder] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:16.844735 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a034f3-c206-43f7-913e-cbf4cf693cfa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:16.914357 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a034f3-c206-43f7-913e-cbf4cf693cfa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:16.916876 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a034f3-c206-43f7-913e-cbf4cf693cfa service cinder] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:16.928328 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1135/2270] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:17:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:17:18.516686 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18402470-5cc1-4746-97ac-e3b3423dd335 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:18.518209 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-18402470-5cc1-4746-97ac-e3b3423dd335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:18.530504 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18402470-5cc1-4746-97ac-e3b3423dd335 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:18.534071 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a01dc56-aac2-4d9a-99b8-de54bc7257a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f4c2fc51f54f0e977648b13efaed1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:18.534671 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01dc56-aac2-4d9a-99b8-de54bc7257a2 service cinder] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:18.534945 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01dc56-aac2-4d9a-99b8-de54bc7257a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:18.535213 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01dc56-aac2-4d9a-99b8-de54bc7257a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:18.595422 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a01dc56-aac2-4d9a-99b8-de54bc7257a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:18.596846 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a01dc56-aac2-4d9a-99b8-de54bc7257a2 service cinder] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:18.607431 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1136/2271] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:17:18 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:17:19.278752 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a034f3-c206-43f7-913e-cbf4cf693cfa service cinder] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:19.280950 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-77a034f3-c206-43f7-913e-cbf4cf693cfa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:19.351347 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a01dc56-aac2-4d9a-99b8-de54bc7257a2 service cinder] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:19.360303 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a01dc56-aac2-4d9a-99b8-de54bc7257a2 service cinder] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:19.362154 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a034f3-c206-43f7-913e-cbf4cf693cfa service cinder] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:19.363834 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33268c17-0af9-4711-b772-e7a9115fe55e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f4c2fc51f54f0e977648b13efaed1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:19.364429 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33268c17-0af9-4711-b772-e7a9115fe55e service cinder] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:19.364705 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33268c17-0af9-4711-b772-e7a9115fe55e service cinder] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:19.364979 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33268c17-0af9-4711-b772-e7a9115fe55e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:19.366702 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f647c42-ab90-4f5f-bae0-3e09f2632706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:19.367341 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f647c42-ab90-4f5f-bae0-3e09f2632706 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:19.367686 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f647c42-ab90-4f5f-bae0-3e09f2632706 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:19.368088 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f647c42-ab90-4f5f-bae0-3e09f2632706 admin admin] PATH_INFO: `/v3/users/3b8d890413d4480d96ce9c9be80076d7` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:19.369845 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f647c42-ab90-4f5f-bae0-3e09f2632706 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b8d890413d4480d96ce9c9be80076d7)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:19.371977 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f647c42-ab90-4f5f-bae0-3e09f2632706 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:19.374495 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33268c17-0af9-4711-b772-e7a9115fe55e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:19.375904 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33268c17-0af9-4711-b772-e7a9115fe55e service cinder] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:19.385633 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1137/2272] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:17:19 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 13 11:17:19.419411 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-0f647c42-ab90-4f5f-bae0-3e09f2632706 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b8d890413d4480d96ce9c9be80076d7'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:19.436177 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-0f647c42-ab90-4f5f-bae0-3e09f2632706 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b8d890413d4480d96ce9c9be80076d7'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:19.437000 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-0f647c42-ab90-4f5f-bae0-3e09f2632706 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b8d890413d4480d96ce9c9be80076d7'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:19.437572 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-0f647c42-ab90-4f5f-bae0-3e09f2632706 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b8d890413d4480d96ce9c9be80076d7'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:19.446272 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-0f647c42-ab90-4f5f-bae0-3e09f2632706 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b8d890413d4480d96ce9c9be80076d7'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:19.460335 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:17:19.465212 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1136/2273] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:17:19 2022] DELETE /identity/v3/users/3b8d890413d4480d96ce9c9be80076d7 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:17:19.654376 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33268c17-0af9-4711-b772-e7a9115fe55e service cinder] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:19.665239 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33268c17-0af9-4711-b772-e7a9115fe55e service cinder] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:19.685519 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:17:19.724444 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643171ab-a92c-4950-a3fc-608dad0a960f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:19.725089 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643171ab-a92c-4950-a3fc-608dad0a960f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:19.725362 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643171ab-a92c-4950-a3fc-608dad0a960f admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:19.725630 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643171ab-a92c-4950-a3fc-608dad0a960f admin admin] PATH_INFO: `/v3/projects/24eb4bc2c8e448ea91f00e7ac1cd33b5` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:19.726774 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643171ab-a92c-4950-a3fc-608dad0a960f admin admin] RBAC: Authorizing `identity:delete_project(project_id=24eb4bc2c8e448ea91f00e7ac1cd33b5)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:19.729307 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643171ab-a92c-4950-a3fc-608dad0a960f admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:19.774069 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-643171ab-a92c-4950-a3fc-608dad0a960f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24eb4bc2c8e448ea91f00e7ac1cd33b5', 'request_id': 'req-643171ab-a92c-4950-a3fc-608dad0a960f'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:19.782106 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-643171ab-a92c-4950-a3fc-608dad0a960f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24eb4bc2c8e448ea91f00e7ac1cd33b5', 'request_id': 'req-643171ab-a92c-4950-a3fc-608dad0a960f'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:19.788332 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-643171ab-a92c-4950-a3fc-608dad0a960f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24eb4bc2c8e448ea91f00e7ac1cd33b5', 'request_id': 'req-643171ab-a92c-4950-a3fc-608dad0a960f'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:19.799014 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-643171ab-a92c-4950-a3fc-608dad0a960f admin admin] The token cache is being invalidate because project 24eb4bc2c8e448ea91f00e7ac1cd33b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:17:19.799299 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-643171ab-a92c-4950-a3fc-608dad0a960f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:19.799926 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-643171ab-a92c-4950-a3fc-608dad0a960f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:19.801386 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1138/2274] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:17:19 2022] DELETE /identity/v3/projects/24eb4bc2c8e448ea91f00e7ac1cd33b5 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:17:19.806335 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e87f4-4970-4274-9696-d610c0fc6735 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:19.806639 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e87f4-4970-4274-9696-d610c0fc6735 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:19.806916 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e87f4-4970-4274-9696-d610c0fc6735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:19.826810 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-dd3e87f4-4970-4274-9696-d610c0fc6735 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:17:19.827975 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-dd3e87f4-4970-4274-9696-d610c0fc6735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:19.886348 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1137/2275] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:17:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:17:19.893973 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4894997-4bca-465e-89eb-358bb3ad2508 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:19.894250 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4894997-4bca-465e-89eb-358bb3ad2508 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:19.894521 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4894997-4bca-465e-89eb-358bb3ad2508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:19.914381 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-f4894997-4bca-465e-89eb-358bb3ad2508 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:17:19.915568 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-f4894997-4bca-465e-89eb-358bb3ad2508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:19.923780 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1139/2276] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:17:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:17:19.927880 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3e87f4-4970-4274-9696-d610c0fc6735 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:19.937579 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3e87f4-4970-4274-9696-d610c0fc6735 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:19.942077 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7012eace-f407-4020-9c40-414a48aa205d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:19.942671 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7012eace-f407-4020-9c40-414a48aa205d admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:19.943107 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7012eace-f407-4020-9c40-414a48aa205d admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:19.943392 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7012eace-f407-4020-9c40-414a48aa205d admin admin] PATH_INFO: `/v3/domains` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:19.944042 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7012eace-f407-4020-9c40-414a48aa205d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:17:19.944344 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7012eace-f407-4020-9c40-414a48aa205d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:19.945931 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7012eace-f407-4020-9c40-414a48aa205d admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:19.958014 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1138/2277] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 11:17:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:17:19.962146 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4894997-4bca-465e-89eb-358bb3ad2508 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:19.971742 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4894997-4bca-465e-89eb-358bb3ad2508 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:19.976256 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cea7221-d2c5-4035-8c74-ccbf131b43a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:19.976838 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea7221-d2c5-4035-8c74-ccbf131b43a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:19.977112 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea7221-d2c5-4035-8c74-ccbf131b43a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:19.977382 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea7221-d2c5-4035-8c74-ccbf131b43a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:19.978029 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cea7221-d2c5-4035-8c74-ccbf131b43a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:19.979903 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cea7221-d2c5-4035-8c74-ccbf131b43a0 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:20.006286 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1140/2278] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:17:19 2022] POST /identity/v3/projects => generated 367 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:17:20.010802 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7012eace-f407-4020-9c40-414a48aa205d admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:20.020634 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7012eace-f407-4020-9c40-414a48aa205d admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:20.076914 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495ea768-e3b3-4ebb-9a76-d9eef8b2ea1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:20.077443 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ea768-e3b3-4ebb-9a76-d9eef8b2ea1d admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:20.077730 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ea768-e3b3-4ebb-9a76-d9eef8b2ea1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:20.078032 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ea768-e3b3-4ebb-9a76-d9eef8b2ea1d admin admin] PATH_INFO: `/v3/users` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:20.078670 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495ea768-e3b3-4ebb-9a76-d9eef8b2ea1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:20.080563 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495ea768-e3b3-4ebb-9a76-d9eef8b2ea1d admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:20.101611 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1139/2279] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:17:20 2022] POST /identity/v3/users => generated 284 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 11:17:20.105643 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cea7221-d2c5-4035-8c74-ccbf131b43a0 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:20.115755 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cea7221-d2c5-4035-8c74-ccbf131b43a0 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:20.120362 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcd15d4-b901-445b-b0b4-3bf0c3348321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:20.121018 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd15d4-b901-445b-b0b4-3bf0c3348321 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:20.121301 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd15d4-b901-445b-b0b4-3bf0c3348321 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:20.121573 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd15d4-b901-445b-b0b4-3bf0c3348321 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:20.122244 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcd15d4-b901-445b-b0b4-3bf0c3348321 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:20.124012 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcd15d4-b901-445b-b0b4-3bf0c3348321 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:20.134651 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1141/2280] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:17:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:17:20.139089 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495ea768-e3b3-4ebb-9a76-d9eef8b2ea1d admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:20.148915 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495ea768-e3b3-4ebb-9a76-d9eef8b2ea1d admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:20.154129 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed18c6a-f62d-479b-a1ce-604c5e80b45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:20.154713 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed18c6a-f62d-479b-a1ce-604c5e80b45a admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:20.154992 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed18c6a-f62d-479b-a1ce-604c5e80b45a admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:20.155265 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed18c6a-f62d-479b-a1ce-604c5e80b45a admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:20.155937 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed18c6a-f62d-479b-a1ce-604c5e80b45a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:20.157494 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed18c6a-f62d-479b-a1ce-604c5e80b45a admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:20.167869 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1140/2281] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:17:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:17:20.171843 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcd15d4-b901-445b-b0b4-3bf0c3348321 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:20.181636 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcd15d4-b901-445b-b0b4-3bf0c3348321 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:20.186217 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691b6cf9-9efa-43b8-aa75-9441b4bd405e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:20.186849 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b6cf9-9efa-43b8-aa75-9441b4bd405e admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:20.187127 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b6cf9-9efa-43b8-aa75-9441b4bd405e admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:20.187400 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b6cf9-9efa-43b8-aa75-9441b4bd405e admin admin] PATH_INFO: `/v3/projects/6288f2f220e2497092f498c967836b75/users/a20fe4f63d474485a1393b128f80e782/roles/7c3871c0ab68438b9014489d50b53a22` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:20.201992 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691b6cf9-9efa-43b8-aa75-9441b4bd405e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6288f2f220e2497092f498c967836b75, user_id=a20fe4f63d474485a1393b128f80e782, role_id=7c3871c0ab68438b9014489d50b53a22)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:20.204596 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691b6cf9-9efa-43b8-aa75-9441b4bd405e admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:20.217753 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1142/2282] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:17:20 2022] PUT /identity/v3/projects/6288f2f220e2497092f498c967836b75/users/a20fe4f63d474485a1393b128f80e782/roles/7c3871c0ab68438b9014489d50b53a22 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:17:20.228500 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411a4e1-98dc-43de-88a3-4890daf6c473 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:20.228790 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411a4e1-98dc-43de-88a3-4890daf6c473 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:20.229062 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411a4e1-98dc-43de-88a3-4890daf6c473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:20.255933 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-1411a4e1-98dc-43de-88a3-4890daf6c473 None None] MFA Rules not processed for user `a20fe4f63d474485a1393b128f80e782`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:17:20.257136 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-1411a4e1-98dc-43de-88a3-4890daf6c473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:20.310633 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:17:20.320106 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1141/2283] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:17:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:17:20.331283 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691b6cf9-9efa-43b8-aa75-9441b4bd405e admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:20.332898 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-691b6cf9-9efa-43b8-aa75-9441b4bd405e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:20.388310 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691b6cf9-9efa-43b8-aa75-9441b4bd405e admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:20.391908 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ae5a1a-8a64-48b1-83f0-b637b4062d2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f4c2fc51f54f0e977648b13efaed1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:20.392501 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae5a1a-8a64-48b1-83f0-b637b4062d2d service cinder] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:20.392780 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae5a1a-8a64-48b1-83f0-b637b4062d2d service cinder] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:20.393053 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae5a1a-8a64-48b1-83f0-b637b4062d2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:20.398139 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:17:20.402712 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ae5a1a-8a64-48b1-83f0-b637b4062d2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:20.404843 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ae5a1a-8a64-48b1-83f0-b637b4062d2d service cinder] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:20.413743 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1143/2284] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:17:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:17:23.314535 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1411a4e1-98dc-43de-88a3-4890daf6c473 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:23.315949 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-1411a4e1-98dc-43de-88a3-4890daf6c473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:23.392209 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1411a4e1-98dc-43de-88a3-4890daf6c473 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:23.398571 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dec340e-fda9-4469-ae19-5f6f9c2a1167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:23.399271 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec340e-fda9-4469-ae19-5f6f9c2a1167 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:23.399553 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec340e-fda9-4469-ae19-5f6f9c2a1167 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:23.400003 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec340e-fda9-4469-ae19-5f6f9c2a1167 admin admin] PATH_INFO: `/v3/users/fa340df106ed4f6ebf61991cf7217a66` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:23.401501 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dec340e-fda9-4469-ae19-5f6f9c2a1167 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa340df106ed4f6ebf61991cf7217a66)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:23.403574 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dec340e-fda9-4469-ae19-5f6f9c2a1167 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:23.465671 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-2dec340e-fda9-4469-ae19-5f6f9c2a1167 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa340df106ed4f6ebf61991cf7217a66'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:23.474555 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-2dec340e-fda9-4469-ae19-5f6f9c2a1167 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa340df106ed4f6ebf61991cf7217a66'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:23.475368 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-2dec340e-fda9-4469-ae19-5f6f9c2a1167 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa340df106ed4f6ebf61991cf7217a66'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:23.475997 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-2dec340e-fda9-4469-ae19-5f6f9c2a1167 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa340df106ed4f6ebf61991cf7217a66'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:23.487616 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-2dec340e-fda9-4469-ae19-5f6f9c2a1167 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa340df106ed4f6ebf61991cf7217a66'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:23.513923 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1142/2285] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:17:23 2022] DELETE /identity/v3/users/fa340df106ed4f6ebf61991cf7217a66 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:17:23.515387 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aff3bf-1858-4e6e-91d3-b095c213ec3a None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:23.515883 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aff3bf-1858-4e6e-91d3-b095c213ec3a None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:23.515997 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aff3bf-1858-4e6e-91d3-b095c213ec3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:23.538793 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-07aff3bf-1858-4e6e-91d3-b095c213ec3a None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:17:23.540111 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-07aff3bf-1858-4e6e-91d3-b095c213ec3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:23.607266 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1144/2286] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:17:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:17:23.616970 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dec340e-fda9-4469-ae19-5f6f9c2a1167 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:23.618473 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-2dec340e-fda9-4469-ae19-5f6f9c2a1167 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:23.679541 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dec340e-fda9-4469-ae19-5f6f9c2a1167 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:23.683248 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4a3c2b-1e64-4857-8a5c-64acc5bfeff2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:23.683869 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a3c2b-1e64-4857-8a5c-64acc5bfeff2 service neutron] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:23.684133 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a3c2b-1e64-4857-8a5c-64acc5bfeff2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:23.684403 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a3c2b-1e64-4857-8a5c-64acc5bfeff2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:23.693094 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4a3c2b-1e64-4857-8a5c-64acc5bfeff2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:23.694542 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4a3c2b-1e64-4857-8a5c-64acc5bfeff2 service neutron] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:23.704262 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1143/2287] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:17:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:17:23.970141 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aff3bf-1858-4e6e-91d3-b095c213ec3a None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:23.971570 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-07aff3bf-1858-4e6e-91d3-b095c213ec3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:23.985369 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aff3bf-1858-4e6e-91d3-b095c213ec3a None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:23.990043 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9966a29e-6a68-43c0-94c0-331ad499c139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:23.990678 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966a29e-6a68-43c0-94c0-331ad499c139 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:23.990954 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966a29e-6a68-43c0-94c0-331ad499c139 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:23.991228 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966a29e-6a68-43c0-94c0-331ad499c139 admin admin] PATH_INFO: `/v3/projects/367b8e8368904cf993c55ff227a1efcc` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:23.992336 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9966a29e-6a68-43c0-94c0-331ad499c139 admin admin] RBAC: Authorizing `identity:delete_project(project_id=367b8e8368904cf993c55ff227a1efcc)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:23.994970 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9966a29e-6a68-43c0-94c0-331ad499c139 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:24.041506 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-9966a29e-6a68-43c0-94c0-331ad499c139 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '367b8e8368904cf993c55ff227a1efcc', 'request_id': 'req-9966a29e-6a68-43c0-94c0-331ad499c139'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:24.048353 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-9966a29e-6a68-43c0-94c0-331ad499c139 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '367b8e8368904cf993c55ff227a1efcc', 'request_id': 'req-9966a29e-6a68-43c0-94c0-331ad499c139'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:24.054624 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-9966a29e-6a68-43c0-94c0-331ad499c139 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '367b8e8368904cf993c55ff227a1efcc', 'request_id': 'req-9966a29e-6a68-43c0-94c0-331ad499c139'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:24.065549 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-9966a29e-6a68-43c0-94c0-331ad499c139 admin admin] The token cache is being invalidate because project 367b8e8368904cf993c55ff227a1efcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:17:24.065836 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-9966a29e-6a68-43c0-94c0-331ad499c139 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:24.066488 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-9966a29e-6a68-43c0-94c0-331ad499c139 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:24.067968 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1145/2288] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:17:23 2022] DELETE /identity/v3/projects/367b8e8368904cf993c55ff227a1efcc => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:17:24.071998 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4a3c2b-1e64-4857-8a5c-64acc5bfeff2 service neutron] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:24.082029 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4a3c2b-1e64-4857-8a5c-64acc5bfeff2 service neutron] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:24.093661 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:17:24.139825 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf4dd6-b0a1-4f9e-94dc-f4dd477e75e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:24.140444 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf4dd6-b0a1-4f9e-94dc-f4dd477e75e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:24.140721 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf4dd6-b0a1-4f9e-94dc-f4dd477e75e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:24.140991 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf4dd6-b0a1-4f9e-94dc-f4dd477e75e7 admin admin] PATH_INFO: `/v3/users/1ca8bc4d044f4a029c4abc8759967786` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:24.142130 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebf4dd6-b0a1-4f9e-94dc-f4dd477e75e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ca8bc4d044f4a029c4abc8759967786)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:24.144017 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebf4dd6-b0a1-4f9e-94dc-f4dd477e75e7 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:24.188597 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-eebf4dd6-b0a1-4f9e-94dc-f4dd477e75e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ca8bc4d044f4a029c4abc8759967786'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:24.195543 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-eebf4dd6-b0a1-4f9e-94dc-f4dd477e75e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ca8bc4d044f4a029c4abc8759967786'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:24.196218 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-eebf4dd6-b0a1-4f9e-94dc-f4dd477e75e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ca8bc4d044f4a029c4abc8759967786'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:24.196814 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-eebf4dd6-b0a1-4f9e-94dc-f4dd477e75e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ca8bc4d044f4a029c4abc8759967786'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:24.204581 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-eebf4dd6-b0a1-4f9e-94dc-f4dd477e75e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ca8bc4d044f4a029c4abc8759967786'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:24.221497 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1144/2289] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:17:24 2022] DELETE /identity/v3/users/1ca8bc4d044f4a029c4abc8759967786 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:17:24.486082 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9966a29e-6a68-43c0-94c0-331ad499c139 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:24.487502 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-9966a29e-6a68-43c0-94c0-331ad499c139 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:24.503648 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9966a29e-6a68-43c0-94c0-331ad499c139 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:24.559964 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63170a72-992f-4e76-9844-da468efbc978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:24.560646 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63170a72-992f-4e76-9844-da468efbc978 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:24.560845 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63170a72-992f-4e76-9844-da468efbc978 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:24.561115 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63170a72-992f-4e76-9844-da468efbc978 admin admin] PATH_INFO: `/v3/projects/3cb63d2ab2634725a1aea7af62557820` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:24.562245 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63170a72-992f-4e76-9844-da468efbc978 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cb63d2ab2634725a1aea7af62557820)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:24.564122 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63170a72-992f-4e76-9844-da468efbc978 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:24.586594 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:17:24.613612 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-63170a72-992f-4e76-9844-da468efbc978 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cb63d2ab2634725a1aea7af62557820', 'request_id': 'req-63170a72-992f-4e76-9844-da468efbc978'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:24.621731 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-63170a72-992f-4e76-9844-da468efbc978 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cb63d2ab2634725a1aea7af62557820', 'request_id': 'req-63170a72-992f-4e76-9844-da468efbc978'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:24.628835 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-63170a72-992f-4e76-9844-da468efbc978 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cb63d2ab2634725a1aea7af62557820', 'request_id': 'req-63170a72-992f-4e76-9844-da468efbc978'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:24.643408 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-63170a72-992f-4e76-9844-da468efbc978 admin admin] The token cache is being invalidate because project 3cb63d2ab2634725a1aea7af62557820 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:17:24.643699 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-63170a72-992f-4e76-9844-da468efbc978 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:24.644346 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-63170a72-992f-4e76-9844-da468efbc978 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:24.645816 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1146/2290] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:17:24 2022] DELETE /identity/v3/projects/3cb63d2ab2634725a1aea7af62557820 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:17:24.649684 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf4dd6-b0a1-4f9e-94dc-f4dd477e75e7 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:24.651100 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-eebf4dd6-b0a1-4f9e-94dc-f4dd477e75e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:24.664105 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf4dd6-b0a1-4f9e-94dc-f4dd477e75e7 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:24.721481 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a72db3e-aa36-4a46-befa-884e3cc436ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:24.722133 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a72db3e-aa36-4a46-befa-884e3cc436ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:24.722441 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a72db3e-aa36-4a46-befa-884e3cc436ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:24.722726 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a72db3e-aa36-4a46-befa-884e3cc436ea admin admin] PATH_INFO: `/v3/users/1ee48c3db47148febaa52d5d40a60f06` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:24.723847 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a72db3e-aa36-4a46-befa-884e3cc436ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ee48c3db47148febaa52d5d40a60f06)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:24.725813 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a72db3e-aa36-4a46-befa-884e3cc436ea admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:24.772633 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:17:24.780012 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-5a72db3e-aa36-4a46-befa-884e3cc436ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ee48c3db47148febaa52d5d40a60f06'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:24.788914 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-5a72db3e-aa36-4a46-befa-884e3cc436ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ee48c3db47148febaa52d5d40a60f06'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:24.789602 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-5a72db3e-aa36-4a46-befa-884e3cc436ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ee48c3db47148febaa52d5d40a60f06'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:24.790225 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-5a72db3e-aa36-4a46-befa-884e3cc436ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ee48c3db47148febaa52d5d40a60f06'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:24.799310 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-5a72db3e-aa36-4a46-befa-884e3cc436ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ee48c3db47148febaa52d5d40a60f06'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:24.817707 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1145/2291] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:17:24 2022] DELETE /identity/v3/users/1ee48c3db47148febaa52d5d40a60f06 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:17:25.097167 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63170a72-992f-4e76-9844-da468efbc978 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:25.098728 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-63170a72-992f-4e76-9844-da468efbc978 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:25.114250 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63170a72-992f-4e76-9844-da468efbc978 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:25.177491 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4eaef5-3a60-4d73-9179-38dc0ed0dc64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:25.178162 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4eaef5-3a60-4d73-9179-38dc0ed0dc64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:25.178444 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4eaef5-3a60-4d73-9179-38dc0ed0dc64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:25.178721 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4eaef5-3a60-4d73-9179-38dc0ed0dc64 admin admin] PATH_INFO: `/v3/projects/c5da192536e44088a8b53bb7379228ed` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:25.180008 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4eaef5-3a60-4d73-9179-38dc0ed0dc64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5da192536e44088a8b53bb7379228ed)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:25.181895 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4eaef5-3a60-4d73-9179-38dc0ed0dc64 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:25.232218 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-de4eaef5-3a60-4d73-9179-38dc0ed0dc64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5da192536e44088a8b53bb7379228ed', 'request_id': 'req-de4eaef5-3a60-4d73-9179-38dc0ed0dc64'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:25.239968 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-de4eaef5-3a60-4d73-9179-38dc0ed0dc64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5da192536e44088a8b53bb7379228ed', 'request_id': 'req-de4eaef5-3a60-4d73-9179-38dc0ed0dc64'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:25.246952 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-de4eaef5-3a60-4d73-9179-38dc0ed0dc64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5da192536e44088a8b53bb7379228ed', 'request_id': 'req-de4eaef5-3a60-4d73-9179-38dc0ed0dc64'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:25.258203 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-de4eaef5-3a60-4d73-9179-38dc0ed0dc64 admin admin] The token cache is being invalidate because project c5da192536e44088a8b53bb7379228ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:17:25.258488 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-de4eaef5-3a60-4d73-9179-38dc0ed0dc64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:25.259127 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-de4eaef5-3a60-4d73-9179-38dc0ed0dc64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:25.261268 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1147/2292] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:17:25 2022] DELETE /identity/v3/projects/c5da192536e44088a8b53bb7379228ed => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:17:25.266153 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a4c02-1e88-448e-b1b6-6f6fd72b3621 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:25.266458 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a4c02-1e88-448e-b1b6-6f6fd72b3621 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:25.266722 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a4c02-1e88-448e-b1b6-6f6fd72b3621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:25.287175 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-8a1a4c02-1e88-448e-b1b6-6f6fd72b3621 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:17:25.288424 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-8a1a4c02-1e88-448e-b1b6-6f6fd72b3621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:25.349519 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1146/2293] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:17:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 11:17:25.357331 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8f9fb8-8c35-47ef-ae08-fb05c203c1d2 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:25.357617 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8f9fb8-8c35-47ef-ae08-fb05c203c1d2 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:25.357891 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8f9fb8-8c35-47ef-ae08-fb05c203c1d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:25.378299 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-1b8f9fb8-8c35-47ef-ae08-fb05c203c1d2 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:17:25.379522 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-1b8f9fb8-8c35-47ef-ae08-fb05c203c1d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:25.393192 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1148/2294] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:17:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:17:25.397555 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a4c02-1e88-448e-b1b6-6f6fd72b3621 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:25.407829 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a4c02-1e88-448e-b1b6-6f6fd72b3621 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:25.413174 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc4102f-fc13-409e-b5c7-c982a0072991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:25.413776 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4102f-fc13-409e-b5c7-c982a0072991 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:25.414161 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4102f-fc13-409e-b5c7-c982a0072991 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:25.414356 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4102f-fc13-409e-b5c7-c982a0072991 admin admin] PATH_INFO: `/v3/domains` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:25.415138 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc4102f-fc13-409e-b5c7-c982a0072991 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:17:25.415327 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc4102f-fc13-409e-b5c7-c982a0072991 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:25.416915 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc4102f-fc13-409e-b5c7-c982a0072991 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:25.430003 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1147/2295] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 11:17:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:17:25.433062 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8f9fb8-8c35-47ef-ae08-fb05c203c1d2 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:25.442510 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8f9fb8-8c35-47ef-ae08-fb05c203c1d2 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:25.447650 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4156a209-9615-4e0b-8b3d-86f9aa0a03f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:25.448349 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4156a209-9615-4e0b-8b3d-86f9aa0a03f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:25.448637 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4156a209-9615-4e0b-8b3d-86f9aa0a03f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:25.448902 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4156a209-9615-4e0b-8b3d-86f9aa0a03f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:25.449538 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4156a209-9615-4e0b-8b3d-86f9aa0a03f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:25.451469 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4156a209-9615-4e0b-8b3d-86f9aa0a03f8 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:25.481744 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1149/2296] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:17:25 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:17:25.482898 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc4102f-fc13-409e-b5c7-c982a0072991 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:25.492906 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc4102f-fc13-409e-b5c7-c982a0072991 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:25.554492 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053086f9-152c-4455-941a-11e7c0dec4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:25.554941 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053086f9-152c-4455-941a-11e7c0dec4c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:25.555219 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053086f9-152c-4455-941a-11e7c0dec4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:25.555488 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053086f9-152c-4455-941a-11e7c0dec4c9 admin admin] PATH_INFO: `/v3/users` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:25.556109 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053086f9-152c-4455-941a-11e7c0dec4c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:25.558523 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053086f9-152c-4455-941a-11e7c0dec4c9 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:25.584603 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1148/2297] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:17:25 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 11:17:25.586130 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4156a209-9615-4e0b-8b3d-86f9aa0a03f8 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:25.597388 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4156a209-9615-4e0b-8b3d-86f9aa0a03f8 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:25.602014 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be07a597-deef-435e-a063-8274186d411c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:25.602611 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07a597-deef-435e-a063-8274186d411c admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:25.602886 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07a597-deef-435e-a063-8274186d411c admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:25.603154 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07a597-deef-435e-a063-8274186d411c admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:25.603845 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be07a597-deef-435e-a063-8274186d411c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:25.605418 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be07a597-deef-435e-a063-8274186d411c admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:25.608034 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:17:25.616724 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1150/2298] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:17:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:17:25.620664 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053086f9-152c-4455-941a-11e7c0dec4c9 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:25.631429 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053086f9-152c-4455-941a-11e7c0dec4c9 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:25.637162 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ad82ef-d357-4fba-a850-bf02a363745e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:25.637761 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad82ef-d357-4fba-a850-bf02a363745e admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:25.638075 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad82ef-d357-4fba-a850-bf02a363745e admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:25.638353 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad82ef-d357-4fba-a850-bf02a363745e admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:25.639018 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ad82ef-d357-4fba-a850-bf02a363745e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:25.640662 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ad82ef-d357-4fba-a850-bf02a363745e admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:25.652432 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1149/2299] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:17:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:17:25.657821 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be07a597-deef-435e-a063-8274186d411c admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:25.667814 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be07a597-deef-435e-a063-8274186d411c admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:25.672355 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2795a0-d177-48cc-93a4-1a0691b2a254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:25.672998 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2795a0-d177-48cc-93a4-1a0691b2a254 admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:25.673269 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2795a0-d177-48cc-93a4-1a0691b2a254 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:25.673567 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2795a0-d177-48cc-93a4-1a0691b2a254 admin admin] PATH_INFO: `/v3/projects/5ccceb200b9f443c84c0d13f5ca92dd3/users/9939076f3d214d139f9837692ced698e/roles/7c3871c0ab68438b9014489d50b53a22` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:25.689371 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2795a0-d177-48cc-93a4-1a0691b2a254 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ccceb200b9f443c84c0d13f5ca92dd3, user_id=9939076f3d214d139f9837692ced698e, role_id=7c3871c0ab68438b9014489d50b53a22)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:25.692036 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2795a0-d177-48cc-93a4-1a0691b2a254 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:25.705052 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1151/2300] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:17:25 2022] PUT /identity/v3/projects/5ccceb200b9f443c84c0d13f5ca92dd3/users/9939076f3d214d139f9837692ced698e/roles/7c3871c0ab68438b9014489d50b53a22 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:17:25.717143 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6413f199-bbfb-4c86-b34c-fa1fb1ce63db None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:25.717435 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6413f199-bbfb-4c86-b34c-fa1fb1ce63db None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:25.717714 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6413f199-bbfb-4c86-b34c-fa1fb1ce63db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:25.746738 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-6413f199-bbfb-4c86-b34c-fa1fb1ce63db None None] MFA Rules not processed for user `9939076f3d214d139f9837692ced698e`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:17:25.748197 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-6413f199-bbfb-4c86-b34c-fa1fb1ce63db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:25.757792 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:17:25.814447 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1150/2301] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:17:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:17:25.818917 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2795a0-d177-48cc-93a4-1a0691b2a254 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:25.881847 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2795a0-d177-48cc-93a4-1a0691b2a254 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:25.887283 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9572967-bc7f-4118-9b42-88db776466a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:25.888330 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9572967-bc7f-4118-9b42-88db776466a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:25.888828 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9572967-bc7f-4118-9b42-88db776466a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:25.889285 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9572967-bc7f-4118-9b42-88db776466a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:25.890106 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9572967-bc7f-4118-9b42-88db776466a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:25.892162 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9572967-bc7f-4118-9b42-88db776466a4 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:25.918580 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1152/2302] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:17:25 2022] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:17:25.922663 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6413f199-bbfb-4c86-b34c-fa1fb1ce63db None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:25.933890 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6413f199-bbfb-4c86-b34c-fa1fb1ce63db None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:25.989257 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995f369f-e878-4862-8bca-176fba35e536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:25.989855 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f369f-e878-4862-8bca-176fba35e536 admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:25.990165 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f369f-e878-4862-8bca-176fba35e536 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:25.990438 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f369f-e878-4862-8bca-176fba35e536 admin admin] PATH_INFO: `/v3/users` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:25.991063 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995f369f-e878-4862-8bca-176fba35e536 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:25.992959 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995f369f-e878-4862-8bca-176fba35e536 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:26.016982 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1151/2303] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:17:25 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 11:17:26.018119 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9572967-bc7f-4118-9b42-88db776466a4 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:26.028461 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9572967-bc7f-4118-9b42-88db776466a4 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:26.033368 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf70f3-8869-47d9-a0f4-a364f98aa2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:26.033998 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf70f3-8869-47d9-a0f4-a364f98aa2eb admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:26.034283 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf70f3-8869-47d9-a0f4-a364f98aa2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:26.034558 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf70f3-8869-47d9-a0f4-a364f98aa2eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:26.035207 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bf70f3-8869-47d9-a0f4-a364f98aa2eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:26.036804 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bf70f3-8869-47d9-a0f4-a364f98aa2eb admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:26.047970 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1153/2304] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:17:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 13 11:17:26.051857 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995f369f-e878-4862-8bca-176fba35e536 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:26.062265 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995f369f-e878-4862-8bca-176fba35e536 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:26.066945 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19d6702-187d-4639-8671-eb8214f65823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:26.067478 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d6702-187d-4639-8671-eb8214f65823 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:26.067760 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d6702-187d-4639-8671-eb8214f65823 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:26.068032 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d6702-187d-4639-8671-eb8214f65823 admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:26.068670 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19d6702-187d-4639-8671-eb8214f65823 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:26.070282 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19d6702-187d-4639-8671-eb8214f65823 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:26.079975 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1152/2305] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:17:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:17:26.083918 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf70f3-8869-47d9-a0f4-a364f98aa2eb admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:26.093917 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf70f3-8869-47d9-a0f4-a364f98aa2eb admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:26.098518 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466560b9-1c82-4d9d-8239-e995d92ca1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:26.099149 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466560b9-1c82-4d9d-8239-e995d92ca1ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:26.099433 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466560b9-1c82-4d9d-8239-e995d92ca1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:26.099713 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466560b9-1c82-4d9d-8239-e995d92ca1ac admin admin] PATH_INFO: `/v3/projects/bd08da7d46f848189f857305717af6f8/users/14671af4e75e409f866077943df72162/roles/7c3871c0ab68438b9014489d50b53a22` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:26.114399 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466560b9-1c82-4d9d-8239-e995d92ca1ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd08da7d46f848189f857305717af6f8, user_id=14671af4e75e409f866077943df72162, role_id=7c3871c0ab68438b9014489d50b53a22)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:26.117023 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466560b9-1c82-4d9d-8239-e995d92ca1ac admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:26.130427 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1154/2306] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:17:26 2022] PUT /identity/v3/projects/bd08da7d46f848189f857305717af6f8/users/14671af4e75e409f866077943df72162/roles/7c3871c0ab68438b9014489d50b53a22 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:17:26.140702 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3e3be-4ccc-48c4-8967-2288759b893e None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:26.140987 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3e3be-4ccc-48c4-8967-2288759b893e None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:26.141261 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3e3be-4ccc-48c4-8967-2288759b893e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:26.168808 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-dec3e3be-4ccc-48c4-8967-2288759b893e None None] MFA Rules not processed for user `14671af4e75e409f866077943df72162`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:17:26.170060 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-dec3e3be-4ccc-48c4-8967-2288759b893e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:26.231970 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1153/2307] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:17:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 11:17:26.236335 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466560b9-1c82-4d9d-8239-e995d92ca1ac admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:26.296209 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466560b9-1c82-4d9d-8239-e995d92ca1ac admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:26.300772 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882e35d1-50cb-4b0f-98fd-866671bf7cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:26.301361 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e35d1-50cb-4b0f-98fd-866671bf7cc2 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:26.301642 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e35d1-50cb-4b0f-98fd-866671bf7cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:26.301920 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e35d1-50cb-4b0f-98fd-866671bf7cc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:26.302591 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882e35d1-50cb-4b0f-98fd-866671bf7cc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:26.304514 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882e35d1-50cb-4b0f-98fd-866671bf7cc2 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:26.330702 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1155/2308] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:17:26 2022] POST /identity/v3/projects => generated 385 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:17:26.334704 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec3e3be-4ccc-48c4-8967-2288759b893e None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:26.345664 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec3e3be-4ccc-48c4-8967-2288759b893e None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:26.361859 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:17:26.403256 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bfd098-59c2-44eb-9492-ec8de299fddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:26.403862 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bfd098-59c2-44eb-9492-ec8de299fddb admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:26.404144 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bfd098-59c2-44eb-9492-ec8de299fddb admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:26.404418 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bfd098-59c2-44eb-9492-ec8de299fddb admin admin] PATH_INFO: `/v3/users` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:26.405060 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bfd098-59c2-44eb-9492-ec8de299fddb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:26.407014 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bfd098-59c2-44eb-9492-ec8de299fddb admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:26.428578 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1154/2309] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:17:26 2022] POST /identity/v3/users => generated 299 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 11:17:26.432733 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882e35d1-50cb-4b0f-98fd-866671bf7cc2 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:26.442857 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882e35d1-50cb-4b0f-98fd-866671bf7cc2 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:26.447368 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b460b2-d984-4c57-be7a-c82bfe801774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:26.447936 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b460b2-d984-4c57-be7a-c82bfe801774 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:26.448213 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b460b2-d984-4c57-be7a-c82bfe801774 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:26.448488 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b460b2-d984-4c57-be7a-c82bfe801774 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:26.449117 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b460b2-d984-4c57-be7a-c82bfe801774 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:26.450729 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b460b2-d984-4c57-be7a-c82bfe801774 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:26.452693 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:17:26.462595 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1156/2310] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:17:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:17:26.466959 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bfd098-59c2-44eb-9492-ec8de299fddb admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:26.476804 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bfd098-59c2-44eb-9492-ec8de299fddb admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:26.482041 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bafac88-b718-4a44-9a93-c27b51718e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:26.482679 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bafac88-b718-4a44-9a93-c27b51718e73 admin admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:26.482960 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bafac88-b718-4a44-9a93-c27b51718e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:26.483237 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bafac88-b718-4a44-9a93-c27b51718e73 admin admin] PATH_INFO: `/v3/projects/bb98144d3b714cc8b7a9c352ba1d4471/users/58dc245dfd504d2294ee69f2c2da8fc2/roles/ea564961b1db4eb4a1d4d880964611b2` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:26.499343 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bafac88-b718-4a44-9a93-c27b51718e73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb98144d3b714cc8b7a9c352ba1d4471, user_id=58dc245dfd504d2294ee69f2c2da8fc2, role_id=ea564961b1db4eb4a1d4d880964611b2)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:26.502257 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bafac88-b718-4a44-9a93-c27b51718e73 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:26.514731 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1155/2311] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:17:26 2022] PUT /identity/v3/projects/bb98144d3b714cc8b7a9c352ba1d4471/users/58dc245dfd504d2294ee69f2c2da8fc2/roles/ea564961b1db4eb4a1d4d880964611b2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 11:17:26.518715 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b460b2-d984-4c57-be7a-c82bfe801774 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:26.529003 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b460b2-d984-4c57-be7a-c82bfe801774 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:26.583961 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c2b60f-1b3e-49db-926f-d6808fbe6ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:26.584492 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2b60f-1b3e-49db-926f-d6808fbe6ebc admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:26.584771 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2b60f-1b3e-49db-926f-d6808fbe6ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:26.585044 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2b60f-1b3e-49db-926f-d6808fbe6ebc admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:26.585673 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c2b60f-1b3e-49db-926f-d6808fbe6ebc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:26.587295 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c2b60f-1b3e-49db-926f-d6808fbe6ebc admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:26.597101 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1157/2312] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:17:26 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:17:26.601231 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bafac88-b718-4a44-9a93-c27b51718e73 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:26.612053 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bafac88-b718-4a44-9a93-c27b51718e73 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:26.616857 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b465da2-f04a-474c-bbed-7564454a7e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:26.617504 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b465da2-f04a-474c-bbed-7564454a7e61 admin admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:26.617782 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b465da2-f04a-474c-bbed-7564454a7e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:26.618095 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b465da2-f04a-474c-bbed-7564454a7e61 admin admin] PATH_INFO: `/v3/projects/bb98144d3b714cc8b7a9c352ba1d4471/users/58dc245dfd504d2294ee69f2c2da8fc2/roles/ea564961b1db4eb4a1d4d880964611b2` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:26.620037 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b465da2-f04a-474c-bbed-7564454a7e61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb98144d3b714cc8b7a9c352ba1d4471, user_id=58dc245dfd504d2294ee69f2c2da8fc2, role_id=ea564961b1db4eb4a1d4d880964611b2)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:26.622699 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b465da2-f04a-474c-bbed-7564454a7e61 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:26.634100 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1156/2313] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:17:26 2022] PUT /identity/v3/projects/bb98144d3b714cc8b7a9c352ba1d4471/users/58dc245dfd504d2294ee69f2c2da8fc2/roles/ea564961b1db4eb4a1d4d880964611b2 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:17:26.645870 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ba655-57d9-4fe6-8b0e-f05b632c7541 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:26.646294 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ba655-57d9-4fe6-8b0e-f05b632c7541 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:26.646650 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ba655-57d9-4fe6-8b0e-f05b632c7541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:26.675858 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-912ba655-57d9-4fe6-8b0e-f05b632c7541 None None] MFA Rules not processed for user `58dc245dfd504d2294ee69f2c2da8fc2`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:17:26.677291 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-912ba655-57d9-4fe6-8b0e-f05b632c7541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:26.747612 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1158/2314] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:17:26 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:17:26.759376 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b465da2-f04a-474c-bbed-7564454a7e61 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:26.761690 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-9b465da2-f04a-474c-bbed-7564454a7e61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:26.818425 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b465da2-f04a-474c-bbed-7564454a7e61 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:26.822587 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f12bf5-1f4f-4f22-a8c4-a55bc4cdcfc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f4c2fc51f54f0e977648b13efaed1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:26.823248 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f12bf5-1f4f-4f22-a8c4-a55bc4cdcfc1 service cinder] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:26.823501 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f12bf5-1f4f-4f22-a8c4-a55bc4cdcfc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:26.823767 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f12bf5-1f4f-4f22-a8c4-a55bc4cdcfc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:26.881981 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f12bf5-1f4f-4f22-a8c4-a55bc4cdcfc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:26.883346 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f12bf5-1f4f-4f22-a8c4-a55bc4cdcfc1 service cinder] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:26.893816 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1157/2315] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:17:26 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:17:28.390420 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912ba655-57d9-4fe6-8b0e-f05b632c7541 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:28.399882 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912ba655-57d9-4fe6-8b0e-f05b632c7541 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:28.404006 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d50e4d-b880-46a9-a030-e8799258b5ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f4c2fc51f54f0e977648b13efaed1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:28.404590 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d50e4d-b880-46a9-a030-e8799258b5ba service cinder] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:28.404864 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d50e4d-b880-46a9-a030-e8799258b5ba service cinder] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:28.405133 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d50e4d-b880-46a9-a030-e8799258b5ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:28.459446 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d50e4d-b880-46a9-a030-e8799258b5ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:28.460853 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d50e4d-b880-46a9-a030-e8799258b5ba service cinder] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:28.470029 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1159/2316] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:17:28 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:17:28.902215 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f12bf5-1f4f-4f22-a8c4-a55bc4cdcfc1 service cinder] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:28.904109 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-70f12bf5-1f4f-4f22-a8c4-a55bc4cdcfc1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:28.953504 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:17:28.993348 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f12bf5-1f4f-4f22-a8c4-a55bc4cdcfc1 service cinder] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:29.000118 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24f8b9c-842a-4cb9-8153-32b663f6de31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:29.000821 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f8b9c-842a-4cb9-8153-32b663f6de31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:29.001165 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f8b9c-842a-4cb9-8153-32b663f6de31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:29.001506 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f8b9c-842a-4cb9-8153-32b663f6de31 admin admin] PATH_INFO: `/v3/users/a20fe4f63d474485a1393b128f80e782` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:29.003559 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24f8b9c-842a-4cb9-8153-32b663f6de31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a20fe4f63d474485a1393b128f80e782)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:29.005610 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24f8b9c-842a-4cb9-8153-32b663f6de31 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:29.027332 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d50e4d-b880-46a9-a030-e8799258b5ba service cinder] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:29.037426 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d50e4d-b880-46a9-a030-e8799258b5ba service cinder] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:29.042078 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6934d1cb-cb7c-4f27-ba15-875af20fb165 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f4c2fc51f54f0e977648b13efaed1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:29.042758 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934d1cb-cb7c-4f27-ba15-875af20fb165 service cinder] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:29.043113 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934d1cb-cb7c-4f27-ba15-875af20fb165 service cinder] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:29.043424 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934d1cb-cb7c-4f27-ba15-875af20fb165 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:29.054907 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6934d1cb-cb7c-4f27-ba15-875af20fb165 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:29.056989 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6934d1cb-cb7c-4f27-ba15-875af20fb165 service cinder] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:29.064451 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-d24f8b9c-842a-4cb9-8153-32b663f6de31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a20fe4f63d474485a1393b128f80e782'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:29.068188 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1160/2317] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:17:29 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 13 11:17:29.071783 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-d24f8b9c-842a-4cb9-8153-32b663f6de31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a20fe4f63d474485a1393b128f80e782'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:29.072495 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-d24f8b9c-842a-4cb9-8153-32b663f6de31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a20fe4f63d474485a1393b128f80e782'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:29.073094 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-d24f8b9c-842a-4cb9-8153-32b663f6de31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a20fe4f63d474485a1393b128f80e782'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:29.080942 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-d24f8b9c-842a-4cb9-8153-32b663f6de31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a20fe4f63d474485a1393b128f80e782'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:29.102985 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1158/2318] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:17:28 2022] DELETE /identity/v3/users/a20fe4f63d474485a1393b128f80e782 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:17:29.108062 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf9efc6-af43-4437-b322-1c8409e1f2ed None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:29.108632 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf9efc6-af43-4437-b322-1c8409e1f2ed None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:29.109102 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf9efc6-af43-4437-b322-1c8409e1f2ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:29.118102 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:17:29.135189 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-9bf9efc6-af43-4437-b322-1c8409e1f2ed None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:17:29.136590 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-9bf9efc6-af43-4437-b322-1c8409e1f2ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:29.203426 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1161/2319] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:17:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 11:17:29.213848 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24f8b9c-842a-4cb9-8153-32b663f6de31 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:29.215377 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-d24f8b9c-842a-4cb9-8153-32b663f6de31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:29.278892 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24f8b9c-842a-4cb9-8153-32b663f6de31 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:29.282648 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059dc5f3-52cf-4b92-92f2-153243435d5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:29.283295 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059dc5f3-52cf-4b92-92f2-153243435d5a service neutron] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:29.283574 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059dc5f3-52cf-4b92-92f2-153243435d5a service neutron] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:29.283845 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059dc5f3-52cf-4b92-92f2-153243435d5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:29.293919 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059dc5f3-52cf-4b92-92f2-153243435d5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:29.295685 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059dc5f3-52cf-4b92-92f2-153243435d5a service neutron] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:29.306187 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1159/2320] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:17:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 13 11:17:29.575103 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf9efc6-af43-4437-b322-1c8409e1f2ed None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:29.576601 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-9bf9efc6-af43-4437-b322-1c8409e1f2ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:29.589137 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf9efc6-af43-4437-b322-1c8409e1f2ed None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:29.593742 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87faac27-1d71-44d4-9aa1-b3ebce1340e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:29.594411 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87faac27-1d71-44d4-9aa1-b3ebce1340e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:29.594691 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87faac27-1d71-44d4-9aa1-b3ebce1340e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:29.594978 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87faac27-1d71-44d4-9aa1-b3ebce1340e2 admin admin] PATH_INFO: `/v3/projects/6288f2f220e2497092f498c967836b75` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:29.596109 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87faac27-1d71-44d4-9aa1-b3ebce1340e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6288f2f220e2497092f498c967836b75)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:29.598118 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87faac27-1d71-44d4-9aa1-b3ebce1340e2 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:29.648263 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-87faac27-1d71-44d4-9aa1-b3ebce1340e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6288f2f220e2497092f498c967836b75', 'request_id': 'req-87faac27-1d71-44d4-9aa1-b3ebce1340e2'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:29.657497 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-87faac27-1d71-44d4-9aa1-b3ebce1340e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6288f2f220e2497092f498c967836b75', 'request_id': 'req-87faac27-1d71-44d4-9aa1-b3ebce1340e2'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:29.664313 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-87faac27-1d71-44d4-9aa1-b3ebce1340e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6288f2f220e2497092f498c967836b75', 'request_id': 'req-87faac27-1d71-44d4-9aa1-b3ebce1340e2'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:29.677671 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-87faac27-1d71-44d4-9aa1-b3ebce1340e2 admin admin] The token cache is being invalidate because project 6288f2f220e2497092f498c967836b75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:17:29.677969 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-87faac27-1d71-44d4-9aa1-b3ebce1340e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:29.678651 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-87faac27-1d71-44d4-9aa1-b3ebce1340e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:29.680164 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1162/2321] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:17:29 2022] DELETE /identity/v3/projects/6288f2f220e2497092f498c967836b75 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:17:29.685148 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5254ea-9852-4fc8-a442-c58b5807873b None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:29.685512 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5254ea-9852-4fc8-a442-c58b5807873b None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:29.685797 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5254ea-9852-4fc8-a442-c58b5807873b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:29.706314 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-3d5254ea-9852-4fc8-a442-c58b5807873b None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:17:29.707532 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-3d5254ea-9852-4fc8-a442-c58b5807873b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:29.751839 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:17:29.770337 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1160/2322] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:17:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:17:29.779097 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce0e3d-3bdb-444b-a6d0-ed881e10071a None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:29.779383 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce0e3d-3bdb-444b-a6d0-ed881e10071a None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:29.779664 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce0e3d-3bdb-444b-a6d0-ed881e10071a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:29.799423 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-ddce0e3d-3bdb-444b-a6d0-ed881e10071a None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:17:29.800700 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-ddce0e3d-3bdb-444b-a6d0-ed881e10071a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:29.809109 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1163/2323] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:17:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:17:29.813476 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5254ea-9852-4fc8-a442-c58b5807873b None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:29.824123 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5254ea-9852-4fc8-a442-c58b5807873b None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:29.829272 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d719fba2-c6be-47b7-a498-f6649f8621ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:29.829868 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719fba2-c6be-47b7-a498-f6649f8621ea admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:29.830175 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719fba2-c6be-47b7-a498-f6649f8621ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:29.830445 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719fba2-c6be-47b7-a498-f6649f8621ea admin admin] PATH_INFO: `/v3/domains` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:29.831090 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d719fba2-c6be-47b7-a498-f6649f8621ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:17:29.831387 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d719fba2-c6be-47b7-a498-f6649f8621ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:29.832948 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d719fba2-c6be-47b7-a498-f6649f8621ea admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:29.845705 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1161/2324] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 11:17:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:17:29.850737 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddce0e3d-3bdb-444b-a6d0-ed881e10071a None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:29.860041 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddce0e3d-3bdb-444b-a6d0-ed881e10071a None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:29.864897 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef26226-292a-4465-ba49-c66187b59c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:29.865483 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef26226-292a-4465-ba49-c66187b59c3c admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:29.865760 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef26226-292a-4465-ba49-c66187b59c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:29.866055 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef26226-292a-4465-ba49-c66187b59c3c admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:29.866685 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef26226-292a-4465-ba49-c66187b59c3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:29.868554 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef26226-292a-4465-ba49-c66187b59c3c admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:29.900717 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1164/2325] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:17:29 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:17:29.903842 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d719fba2-c6be-47b7-a498-f6649f8621ea admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:29.913732 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d719fba2-c6be-47b7-a498-f6649f8621ea admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:29.968825 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbe3e85-04c5-4c9b-9125-df91f81fcbc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:29.969420 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe3e85-04c5-4c9b-9125-df91f81fcbc7 admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:29.969724 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe3e85-04c5-4c9b-9125-df91f81fcbc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:29.970036 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe3e85-04c5-4c9b-9125-df91f81fcbc7 admin admin] PATH_INFO: `/v3/users` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:29.970707 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbe3e85-04c5-4c9b-9125-df91f81fcbc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:29.972666 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbe3e85-04c5-4c9b-9125-df91f81fcbc7 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:29.993583 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1162/2326] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:17:29 2022] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:17:29.997054 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef26226-292a-4465-ba49-c66187b59c3c admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:30.007348 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef26226-292a-4465-ba49-c66187b59c3c admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:30.012528 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46820fe8-0bf7-45d4-900e-925febd368ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:30.013152 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46820fe8-0bf7-45d4-900e-925febd368ee admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:30.013429 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46820fe8-0bf7-45d4-900e-925febd368ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:30.013701 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46820fe8-0bf7-45d4-900e-925febd368ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:30.014370 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46820fe8-0bf7-45d4-900e-925febd368ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:30.015948 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46820fe8-0bf7-45d4-900e-925febd368ee admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:30.026297 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1165/2327] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:17:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:17:30.030092 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbe3e85-04c5-4c9b-9125-df91f81fcbc7 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:30.039927 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbe3e85-04c5-4c9b-9125-df91f81fcbc7 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:30.044842 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07345b23-0499-4f52-834f-39dfb9ed57b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:30.045429 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07345b23-0499-4f52-834f-39dfb9ed57b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:30.045710 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07345b23-0499-4f52-834f-39dfb9ed57b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:30.046017 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07345b23-0499-4f52-834f-39dfb9ed57b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:30.046660 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07345b23-0499-4f52-834f-39dfb9ed57b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:30.048224 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07345b23-0499-4f52-834f-39dfb9ed57b0 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:30.059025 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1163/2328] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:17:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:17:30.062972 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46820fe8-0bf7-45d4-900e-925febd368ee admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:30.073153 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46820fe8-0bf7-45d4-900e-925febd368ee admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:30.077635 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814541aa-82b0-4881-9648-06f6b36b1fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:30.078302 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814541aa-82b0-4881-9648-06f6b36b1fb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:30.078580 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814541aa-82b0-4881-9648-06f6b36b1fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:30.078852 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814541aa-82b0-4881-9648-06f6b36b1fb3 admin admin] PATH_INFO: `/v3/projects/4e59effa1d4c4902be8bbe14f94f94e5/users/a487bce8e3664bd3969b645f7f3021f7/roles/7c3871c0ab68438b9014489d50b53a22` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:30.093173 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814541aa-82b0-4881-9648-06f6b36b1fb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e59effa1d4c4902be8bbe14f94f94e5, user_id=a487bce8e3664bd3969b645f7f3021f7, role_id=7c3871c0ab68438b9014489d50b53a22)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:30.095868 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814541aa-82b0-4881-9648-06f6b36b1fb3 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:30.109075 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1166/2329] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:17:30 2022] PUT /identity/v3/projects/4e59effa1d4c4902be8bbe14f94f94e5/users/a487bce8e3664bd3969b645f7f3021f7/roles/7c3871c0ab68438b9014489d50b53a22 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:17:30.119932 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d981eae-eba5-4b30-89d0-b1c4df810d3f None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:30.120347 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d981eae-eba5-4b30-89d0-b1c4df810d3f None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:30.120687 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d981eae-eba5-4b30-89d0-b1c4df810d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:30.148684 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-5d981eae-eba5-4b30-89d0-b1c4df810d3f None None] MFA Rules not processed for user `a487bce8e3664bd3969b645f7f3021f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:17:30.149890 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-5d981eae-eba5-4b30-89d0-b1c4df810d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:30.213218 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1164/2330] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:17:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:17:30.217859 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814541aa-82b0-4881-9648-06f6b36b1fb3 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:30.245256 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:17:30.282184 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814541aa-82b0-4881-9648-06f6b36b1fb3 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:30.286838 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f9b387-19f6-48f4-a150-c039ad255ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:30.287443 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f9b387-19f6-48f4-a150-c039ad255ccc admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:30.287720 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f9b387-19f6-48f4-a150-c039ad255ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:30.287999 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f9b387-19f6-48f4-a150-c039ad255ccc admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:30.288654 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f9b387-19f6-48f4-a150-c039ad255ccc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:30.290577 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f9b387-19f6-48f4-a150-c039ad255ccc admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:30.320599 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1167/2331] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:17:30 2022] POST /identity/v3/projects => generated 369 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:17:30.321703 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d981eae-eba5-4b30-89d0-b1c4df810d3f None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:30.333653 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d981eae-eba5-4b30-89d0-b1c4df810d3f None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:30.375500 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:17:30.396022 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54ce7f3-a362-437c-a15c-f7f0ed3fcac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:30.396627 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54ce7f3-a362-437c-a15c-f7f0ed3fcac8 admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:30.396904 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54ce7f3-a362-437c-a15c-f7f0ed3fcac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:30.397174 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54ce7f3-a362-437c-a15c-f7f0ed3fcac8 admin admin] PATH_INFO: `/v3/users` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:30.397811 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54ce7f3-a362-437c-a15c-f7f0ed3fcac8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:30.400357 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54ce7f3-a362-437c-a15c-f7f0ed3fcac8 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:30.437586 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1165/2332] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:17:30 2022] POST /identity/v3/users => generated 291 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 11:17:30.440474 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f9b387-19f6-48f4-a150-c039ad255ccc admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:30.452935 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f9b387-19f6-48f4-a150-c039ad255ccc admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:30.458906 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9d9194-876f-4e3b-b178-b9573b0ebb21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:30.459839 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d9194-876f-4e3b-b178-b9573b0ebb21 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:30.460343 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d9194-876f-4e3b-b178-b9573b0ebb21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:30.461134 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d9194-876f-4e3b-b178-b9573b0ebb21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:30.462641 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9d9194-876f-4e3b-b178-b9573b0ebb21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:30.467282 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9d9194-876f-4e3b-b178-b9573b0ebb21 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:30.480382 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1168/2333] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:17:30 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:17:30.484696 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54ce7f3-a362-437c-a15c-f7f0ed3fcac8 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:30.495401 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54ce7f3-a362-437c-a15c-f7f0ed3fcac8 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:30.500121 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179a84b3-e1cb-4d93-a31e-a5e1c574aa7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:30.500769 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a84b3-e1cb-4d93-a31e-a5e1c574aa7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:30.501048 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a84b3-e1cb-4d93-a31e-a5e1c574aa7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:30.501323 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a84b3-e1cb-4d93-a31e-a5e1c574aa7d admin admin] PATH_INFO: `/v3/projects/bd44960cb62549f0a348ba78b87d03fb/users/f7394bd5bdf141bd9c891d6e87d14ef6/roles/ea564961b1db4eb4a1d4d880964611b2` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:30.517341 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179a84b3-e1cb-4d93-a31e-a5e1c574aa7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd44960cb62549f0a348ba78b87d03fb, user_id=f7394bd5bdf141bd9c891d6e87d14ef6, role_id=ea564961b1db4eb4a1d4d880964611b2)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:30.519998 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179a84b3-e1cb-4d93-a31e-a5e1c574aa7d admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:30.533590 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1166/2334] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:17:30 2022] PUT /identity/v3/projects/bd44960cb62549f0a348ba78b87d03fb/users/f7394bd5bdf141bd9c891d6e87d14ef6/roles/ea564961b1db4eb4a1d4d880964611b2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:17:30.538288 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9d9194-876f-4e3b-b178-b9573b0ebb21 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:30.549188 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9d9194-876f-4e3b-b178-b9573b0ebb21 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:30.603714 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d87d1-41d6-45aa-9bb5-3e66f8104516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:30.604406 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d87d1-41d6-45aa-9bb5-3e66f8104516 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:30.604693 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d87d1-41d6-45aa-9bb5-3e66f8104516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:30.604962 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d87d1-41d6-45aa-9bb5-3e66f8104516 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:30.605584 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5d87d1-41d6-45aa-9bb5-3e66f8104516 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:30.607189 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5d87d1-41d6-45aa-9bb5-3e66f8104516 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:30.616745 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1169/2335] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:17:30 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:17:30.621569 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179a84b3-e1cb-4d93-a31e-a5e1c574aa7d admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:30.632474 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179a84b3-e1cb-4d93-a31e-a5e1c574aa7d admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:30.638189 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e763a2-7e05-4db0-9a6a-3eab59ae13f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:30.639229 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e763a2-7e05-4db0-9a6a-3eab59ae13f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:30.639671 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e763a2-7e05-4db0-9a6a-3eab59ae13f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:30.639951 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e763a2-7e05-4db0-9a6a-3eab59ae13f6 admin admin] PATH_INFO: `/v3/projects/bd44960cb62549f0a348ba78b87d03fb/users/f7394bd5bdf141bd9c891d6e87d14ef6/roles/ea564961b1db4eb4a1d4d880964611b2` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:30.642368 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e763a2-7e05-4db0-9a6a-3eab59ae13f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd44960cb62549f0a348ba78b87d03fb, user_id=f7394bd5bdf141bd9c891d6e87d14ef6, role_id=ea564961b1db4eb4a1d4d880964611b2)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:30.644970 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e763a2-7e05-4db0-9a6a-3eab59ae13f6 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:30.655171 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1167/2336] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:17:30 2022] PUT /identity/v3/projects/bd44960cb62549f0a348ba78b87d03fb/users/f7394bd5bdf141bd9c891d6e87d14ef6/roles/ea564961b1db4eb4a1d4d880964611b2 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:17:30.667209 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2cfef6-1e7e-4fec-9959-dc153c5225d3 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:30.667497 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2cfef6-1e7e-4fec-9959-dc153c5225d3 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:30.667773 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2cfef6-1e7e-4fec-9959-dc153c5225d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:30.695509 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-ec2cfef6-1e7e-4fec-9959-dc153c5225d3 None None] MFA Rules not processed for user `f7394bd5bdf141bd9c891d6e87d14ef6`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:17:30.696641 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-ec2cfef6-1e7e-4fec-9959-dc153c5225d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:30.762562 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1170/2337] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:17:30 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:17:30.773924 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e763a2-7e05-4db0-9a6a-3eab59ae13f6 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:30.775672 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-40e763a2-7e05-4db0-9a6a-3eab59ae13f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:30.833995 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e763a2-7e05-4db0-9a6a-3eab59ae13f6 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:30.838207 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b111e-b04c-4227-8979-e4d5c11e3f77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f4c2fc51f54f0e977648b13efaed1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:30.838812 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b111e-b04c-4227-8979-e4d5c11e3f77 service cinder] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:30.839096 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b111e-b04c-4227-8979-e4d5c11e3f77 service cinder] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:30.839388 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b111e-b04c-4227-8979-e4d5c11e3f77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:30.848170 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0b111e-b04c-4227-8979-e4d5c11e3f77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:30.849588 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0b111e-b04c-4227-8979-e4d5c11e3f77 service cinder] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:30.859409 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1168/2338] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:17:30 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:17:31.237521 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2cfef6-1e7e-4fec-9959-dc153c5225d3 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:31.258227 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:17:31.300924 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2cfef6-1e7e-4fec-9959-dc153c5225d3 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:31.305394 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dcef31-cb9b-437d-8a8d-3f98e41b74d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:31.306041 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dcef31-cb9b-437d-8a8d-3f98e41b74d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:31.306324 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dcef31-cb9b-437d-8a8d-3f98e41b74d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:31.306601 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dcef31-cb9b-437d-8a8d-3f98e41b74d3 admin admin] PATH_INFO: `/v3/users/a487bce8e3664bd3969b645f7f3021f7` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:31.307744 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dcef31-cb9b-437d-8a8d-3f98e41b74d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a487bce8e3664bd3969b645f7f3021f7)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:31.309657 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dcef31-cb9b-437d-8a8d-3f98e41b74d3 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:31.354558 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-41dcef31-cb9b-437d-8a8d-3f98e41b74d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a487bce8e3664bd3969b645f7f3021f7'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:31.355198 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-41dcef31-cb9b-437d-8a8d-3f98e41b74d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a487bce8e3664bd3969b645f7f3021f7'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:31.355790 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-41dcef31-cb9b-437d-8a8d-3f98e41b74d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a487bce8e3664bd3969b645f7f3021f7'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:31.367319 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-41dcef31-cb9b-437d-8a8d-3f98e41b74d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a487bce8e3664bd3969b645f7f3021f7'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:31.374292 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-41dcef31-cb9b-437d-8a8d-3f98e41b74d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a487bce8e3664bd3969b645f7f3021f7'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:31.386756 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1171/2339] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:17:31 2022] DELETE /identity/v3/users/a487bce8e3664bd3969b645f7f3021f7 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:17:31.391303 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc813bf-3d3b-42fc-8bc5-3dc81b5f9667 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:31.391790 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc813bf-3d3b-42fc-8bc5-3dc81b5f9667 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:31.391892 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc813bf-3d3b-42fc-8bc5-3dc81b5f9667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:31.410624 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-8cc813bf-3d3b-42fc-8bc5-3dc81b5f9667 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:17:31.411826 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-8cc813bf-3d3b-42fc-8bc5-3dc81b5f9667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:31.468162 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1169/2340] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:17:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:17:31.477742 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dcef31-cb9b-437d-8a8d-3f98e41b74d3 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:31.479204 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-41dcef31-cb9b-437d-8a8d-3f98e41b74d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:31.538616 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dcef31-cb9b-437d-8a8d-3f98e41b74d3 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:31.542425 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7925f82a-8b2e-4124-8386-957bee36b123 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:31.543026 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7925f82a-8b2e-4124-8386-957bee36b123 service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:31.543300 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7925f82a-8b2e-4124-8386-957bee36b123 service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:31.543572 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7925f82a-8b2e-4124-8386-957bee36b123 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:31.553997 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7925f82a-8b2e-4124-8386-957bee36b123 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:31.555467 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7925f82a-8b2e-4124-8386-957bee36b123 service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:31.565397 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1172/2341] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:17:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:17:31.853002 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc813bf-3d3b-42fc-8bc5-3dc81b5f9667 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:31.854459 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-8cc813bf-3d3b-42fc-8bc5-3dc81b5f9667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:31.869814 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc813bf-3d3b-42fc-8bc5-3dc81b5f9667 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:31.874806 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3126e4-a28a-45a1-b004-6f099ff462bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:31.875442 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3126e4-a28a-45a1-b004-6f099ff462bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:31.886705 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3126e4-a28a-45a1-b004-6f099ff462bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:31.894666 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3126e4-a28a-45a1-b004-6f099ff462bd admin admin] PATH_INFO: `/v3/projects/4e59effa1d4c4902be8bbe14f94f94e5` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:31.896438 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3126e4-a28a-45a1-b004-6f099ff462bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e59effa1d4c4902be8bbe14f94f94e5)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:31.898435 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3126e4-a28a-45a1-b004-6f099ff462bd admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:31.935126 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:17:31.945620 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-fb3126e4-a28a-45a1-b004-6f099ff462bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e59effa1d4c4902be8bbe14f94f94e5', 'request_id': 'req-fb3126e4-a28a-45a1-b004-6f099ff462bd'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:31.952909 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-fb3126e4-a28a-45a1-b004-6f099ff462bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e59effa1d4c4902be8bbe14f94f94e5', 'request_id': 'req-fb3126e4-a28a-45a1-b004-6f099ff462bd'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:31.958444 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-fb3126e4-a28a-45a1-b004-6f099ff462bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e59effa1d4c4902be8bbe14f94f94e5', 'request_id': 'req-fb3126e4-a28a-45a1-b004-6f099ff462bd'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:31.970579 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-fb3126e4-a28a-45a1-b004-6f099ff462bd admin admin] The token cache is being invalidate because project 4e59effa1d4c4902be8bbe14f94f94e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:17:31.970807 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-fb3126e4-a28a-45a1-b004-6f099ff462bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:31.971423 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-fb3126e4-a28a-45a1-b004-6f099ff462bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:31.972953 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1170/2342] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:17:31 2022] DELETE /identity/v3/projects/4e59effa1d4c4902be8bbe14f94f94e5 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:17:31.977288 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7925f82a-8b2e-4124-8386-957bee36b123 service neutron] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:31.987483 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7925f82a-8b2e-4124-8386-957bee36b123 service neutron] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:32.026777 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:17:32.046918 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce503bb-e42a-4f1e-9c69-82b6799a2df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:32.047565 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce503bb-e42a-4f1e-9c69-82b6799a2df1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:32.047839 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce503bb-e42a-4f1e-9c69-82b6799a2df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:32.048113 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce503bb-e42a-4f1e-9c69-82b6799a2df1 admin admin] PATH_INFO: `/v3/users/f7394bd5bdf141bd9c891d6e87d14ef6` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:32.049279 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce503bb-e42a-4f1e-9c69-82b6799a2df1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7394bd5bdf141bd9c891d6e87d14ef6)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:32.052026 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce503bb-e42a-4f1e-9c69-82b6799a2df1 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:32.098649 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-4ce503bb-e42a-4f1e-9c69-82b6799a2df1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7394bd5bdf141bd9c891d6e87d14ef6'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:32.099287 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-4ce503bb-e42a-4f1e-9c69-82b6799a2df1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7394bd5bdf141bd9c891d6e87d14ef6'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:32.099882 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-4ce503bb-e42a-4f1e-9c69-82b6799a2df1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7394bd5bdf141bd9c891d6e87d14ef6'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:32.112095 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-4ce503bb-e42a-4f1e-9c69-82b6799a2df1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7394bd5bdf141bd9c891d6e87d14ef6'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:32.119756 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-4ce503bb-e42a-4f1e-9c69-82b6799a2df1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7394bd5bdf141bd9c891d6e87d14ef6'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:32.133132 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1173/2343] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:17:31 2022] DELETE /identity/v3/users/f7394bd5bdf141bd9c891d6e87d14ef6 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:17:32.399162 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3126e4-a28a-45a1-b004-6f099ff462bd admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:32.401107 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-fb3126e4-a28a-45a1-b004-6f099ff462bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:32.414166 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3126e4-a28a-45a1-b004-6f099ff462bd admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:32.470253 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58229b05-6ed4-418f-92c2-7f23b70a7928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:32.470878 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58229b05-6ed4-418f-92c2-7f23b70a7928 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:32.471151 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58229b05-6ed4-418f-92c2-7f23b70a7928 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:32.471418 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58229b05-6ed4-418f-92c2-7f23b70a7928 admin admin] PATH_INFO: `/v3/projects/bd44960cb62549f0a348ba78b87d03fb` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:32.472518 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58229b05-6ed4-418f-92c2-7f23b70a7928 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd44960cb62549f0a348ba78b87d03fb)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:32.474427 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58229b05-6ed4-418f-92c2-7f23b70a7928 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:32.519026 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-58229b05-6ed4-418f-92c2-7f23b70a7928 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd44960cb62549f0a348ba78b87d03fb', 'request_id': 'req-58229b05-6ed4-418f-92c2-7f23b70a7928'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:32.524927 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-58229b05-6ed4-418f-92c2-7f23b70a7928 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd44960cb62549f0a348ba78b87d03fb', 'request_id': 'req-58229b05-6ed4-418f-92c2-7f23b70a7928'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:32.530911 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-58229b05-6ed4-418f-92c2-7f23b70a7928 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd44960cb62549f0a348ba78b87d03fb', 'request_id': 'req-58229b05-6ed4-418f-92c2-7f23b70a7928'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:32.543465 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-58229b05-6ed4-418f-92c2-7f23b70a7928 admin admin] The token cache is being invalidate because project bd44960cb62549f0a348ba78b87d03fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:17:32.543676 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-58229b05-6ed4-418f-92c2-7f23b70a7928 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:32.544194 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-58229b05-6ed4-418f-92c2-7f23b70a7928 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:32.545652 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1171/2344] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:17:32 2022] DELETE /identity/v3/projects/bd44960cb62549f0a348ba78b87d03fb => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:17:32.550550 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36fa2df-f47a-415a-abfb-54a31123fb5a None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:32.550858 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36fa2df-f47a-415a-abfb-54a31123fb5a None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:32.551128 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36fa2df-f47a-415a-abfb-54a31123fb5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:32.570269 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-f36fa2df-f47a-415a-abfb-54a31123fb5a None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:17:32.571458 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-f36fa2df-f47a-415a-abfb-54a31123fb5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:32.627921 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1174/2345] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:17:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 11:17:32.636417 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84d39c-f10f-4784-96ec-1bb8ace6358a None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:32.636702 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84d39c-f10f-4784-96ec-1bb8ace6358a None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:32.636975 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84d39c-f10f-4784-96ec-1bb8ace6358a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:32.657418 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-3d84d39c-f10f-4784-96ec-1bb8ace6358a None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:17:32.658648 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-3d84d39c-f10f-4784-96ec-1bb8ace6358a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:32.667129 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1172/2346] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:17:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:17:32.671151 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36fa2df-f47a-415a-abfb-54a31123fb5a None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:32.680843 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36fa2df-f47a-415a-abfb-54a31123fb5a None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:32.685479 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66174c6c-3981-499b-8e31-54ca0dc16137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:32.686101 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66174c6c-3981-499b-8e31-54ca0dc16137 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:32.686376 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66174c6c-3981-499b-8e31-54ca0dc16137 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:32.686645 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66174c6c-3981-499b-8e31-54ca0dc16137 admin admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:32.687286 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66174c6c-3981-499b-8e31-54ca0dc16137 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:17:32.687584 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66174c6c-3981-499b-8e31-54ca0dc16137 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:32.689160 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66174c6c-3981-499b-8e31-54ca0dc16137 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:32.701085 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1175/2347] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 11:17:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 11:17:32.704889 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d84d39c-f10f-4784-96ec-1bb8ace6358a None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:32.714393 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d84d39c-f10f-4784-96ec-1bb8ace6358a None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:32.718952 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce22d113-f8f1-4cee-b92f-bfead9599c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:32.719532 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce22d113-f8f1-4cee-b92f-bfead9599c1e admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:32.719808 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce22d113-f8f1-4cee-b92f-bfead9599c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:32.720075 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce22d113-f8f1-4cee-b92f-bfead9599c1e admin admin] PATH_INFO: `/v3/projects` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:32.720700 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce22d113-f8f1-4cee-b92f-bfead9599c1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:32.722603 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce22d113-f8f1-4cee-b92f-bfead9599c1e admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:32.749089 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1173/2348] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:17:32 2022] POST /identity/v3/projects => generated 387 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 11:17:32.753161 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66174c6c-3981-499b-8e31-54ca0dc16137 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:32.763413 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66174c6c-3981-499b-8e31-54ca0dc16137 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:32.805826 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:17:32.818992 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c6a8c8-a1b8-4c50-b103-6414dcc25c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:32.819592 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c6a8c8-a1b8-4c50-b103-6414dcc25c60 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:32.819870 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c6a8c8-a1b8-4c50-b103-6414dcc25c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:32.820143 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c6a8c8-a1b8-4c50-b103-6414dcc25c60 admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:32.820764 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c6a8c8-a1b8-4c50-b103-6414dcc25c60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:32.823202 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c6a8c8-a1b8-4c50-b103-6414dcc25c60 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:32.844317 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1176/2349] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:17:32 2022] POST /identity/v3/users => generated 294 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:17:32.848267 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce22d113-f8f1-4cee-b92f-bfead9599c1e admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:32.859036 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce22d113-f8f1-4cee-b92f-bfead9599c1e admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:32.866323 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2b4236-9871-4687-a7ba-1698936ee116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:32.866985 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2b4236-9871-4687-a7ba-1698936ee116 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:32.867261 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2b4236-9871-4687-a7ba-1698936ee116 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:32.867530 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2b4236-9871-4687-a7ba-1698936ee116 admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:32.868170 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2b4236-9871-4687-a7ba-1698936ee116 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:32.869741 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2b4236-9871-4687-a7ba-1698936ee116 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:32.880066 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1174/2350] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:17:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:17:32.884083 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c6a8c8-a1b8-4c50-b103-6414dcc25c60 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:32.895043 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c6a8c8-a1b8-4c50-b103-6414dcc25c60 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:32.899536 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae504a11-12cc-4696-afdc-1cc04b772886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:32.900767 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae504a11-12cc-4696-afdc-1cc04b772886 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:32.901046 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae504a11-12cc-4696-afdc-1cc04b772886 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:32.901318 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae504a11-12cc-4696-afdc-1cc04b772886 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:32.901984 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae504a11-12cc-4696-afdc-1cc04b772886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:32.903571 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae504a11-12cc-4696-afdc-1cc04b772886 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:32.917200 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1177/2351] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:17:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:17:32.918639 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2b4236-9871-4687-a7ba-1698936ee116 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:32.929810 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2b4236-9871-4687-a7ba-1698936ee116 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:32.935050 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb20b52-6b7a-4e15-8afc-3a5def319f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:32.935737 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb20b52-6b7a-4e15-8afc-3a5def319f6d admin admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:32.935982 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb20b52-6b7a-4e15-8afc-3a5def319f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:32.936257 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb20b52-6b7a-4e15-8afc-3a5def319f6d admin admin] PATH_INFO: `/v3/projects/0b5508a4ebff4a9c82134bb766d2ad46/users/4431842386094eee898f6c1c6a887634/roles/7c3871c0ab68438b9014489d50b53a22` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:32.950230 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:17:32.954702 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb20b52-6b7a-4e15-8afc-3a5def319f6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b5508a4ebff4a9c82134bb766d2ad46, user_id=4431842386094eee898f6c1c6a887634, role_id=7c3871c0ab68438b9014489d50b53a22)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:32.958657 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb20b52-6b7a-4e15-8afc-3a5def319f6d admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:32.971097 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae504a11-12cc-4696-afdc-1cc04b772886 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:32.973096 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-ae504a11-12cc-4696-afdc-1cc04b772886 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:32.976301 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1175/2352] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:17:32 2022] PUT /identity/v3/projects/0b5508a4ebff4a9c82134bb766d2ad46/users/4431842386094eee898f6c1c6a887634/roles/7c3871c0ab68438b9014489d50b53a22 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:17:32.986077 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae504a11-12cc-4696-afdc-1cc04b772886 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:32.986597 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d906e36-c1a2-4908-a0a8-a13420ffe5d5 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:32.986597 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d906e36-c1a2-4908-a0a8-a13420ffe5d5 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:32.986795 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d906e36-c1a2-4908-a0a8-a13420ffe5d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:33.014751 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-8d906e36-c1a2-4908-a0a8-a13420ffe5d5 None None] MFA Rules not processed for user `4431842386094eee898f6c1c6a887634`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:17:33.016168 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-8d906e36-c1a2-4908-a0a8-a13420ffe5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:33.043367 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e87aba-fe71-4628-99c6-1d4d6557b6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:33.044013 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e87aba-fe71-4628-99c6-1d4d6557b6b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:33.044277 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e87aba-fe71-4628-99c6-1d4d6557b6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:33.044586 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e87aba-fe71-4628-99c6-1d4d6557b6b5 admin admin] PATH_INFO: `/v3/users/9939076f3d214d139f9837692ced698e` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:33.045683 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e87aba-fe71-4628-99c6-1d4d6557b6b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9939076f3d214d139f9837692ced698e)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:33.047626 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e87aba-fe71-4628-99c6-1d4d6557b6b5 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:33.081347 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1176/2353] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:17:32 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 11:17:33.085756 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d906e36-c1a2-4908-a0a8-a13420ffe5d5 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:33.094266 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-c0e87aba-fe71-4628-99c6-1d4d6557b6b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9939076f3d214d139f9837692ced698e'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:33.095044 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-c0e87aba-fe71-4628-99c6-1d4d6557b6b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9939076f3d214d139f9837692ced698e'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:33.096058 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-c0e87aba-fe71-4628-99c6-1d4d6557b6b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9939076f3d214d139f9837692ced698e'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:33.096220 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d906e36-c1a2-4908-a0a8-a13420ffe5d5 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:33.100774 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece7e8e3-71b4-4235-8e0a-2489fd00da5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:33.101360 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7e8e3-71b4-4235-8e0a-2489fd00da5a admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:33.101640 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7e8e3-71b4-4235-8e0a-2489fd00da5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:33.101914 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7e8e3-71b4-4235-8e0a-2489fd00da5a admin admin] PATH_INFO: `/v3/projects` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:33.102571 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece7e8e3-71b4-4235-8e0a-2489fd00da5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:33.104493 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece7e8e3-71b4-4235-8e0a-2489fd00da5a admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:33.108685 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-c0e87aba-fe71-4628-99c6-1d4d6557b6b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9939076f3d214d139f9837692ced698e'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:33.116766 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-c0e87aba-fe71-4628-99c6-1d4d6557b6b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9939076f3d214d139f9837692ced698e'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:33.131363 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1178/2354] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:17:32 2022] DELETE /identity/v3/users/9939076f3d214d139f9837692ced698e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 11:17:33.132812 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1177/2355] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:17:33 2022] POST /identity/v3/projects => generated 387 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 11:17:33.137387 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece7e8e3-71b4-4235-8e0a-2489fd00da5a admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:33.137850 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233672e3-691c-446a-af13-33f0e24f10d7 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:33.138576 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233672e3-691c-446a-af13-33f0e24f10d7 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:33.138922 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233672e3-691c-446a-af13-33f0e24f10d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:33.139222 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-ece7e8e3-71b4-4235-8e0a-2489fd00da5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:33.158673 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-233672e3-691c-446a-af13-33f0e24f10d7 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:17:33.159877 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-233672e3-691c-446a-af13-33f0e24f10d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:33.202053 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece7e8e3-71b4-4235-8e0a-2489fd00da5a admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:33.202487 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:17:33.207381 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e0ddd5-93de-438d-aea5-59c4b6f27fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:33.208310 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e0ddd5-93de-438d-aea5-59c4b6f27fff admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:33.208755 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e0ddd5-93de-438d-aea5-59c4b6f27fff admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:33.209048 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e0ddd5-93de-438d-aea5-59c4b6f27fff admin admin] PATH_INFO: `/v3/users` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:33.209705 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e0ddd5-93de-438d-aea5-59c4b6f27fff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:33.211867 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e0ddd5-93de-438d-aea5-59c4b6f27fff admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:33.223865 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1179/2356] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:17:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:17:33.230370 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233672e3-691c-446a-af13-33f0e24f10d7 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:33.231778 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-233672e3-691c-446a-af13-33f0e24f10d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:33.233834 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1178/2357] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:17:33 2022] POST /identity/v3/users => generated 300 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 11:17:33.237661 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e0ddd5-93de-438d-aea5-59c4b6f27fff admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:33.247959 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e0ddd5-93de-438d-aea5-59c4b6f27fff admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:33.252739 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6217fdf-8351-45a0-8fe1-109f242f6963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:33.253317 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6217fdf-8351-45a0-8fe1-109f242f6963 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:33.253592 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6217fdf-8351-45a0-8fe1-109f242f6963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:33.253862 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6217fdf-8351-45a0-8fe1-109f242f6963 admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:33.254543 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6217fdf-8351-45a0-8fe1-109f242f6963 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:33.256210 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6217fdf-8351-45a0-8fe1-109f242f6963 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:33.267609 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1179/2358] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:17:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 13 11:17:33.271616 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6217fdf-8351-45a0-8fe1-109f242f6963 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:33.281336 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6217fdf-8351-45a0-8fe1-109f242f6963 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:33.286236 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd681feb-2181-4195-a73e-d135aa4400d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:33.286894 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd681feb-2181-4195-a73e-d135aa4400d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:33.287173 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd681feb-2181-4195-a73e-d135aa4400d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:33.287469 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd681feb-2181-4195-a73e-d135aa4400d7 admin admin] PATH_INFO: `/v3/projects/b2dd123dc0c94fe59c20e5335d88c3a4/users/a41dc313ca1f42f3bc13a9e4892453f6/roles/ea564961b1db4eb4a1d4d880964611b2` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:33.289120 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233672e3-691c-446a-af13-33f0e24f10d7 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:33.293712 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965e8af8-7fb3-4ee7-b10b-779ab99a7e0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:33.294350 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e8af8-7fb3-4ee7-b10b-779ab99a7e0e service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:33.294627 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e8af8-7fb3-4ee7-b10b-779ab99a7e0e service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:33.294898 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e8af8-7fb3-4ee7-b10b-779ab99a7e0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:33.301998 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd681feb-2181-4195-a73e-d135aa4400d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2dd123dc0c94fe59c20e5335d88c3a4, user_id=a41dc313ca1f42f3bc13a9e4892453f6, role_id=ea564961b1db4eb4a1d4d880964611b2)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:33.303956 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965e8af8-7fb3-4ee7-b10b-779ab99a7e0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:33.304592 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd681feb-2181-4195-a73e-d135aa4400d7 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:33.305368 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965e8af8-7fb3-4ee7-b10b-779ab99a7e0e service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:33.316359 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1180/2359] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:17:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 13 11:17:33.318148 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1180/2360] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:17:33 2022] PUT /identity/v3/projects/b2dd123dc0c94fe59c20e5335d88c3a4/users/a41dc313ca1f42f3bc13a9e4892453f6/roles/ea564961b1db4eb4a1d4d880964611b2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 11:17:33.321774 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965e8af8-7fb3-4ee7-b10b-779ab99a7e0e service neutron] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:33.331696 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965e8af8-7fb3-4ee7-b10b-779ab99a7e0e service neutron] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:33.389152 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d056b0-a7de-41a1-901e-c9520c0f790c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:33.390062 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d056b0-a7de-41a1-901e-c9520c0f790c admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:33.390343 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d056b0-a7de-41a1-901e-c9520c0f790c admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:33.390617 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d056b0-a7de-41a1-901e-c9520c0f790c admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:33.391257 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d056b0-a7de-41a1-901e-c9520c0f790c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:33.392854 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d056b0-a7de-41a1-901e-c9520c0f790c admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:33.402993 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1181/2361] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:17:33 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:17:33.418160 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd681feb-2181-4195-a73e-d135aa4400d7 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:33.429574 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd681feb-2181-4195-a73e-d135aa4400d7 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:33.437129 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e15b1-eaf7-4517-9cb6-293450a69005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:33.437129 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e15b1-eaf7-4517-9cb6-293450a69005 admin admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:33.437129 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e15b1-eaf7-4517-9cb6-293450a69005 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:33.437129 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e15b1-eaf7-4517-9cb6-293450a69005 admin admin] PATH_INFO: `/v3/projects/b2dd123dc0c94fe59c20e5335d88c3a4/users/a41dc313ca1f42f3bc13a9e4892453f6/roles/ea564961b1db4eb4a1d4d880964611b2` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:33.438561 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493e15b1-eaf7-4517-9cb6-293450a69005 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2dd123dc0c94fe59c20e5335d88c3a4, user_id=a41dc313ca1f42f3bc13a9e4892453f6, role_id=ea564961b1db4eb4a1d4d880964611b2)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:33.441337 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493e15b1-eaf7-4517-9cb6-293450a69005 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:33.448488 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:17:33.454136 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1181/2362] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:17:33 2022] PUT /identity/v3/projects/b2dd123dc0c94fe59c20e5335d88c3a4/users/a41dc313ca1f42f3bc13a9e4892453f6/roles/ea564961b1db4eb4a1d4d880964611b2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:17:33.465530 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2337ba65-e00e-4699-8a97-3f414078457f None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:33.466102 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2337ba65-e00e-4699-8a97-3f414078457f None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:33.466476 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2337ba65-e00e-4699-8a97-3f414078457f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:33.524679 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-2337ba65-e00e-4699-8a97-3f414078457f None None] MFA Rules not processed for user `a41dc313ca1f42f3bc13a9e4892453f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:17:33.526266 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-2337ba65-e00e-4699-8a97-3f414078457f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:33.601770 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1182/2363] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:17:33 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 11:17:33.610690 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e15b1-eaf7-4517-9cb6-293450a69005 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:33.614611 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2337ba65-e00e-4699-8a97-3f414078457f None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:33.614752 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-493e15b1-eaf7-4517-9cb6-293450a69005 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:33.616336 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-2337ba65-e00e-4699-8a97-3f414078457f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:33.637695 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:17:33.684437 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2337ba65-e00e-4699-8a97-3f414078457f None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:33.688129 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b885e7fb-c2a5-4172-bb7e-33d9f28b7a7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f4c2fc51f54f0e977648b13efaed1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:33.688729 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b885e7fb-c2a5-4172-bb7e-33d9f28b7a7c service cinder] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:33.688999 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b885e7fb-c2a5-4172-bb7e-33d9f28b7a7c service cinder] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:33.689264 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b885e7fb-c2a5-4172-bb7e-33d9f28b7a7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:33.689658 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e15b1-eaf7-4517-9cb6-293450a69005 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:33.694394 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f773e5-fe45-45a6-8ac3-8f50feaa0447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:33.695010 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f773e5-fe45-45a6-8ac3-8f50feaa0447 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:33.695292 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f773e5-fe45-45a6-8ac3-8f50feaa0447 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:33.695564 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f773e5-fe45-45a6-8ac3-8f50feaa0447 admin admin] PATH_INFO: `/v3/projects/5ccceb200b9f443c84c0d13f5ca92dd3` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:33.696736 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f773e5-fe45-45a6-8ac3-8f50feaa0447 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ccceb200b9f443c84c0d13f5ca92dd3)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:33.698507 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b885e7fb-c2a5-4172-bb7e-33d9f28b7a7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:33.698715 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f773e5-fe45-45a6-8ac3-8f50feaa0447 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:33.700096 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b885e7fb-c2a5-4172-bb7e-33d9f28b7a7c service cinder] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:33.711776 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1183/2364] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:17:33 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 13 11:17:33.746647 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-66f773e5-fe45-45a6-8ac3-8f50feaa0447 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ccceb200b9f443c84c0d13f5ca92dd3', 'request_id': 'req-66f773e5-fe45-45a6-8ac3-8f50feaa0447'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:33.753499 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-66f773e5-fe45-45a6-8ac3-8f50feaa0447 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ccceb200b9f443c84c0d13f5ca92dd3', 'request_id': 'req-66f773e5-fe45-45a6-8ac3-8f50feaa0447'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:33.759109 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-66f773e5-fe45-45a6-8ac3-8f50feaa0447 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ccceb200b9f443c84c0d13f5ca92dd3', 'request_id': 'req-66f773e5-fe45-45a6-8ac3-8f50feaa0447'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:33.771854 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-66f773e5-fe45-45a6-8ac3-8f50feaa0447 admin admin] The token cache is being invalidate because project 5ccceb200b9f443c84c0d13f5ca92dd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:17:33.772147 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-66f773e5-fe45-45a6-8ac3-8f50feaa0447 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:33.772780 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-66f773e5-fe45-45a6-8ac3-8f50feaa0447 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:33.774500 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1182/2365] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:17:33 2022] DELETE /identity/v3/projects/5ccceb200b9f443c84c0d13f5ca92dd3 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:17:33.778287 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b885e7fb-c2a5-4172-bb7e-33d9f28b7a7c service cinder] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:33.788653 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b885e7fb-c2a5-4172-bb7e-33d9f28b7a7c service cinder] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:33.850596 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b5c5b6-18bd-4240-bd1d-cc2358334f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:33.851285 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5c5b6-18bd-4240-bd1d-cc2358334f92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:33.851564 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5c5b6-18bd-4240-bd1d-cc2358334f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:33.851887 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5c5b6-18bd-4240-bd1d-cc2358334f92 admin admin] PATH_INFO: `/v3/users/14671af4e75e409f866077943df72162` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:33.852978 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b5c5b6-18bd-4240-bd1d-cc2358334f92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14671af4e75e409f866077943df72162)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:33.855564 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b5c5b6-18bd-4240-bd1d-cc2358334f92 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:33.911858 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-c4b5c5b6-18bd-4240-bd1d-cc2358334f92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14671af4e75e409f866077943df72162'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:33.912498 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-c4b5c5b6-18bd-4240-bd1d-cc2358334f92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14671af4e75e409f866077943df72162'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:33.913106 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-c4b5c5b6-18bd-4240-bd1d-cc2358334f92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14671af4e75e409f866077943df72162'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:33.925621 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-c4b5c5b6-18bd-4240-bd1d-cc2358334f92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14671af4e75e409f866077943df72162'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:33.933570 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-c4b5c5b6-18bd-4240-bd1d-cc2358334f92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14671af4e75e409f866077943df72162'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:33.946091 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1184/2366] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:17:33 2022] DELETE /identity/v3/users/14671af4e75e409f866077943df72162 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:17:34.229007 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f773e5-fe45-45a6-8ac3-8f50feaa0447 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:34.230746 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-66f773e5-fe45-45a6-8ac3-8f50feaa0447 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:34.246292 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f773e5-fe45-45a6-8ac3-8f50feaa0447 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:34.292245 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b5c5b6-18bd-4240-bd1d-cc2358334f92 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:34.293785 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-c4b5c5b6-18bd-4240-bd1d-cc2358334f92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:34.306853 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e77d890-1aab-42c6-b202-fd5daa802e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:34.307493 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77d890-1aab-42c6-b202-fd5daa802e21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:34.307768 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77d890-1aab-42c6-b202-fd5daa802e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:34.308038 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77d890-1aab-42c6-b202-fd5daa802e21 admin admin] PATH_INFO: `/v3/projects/bd08da7d46f848189f857305717af6f8` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:34.309172 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e77d890-1aab-42c6-b202-fd5daa802e21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd08da7d46f848189f857305717af6f8)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:34.311076 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e77d890-1aab-42c6-b202-fd5daa802e21 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:34.329789 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:17:34.346262 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:17:34.361878 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-9e77d890-1aab-42c6-b202-fd5daa802e21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd08da7d46f848189f857305717af6f8', 'request_id': 'req-9e77d890-1aab-42c6-b202-fd5daa802e21'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:34.364188 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b5c5b6-18bd-4240-bd1d-cc2358334f92 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:34.368068 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-9e77d890-1aab-42c6-b202-fd5daa802e21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd08da7d46f848189f857305717af6f8', 'request_id': 'req-9e77d890-1aab-42c6-b202-fd5daa802e21'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:34.374205 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-9e77d890-1aab-42c6-b202-fd5daa802e21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd08da7d46f848189f857305717af6f8', 'request_id': 'req-9e77d890-1aab-42c6-b202-fd5daa802e21'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:34.387360 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-9e77d890-1aab-42c6-b202-fd5daa802e21 admin admin] The token cache is being invalidate because project bd08da7d46f848189f857305717af6f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:17:34.387648 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-9e77d890-1aab-42c6-b202-fd5daa802e21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:34.388260 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-9e77d890-1aab-42c6-b202-fd5daa802e21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:34.389760 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1183/2367] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:17:34 2022] DELETE /identity/v3/projects/bd08da7d46f848189f857305717af6f8 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:17:34.393559 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e77d890-1aab-42c6-b202-fd5daa802e21 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:34.394942 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-9e77d890-1aab-42c6-b202-fd5daa802e21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:34.422920 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789eda25-c535-4100-8c51-7aaaab8683dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:34.423573 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789eda25-c535-4100-8c51-7aaaab8683dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:34.423845 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789eda25-c535-4100-8c51-7aaaab8683dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:34.424113 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789eda25-c535-4100-8c51-7aaaab8683dd admin admin] PATH_INFO: `/v3/users/4431842386094eee898f6c1c6a887634` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:34.425220 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789eda25-c535-4100-8c51-7aaaab8683dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=4431842386094eee898f6c1c6a887634)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:34.427298 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789eda25-c535-4100-8c51-7aaaab8683dd admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:34.458773 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e77d890-1aab-42c6-b202-fd5daa802e21 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:34.463835 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b4db0-ddcf-42ef-af73-184aadf472f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:34.464591 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b4db0-ddcf-42ef-af73-184aadf472f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:34.464869 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b4db0-ddcf-42ef-af73-184aadf472f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:34.465141 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b4db0-ddcf-42ef-af73-184aadf472f3 admin admin] PATH_INFO: `/v3/users/58dc245dfd504d2294ee69f2c2da8fc2` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:34.466301 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93b4db0-ddcf-42ef-af73-184aadf472f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58dc245dfd504d2294ee69f2c2da8fc2)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:34.468214 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93b4db0-ddcf-42ef-af73-184aadf472f3 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:34.474933 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-789eda25-c535-4100-8c51-7aaaab8683dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4431842386094eee898f6c1c6a887634'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:34.475668 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-789eda25-c535-4100-8c51-7aaaab8683dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4431842386094eee898f6c1c6a887634'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:34.476368 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-789eda25-c535-4100-8c51-7aaaab8683dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4431842386094eee898f6c1c6a887634'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:34.489019 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-789eda25-c535-4100-8c51-7aaaab8683dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4431842386094eee898f6c1c6a887634'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:34.497258 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-789eda25-c535-4100-8c51-7aaaab8683dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4431842386094eee898f6c1c6a887634'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:34.510057 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1185/2368] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:17:34 2022] DELETE /identity/v3/users/4431842386094eee898f6c1c6a887634 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 11:17:34.514334 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f5b0c0-0328-4b28-b7b0-eb54bf8d2fe9 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:34.514714 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f5b0c0-0328-4b28-b7b0-eb54bf8d2fe9 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:34.515081 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f5b0c0-0328-4b28-b7b0-eb54bf8d2fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:34.517985 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-c93b4db0-ddcf-42ef-af73-184aadf472f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58dc245dfd504d2294ee69f2c2da8fc2'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:34.525089 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-c93b4db0-ddcf-42ef-af73-184aadf472f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58dc245dfd504d2294ee69f2c2da8fc2'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:34.525761 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-c93b4db0-ddcf-42ef-af73-184aadf472f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58dc245dfd504d2294ee69f2c2da8fc2'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:34.526416 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-c93b4db0-ddcf-42ef-af73-184aadf472f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58dc245dfd504d2294ee69f2c2da8fc2'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:34.533826 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-c93b4db0-ddcf-42ef-af73-184aadf472f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58dc245dfd504d2294ee69f2c2da8fc2'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:34.534256 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-d3f5b0c0-0328-4b28-b7b0-eb54bf8d2fe9 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:17:34.535456 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-d3f5b0c0-0328-4b28-b7b0-eb54bf8d2fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:34.552231 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1184/2369] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:17:34 2022] DELETE /identity/v3/users/58dc245dfd504d2294ee69f2c2da8fc2 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 11:17:34.589585 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:17:34.600615 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1186/2370] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:17:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 11:17:34.610799 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b4db0-ddcf-42ef-af73-184aadf472f3 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:34.612277 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-c93b4db0-ddcf-42ef-af73-184aadf472f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:34.656805 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:17:34.674646 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b4db0-ddcf-42ef-af73-184aadf472f3 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:34.678436 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f2664-7b04-4e1a-928e-5f96375c3bb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:34.679068 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f2664-7b04-4e1a-928e-5f96375c3bb4 service neutron] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:34.679344 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f2664-7b04-4e1a-928e-5f96375c3bb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:34.679611 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f2664-7b04-4e1a-928e-5f96375c3bb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:34.744724 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134f2664-7b04-4e1a-928e-5f96375c3bb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:34.746176 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134f2664-7b04-4e1a-928e-5f96375c3bb4 service neutron] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:34.756001 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1185/2371] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:17:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:17:34.830795 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f5b0c0-0328-4b28-b7b0-eb54bf8d2fe9 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:34.832559 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-d3f5b0c0-0328-4b28-b7b0-eb54bf8d2fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:34.845570 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f5b0c0-0328-4b28-b7b0-eb54bf8d2fe9 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:34.850337 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca34eb76-050e-4ab9-841e-ba9716dd6b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:34.850974 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca34eb76-050e-4ab9-841e-ba9716dd6b8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:34.851696 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca34eb76-050e-4ab9-841e-ba9716dd6b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:34.851696 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca34eb76-050e-4ab9-841e-ba9716dd6b8f admin admin] PATH_INFO: `/v3/projects/bb98144d3b714cc8b7a9c352ba1d4471` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:34.853016 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca34eb76-050e-4ab9-841e-ba9716dd6b8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb98144d3b714cc8b7a9c352ba1d4471)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:34.855844 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca34eb76-050e-4ab9-841e-ba9716dd6b8f admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:34.910808 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-ca34eb76-050e-4ab9-841e-ba9716dd6b8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb98144d3b714cc8b7a9c352ba1d4471', 'request_id': 'req-ca34eb76-050e-4ab9-841e-ba9716dd6b8f'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:34.920306 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-ca34eb76-050e-4ab9-841e-ba9716dd6b8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb98144d3b714cc8b7a9c352ba1d4471', 'request_id': 'req-ca34eb76-050e-4ab9-841e-ba9716dd6b8f'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:34.927636 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-ca34eb76-050e-4ab9-841e-ba9716dd6b8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb98144d3b714cc8b7a9c352ba1d4471', 'request_id': 'req-ca34eb76-050e-4ab9-841e-ba9716dd6b8f'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:34.938710 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-ca34eb76-050e-4ab9-841e-ba9716dd6b8f admin admin] The token cache is being invalidate because project bb98144d3b714cc8b7a9c352ba1d4471 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:17:34.938998 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-ca34eb76-050e-4ab9-841e-ba9716dd6b8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:34.939661 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-ca34eb76-050e-4ab9-841e-ba9716dd6b8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:34.941863 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1187/2372] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:17:34 2022] DELETE /identity/v3/projects/bb98144d3b714cc8b7a9c352ba1d4471 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:17:34.947673 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d603c5-d64f-47d9-ab81-0ba1525a6c18 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:34.947972 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d603c5-d64f-47d9-ab81-0ba1525a6c18 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:34.948216 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d603c5-d64f-47d9-ab81-0ba1525a6c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:34.968773 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-82d603c5-d64f-47d9-ab81-0ba1525a6c18 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:17:34.970023 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-82d603c5-d64f-47d9-ab81-0ba1525a6c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:35.034343 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1186/2373] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:17:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 11:17:35.039213 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca34eb76-050e-4ab9-841e-ba9716dd6b8f admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:35.041342 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-ca34eb76-050e-4ab9-841e-ba9716dd6b8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:35.042181 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab461585-750b-4e59-a3fc-4a8185e3e427 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:35.042514 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab461585-750b-4e59-a3fc-4a8185e3e427 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:35.042767 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab461585-750b-4e59-a3fc-4a8185e3e427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:35.057431 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca34eb76-050e-4ab9-841e-ba9716dd6b8f admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:35.063292 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a6c11d-22ec-418d-b802-c0b0d919d1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:35.064053 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a6c11d-22ec-418d-b802-c0b0d919d1df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:35.064356 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a6c11d-22ec-418d-b802-c0b0d919d1df admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:35.064736 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a6c11d-22ec-418d-b802-c0b0d919d1df admin admin] PATH_INFO: `/v3/projects/0b5508a4ebff4a9c82134bb766d2ad46` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:35.066198 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a6c11d-22ec-418d-b802-c0b0d919d1df admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b5508a4ebff4a9c82134bb766d2ad46)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:35.067613 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-ab461585-750b-4e59-a3fc-4a8185e3e427 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:17:35.068294 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a6c11d-22ec-418d-b802-c0b0d919d1df admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:35.068863 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-ab461585-750b-4e59-a3fc-4a8185e3e427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:35.077299 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1187/2374] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:17:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 11:17:35.081516 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab461585-750b-4e59-a3fc-4a8185e3e427 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:35.091718 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab461585-750b-4e59-a3fc-4a8185e3e427 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:35.096432 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f86074a-9494-4c99-be0e-9c010b3cbb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:35.097067 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f86074a-9494-4c99-be0e-9c010b3cbb41 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:35.097287 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f86074a-9494-4c99-be0e-9c010b3cbb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:35.097538 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f86074a-9494-4c99-be0e-9c010b3cbb41 admin admin] PATH_INFO: `/v3/domains` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:35.098288 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f86074a-9494-4c99-be0e-9c010b3cbb41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:17:35.098590 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f86074a-9494-4c99-be0e-9c010b3cbb41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:35.100165 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f86074a-9494-4c99-be0e-9c010b3cbb41 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:35.115405 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1188/2375] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 11:17:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 11:17:35.116379 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f86074a-9494-4c99-be0e-9c010b3cbb41 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:35.117933 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-08a6c11d-22ec-418d-b802-c0b0d919d1df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b5508a4ebff4a9c82134bb766d2ad46', 'request_id': 'req-08a6c11d-22ec-418d-b802-c0b0d919d1df'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:35.126297 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-08a6c11d-22ec-418d-b802-c0b0d919d1df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b5508a4ebff4a9c82134bb766d2ad46', 'request_id': 'req-08a6c11d-22ec-418d-b802-c0b0d919d1df'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:35.126445 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f86074a-9494-4c99-be0e-9c010b3cbb41 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:35.133148 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-08a6c11d-22ec-418d-b802-c0b0d919d1df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b5508a4ebff4a9c82134bb766d2ad46', 'request_id': 'req-08a6c11d-22ec-418d-b802-c0b0d919d1df'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:35.146005 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-08a6c11d-22ec-418d-b802-c0b0d919d1df admin admin] The token cache is being invalidate because project 0b5508a4ebff4a9c82134bb766d2ad46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:17:35.146303 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-08a6c11d-22ec-418d-b802-c0b0d919d1df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:35.147001 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-08a6c11d-22ec-418d-b802-c0b0d919d1df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:35.148521 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1188/2376] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:17:35 2022] DELETE /identity/v3/projects/0b5508a4ebff4a9c82134bb766d2ad46 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:17:35.152819 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a6c11d-22ec-418d-b802-c0b0d919d1df admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:35.154165 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-08a6c11d-22ec-418d-b802-c0b0d919d1df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:35.184257 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c9305-7708-4c6c-9dfc-3569aa334063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:35.184855 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c9305-7708-4c6c-9dfc-3569aa334063 admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:35.185131 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c9305-7708-4c6c-9dfc-3569aa334063 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:35.185419 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c9305-7708-4c6c-9dfc-3569aa334063 admin admin] PATH_INFO: `/v3/projects` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:35.186067 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0c9305-7708-4c6c-9dfc-3569aa334063 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:35.187938 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0c9305-7708-4c6c-9dfc-3569aa334063 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:35.203058 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:17:35.217024 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1189/2377] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:17:35 2022] POST /identity/v3/projects => generated 375 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 11:17:35.218986 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a6c11d-22ec-418d-b802-c0b0d919d1df admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:35.220938 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c9305-7708-4c6c-9dfc-3569aa334063 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:35.222796 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-7d0c9305-7708-4c6c-9dfc-3569aa334063 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:35.228527 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:17:35.278818 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cdf81b-5c53-4676-8f4f-89bd5ff49fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:35.279452 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cdf81b-5c53-4676-8f4f-89bd5ff49fe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:35.279731 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cdf81b-5c53-4676-8f4f-89bd5ff49fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:35.280002 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cdf81b-5c53-4676-8f4f-89bd5ff49fe4 admin admin] PATH_INFO: `/v3/users/a41dc313ca1f42f3bc13a9e4892453f6` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:35.281121 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cdf81b-5c53-4676-8f4f-89bd5ff49fe4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a41dc313ca1f42f3bc13a9e4892453f6)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:35.283068 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cdf81b-5c53-4676-8f4f-89bd5ff49fe4 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:35.286748 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c9305-7708-4c6c-9dfc-3569aa334063 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:35.291481 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c89082e-a589-4875-abfe-946f36b35159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:35.292074 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c89082e-a589-4875-abfe-946f36b35159 admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:35.292415 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c89082e-a589-4875-abfe-946f36b35159 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:35.292691 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c89082e-a589-4875-abfe-946f36b35159 admin admin] PATH_INFO: `/v3/users` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:35.293342 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c89082e-a589-4875-abfe-946f36b35159 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:35.295242 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c89082e-a589-4875-abfe-946f36b35159 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:35.324778 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1190/2378] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:17:35 2022] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 11:17:35.325986 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c89082e-a589-4875-abfe-946f36b35159 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:35.330708 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-f5cdf81b-5c53-4676-8f4f-89bd5ff49fe4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a41dc313ca1f42f3bc13a9e4892453f6'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:35.331418 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-f5cdf81b-5c53-4676-8f4f-89bd5ff49fe4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a41dc313ca1f42f3bc13a9e4892453f6'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:35.332110 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-f5cdf81b-5c53-4676-8f4f-89bd5ff49fe4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a41dc313ca1f42f3bc13a9e4892453f6'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:35.335246 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c89082e-a589-4875-abfe-946f36b35159 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:35.339891 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebacea62-9cde-4675-8fbc-1bc0daacd9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:35.340470 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebacea62-9cde-4675-8fbc-1bc0daacd9f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:35.340748 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebacea62-9cde-4675-8fbc-1bc0daacd9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:35.341150 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebacea62-9cde-4675-8fbc-1bc0daacd9f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:35.342021 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebacea62-9cde-4675-8fbc-1bc0daacd9f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:35.343840 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebacea62-9cde-4675-8fbc-1bc0daacd9f7 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:35.344932 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-f5cdf81b-5c53-4676-8f4f-89bd5ff49fe4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a41dc313ca1f42f3bc13a9e4892453f6'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:35.352563 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-f5cdf81b-5c53-4676-8f4f-89bd5ff49fe4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a41dc313ca1f42f3bc13a9e4892453f6'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:35.355311 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1191/2379] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:17:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:17:35.359094 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebacea62-9cde-4675-8fbc-1bc0daacd9f7 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:35.360754 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-ebacea62-9cde-4675-8fbc-1bc0daacd9f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:35.365601 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1189/2380] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:17:35 2022] DELETE /identity/v3/users/a41dc313ca1f42f3bc13a9e4892453f6 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 11:17:35.374406 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebacea62-9cde-4675-8fbc-1bc0daacd9f7 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:35.434747 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a52fb1-9325-408d-955c-4a901d7816d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:35.435598 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a52fb1-9325-408d-955c-4a901d7816d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:35.435598 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a52fb1-9325-408d-955c-4a901d7816d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:35.435891 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a52fb1-9325-408d-955c-4a901d7816d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:35.436940 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a52fb1-9325-408d-955c-4a901d7816d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:35.438721 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a52fb1-9325-408d-955c-4a901d7816d3 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:35.450370 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1192/2381] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:17:35 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 13 11:17:35.454472 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cdf81b-5c53-4676-8f4f-89bd5ff49fe4 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:35.464649 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cdf81b-5c53-4676-8f4f-89bd5ff49fe4 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:35.470262 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca039e6-a655-48fc-93a8-dc4ce4992e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:35.470913 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca039e6-a655-48fc-93a8-dc4ce4992e30 admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:35.471192 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca039e6-a655-48fc-93a8-dc4ce4992e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:35.471465 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca039e6-a655-48fc-93a8-dc4ce4992e30 admin admin] PATH_INFO: `/v3/projects/ae8e5e7de9204f15a5b5d73329023c90/users/02208b5dec274c9286ad5187ef699359/roles/7c3871c0ab68438b9014489d50b53a22` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:35.486569 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca039e6-a655-48fc-93a8-dc4ce4992e30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae8e5e7de9204f15a5b5d73329023c90, user_id=02208b5dec274c9286ad5187ef699359, role_id=7c3871c0ab68438b9014489d50b53a22)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:35.489183 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca039e6-a655-48fc-93a8-dc4ce4992e30 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:35.503031 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1190/2382] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:17:35 2022] PUT /identity/v3/projects/ae8e5e7de9204f15a5b5d73329023c90/users/02208b5dec274c9286ad5187ef699359/roles/7c3871c0ab68438b9014489d50b53a22 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:17:35.514096 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed31ca6-7d33-4cbc-8326-8ea9cd7e0651 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:35.514559 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed31ca6-7d33-4cbc-8326-8ea9cd7e0651 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:35.514786 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed31ca6-7d33-4cbc-8326-8ea9cd7e0651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:35.544342 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-fed31ca6-7d33-4cbc-8326-8ea9cd7e0651 None None] MFA Rules not processed for user `02208b5dec274c9286ad5187ef699359`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:17:35.545664 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-fed31ca6-7d33-4cbc-8326-8ea9cd7e0651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:35.610427 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:17:35.612986 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1193/2383] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:17:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:17:35.624828 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca039e6-a655-48fc-93a8-dc4ce4992e30 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:35.626972 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-fca039e6-a655-48fc-93a8-dc4ce4992e30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:35.658660 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed31ca6-7d33-4cbc-8326-8ea9cd7e0651 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:35.660830 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-fed31ca6-7d33-4cbc-8326-8ea9cd7e0651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:35.692531 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca039e6-a655-48fc-93a8-dc4ce4992e30 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:35.696143 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4572c669-9dcd-406d-bf66-0a485f5b7f22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f4c2fc51f54f0e977648b13efaed1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:35.696748 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572c669-9dcd-406d-bf66-0a485f5b7f22 service cinder] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:35.697952 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572c669-9dcd-406d-bf66-0a485f5b7f22 service cinder] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:35.698247 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572c669-9dcd-406d-bf66-0a485f5b7f22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:35.709678 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4572c669-9dcd-406d-bf66-0a485f5b7f22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:35.711129 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4572c669-9dcd-406d-bf66-0a485f5b7f22 service cinder] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:35.720383 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1191/2384] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:17:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:17:35.739730 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed31ca6-7d33-4cbc-8326-8ea9cd7e0651 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:35.744928 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacb6698-c648-4ac4-b15d-e18380eb4409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:35.745554 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb6698-c648-4ac4-b15d-e18380eb4409 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:35.745827 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb6698-c648-4ac4-b15d-e18380eb4409 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:35.746139 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb6698-c648-4ac4-b15d-e18380eb4409 admin admin] PATH_INFO: `/v3/projects/b2dd123dc0c94fe59c20e5335d88c3a4` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:35.747756 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacb6698-c648-4ac4-b15d-e18380eb4409 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2dd123dc0c94fe59c20e5335d88c3a4)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:35.749921 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacb6698-c648-4ac4-b15d-e18380eb4409 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:35.795753 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-eacb6698-c648-4ac4-b15d-e18380eb4409 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2dd123dc0c94fe59c20e5335d88c3a4', 'request_id': 'req-eacb6698-c648-4ac4-b15d-e18380eb4409'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:35.801788 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-eacb6698-c648-4ac4-b15d-e18380eb4409 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2dd123dc0c94fe59c20e5335d88c3a4', 'request_id': 'req-eacb6698-c648-4ac4-b15d-e18380eb4409'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:35.808335 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-eacb6698-c648-4ac4-b15d-e18380eb4409 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2dd123dc0c94fe59c20e5335d88c3a4', 'request_id': 'req-eacb6698-c648-4ac4-b15d-e18380eb4409'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:35.822247 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-eacb6698-c648-4ac4-b15d-e18380eb4409 admin admin] The token cache is being invalidate because project b2dd123dc0c94fe59c20e5335d88c3a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:17:35.822537 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-eacb6698-c648-4ac4-b15d-e18380eb4409 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:35.823220 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-eacb6698-c648-4ac4-b15d-e18380eb4409 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:17:35.824829 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1194/2385] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:17:35 2022] DELETE /identity/v3/projects/b2dd123dc0c94fe59c20e5335d88c3a4 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:17:35.830195 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bfba9e-2171-4a64-ad67-b28ea4d8f20f None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:35.830486 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bfba9e-2171-4a64-ad67-b28ea4d8f20f None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:35.830765 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bfba9e-2171-4a64-ad67-b28ea4d8f20f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:35.850153 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-49bfba9e-2171-4a64-ad67-b28ea4d8f20f None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:17:35.851356 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-49bfba9e-2171-4a64-ad67-b28ea4d8f20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:35.857850 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:17:35.924241 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1192/2386] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:17:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 11:17:35.932316 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a4eea2-13ee-4ae0-8ff3-df94891b3895 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:35.932598 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a4eea2-13ee-4ae0-8ff3-df94891b3895 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:35.932872 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a4eea2-13ee-4ae0-8ff3-df94891b3895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:35.956402 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-12a4eea2-13ee-4ae0-8ff3-df94891b3895 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:17:35.957962 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-12a4eea2-13ee-4ae0-8ff3-df94891b3895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:35.967003 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1195/2387] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:17:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:17:35.971370 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bfba9e-2171-4a64-ad67-b28ea4d8f20f None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:35.990659 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bfba9e-2171-4a64-ad67-b28ea4d8f20f None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:35.996470 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd4ea21-6035-41c2-ae11-54c4912c54a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:35.997082 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd4ea21-6035-41c2-ae11-54c4912c54a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:35.997367 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd4ea21-6035-41c2-ae11-54c4912c54a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:35.997691 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd4ea21-6035-41c2-ae11-54c4912c54a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:35.998400 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd4ea21-6035-41c2-ae11-54c4912c54a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:17:35.998705 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd4ea21-6035-41c2-ae11-54c4912c54a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:36.000340 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd4ea21-6035-41c2-ae11-54c4912c54a2 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:36.015838 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1193/2388] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 11:17:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:17:36.017006 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a4eea2-13ee-4ae0-8ff3-df94891b3895 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:36.026692 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a4eea2-13ee-4ae0-8ff3-df94891b3895 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:36.031800 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05d9667-35f0-491a-92b5-cdaaa076ceb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:36.032432 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d9667-35f0-491a-92b5-cdaaa076ceb8 admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:36.032698 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d9667-35f0-491a-92b5-cdaaa076ceb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:36.037023 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d9667-35f0-491a-92b5-cdaaa076ceb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:36.037023 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05d9667-35f0-491a-92b5-cdaaa076ceb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:36.038611 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05d9667-35f0-491a-92b5-cdaaa076ceb8 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:36.072416 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1196/2389] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:17:36 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:17:36.073577 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd4ea21-6035-41c2-ae11-54c4912c54a2 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:36.083942 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd4ea21-6035-41c2-ae11-54c4912c54a2 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:36.139896 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412b6bbe-4050-4d9e-8fa8-0d7cd5374ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:36.140415 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b6bbe-4050-4d9e-8fa8-0d7cd5374ca7 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:36.140690 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b6bbe-4050-4d9e-8fa8-0d7cd5374ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:36.140986 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b6bbe-4050-4d9e-8fa8-0d7cd5374ca7 admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:36.141632 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412b6bbe-4050-4d9e-8fa8-0d7cd5374ca7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:36.143594 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412b6bbe-4050-4d9e-8fa8-0d7cd5374ca7 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:36.163788 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1194/2390] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:17:36 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:17:36.168508 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05d9667-35f0-491a-92b5-cdaaa076ceb8 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:36.178668 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05d9667-35f0-491a-92b5-cdaaa076ceb8 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:36.183235 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd4c5c0-b7a4-4a0b-8881-f9d5007c8f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:36.183845 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd4c5c0-b7a4-4a0b-8881-f9d5007c8f5d admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:36.184123 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd4c5c0-b7a4-4a0b-8881-f9d5007c8f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:36.184390 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd4c5c0-b7a4-4a0b-8881-f9d5007c8f5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:36.185020 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd4c5c0-b7a4-4a0b-8881-f9d5007c8f5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:36.186746 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd4c5c0-b7a4-4a0b-8881-f9d5007c8f5d admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:36.196312 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1197/2391] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:17:36 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:17:36.200067 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412b6bbe-4050-4d9e-8fa8-0d7cd5374ca7 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:36.209633 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412b6bbe-4050-4d9e-8fa8-0d7cd5374ca7 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:36.214690 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d92ab9-1dd9-4bb9-96c7-b99f270d7db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:36.215266 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d92ab9-1dd9-4bb9-96c7-b99f270d7db2 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:36.215541 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d92ab9-1dd9-4bb9-96c7-b99f270d7db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:36.215809 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d92ab9-1dd9-4bb9-96c7-b99f270d7db2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:36.216438 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d92ab9-1dd9-4bb9-96c7-b99f270d7db2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:36.218035 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d92ab9-1dd9-4bb9-96c7-b99f270d7db2 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:36.229099 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1195/2392] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:17:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:17:36.232863 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd4c5c0-b7a4-4a0b-8881-f9d5007c8f5d admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:36.242549 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd4c5c0-b7a4-4a0b-8881-f9d5007c8f5d admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:36.247072 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04691dd-bd75-4051-8c1b-ede5b2ed3d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:36.247697 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04691dd-bd75-4051-8c1b-ede5b2ed3d62 admin admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:36.247971 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04691dd-bd75-4051-8c1b-ede5b2ed3d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:36.248241 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04691dd-bd75-4051-8c1b-ede5b2ed3d62 admin admin] PATH_INFO: `/v3/projects/9e19b5f2cac2480bb84384e3973af613/users/ffd5f03eba4a429ba02ae8b305a59a56/roles/7c3871c0ab68438b9014489d50b53a22` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:36.263023 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04691dd-bd75-4051-8c1b-ede5b2ed3d62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e19b5f2cac2480bb84384e3973af613, user_id=ffd5f03eba4a429ba02ae8b305a59a56, role_id=7c3871c0ab68438b9014489d50b53a22)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:36.265625 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04691dd-bd75-4051-8c1b-ede5b2ed3d62 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:36.278658 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1198/2393] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:17:36 2022] PUT /identity/v3/projects/9e19b5f2cac2480bb84384e3973af613/users/ffd5f03eba4a429ba02ae8b305a59a56/roles/7c3871c0ab68438b9014489d50b53a22 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:17:36.283650 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633769e3-2472-41ef-a790-69263d2a20f9 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:36.283933 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633769e3-2472-41ef-a790-69263d2a20f9 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:36.284205 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633769e3-2472-41ef-a790-69263d2a20f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:36.304371 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-633769e3-2472-41ef-a790-69263d2a20f9 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:17:36.305559 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-633769e3-2472-41ef-a790-69263d2a20f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:36.362116 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1196/2394] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:17:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 11:17:36.371581 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04691dd-bd75-4051-8c1b-ede5b2ed3d62 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:36.373281 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-b04691dd-bd75-4051-8c1b-ede5b2ed3d62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:36.401462 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:17:36.433479 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04691dd-bd75-4051-8c1b-ede5b2ed3d62 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:36.437223 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea8fe2a-561d-4fd1-8041-ca835ebca430 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:36.437826 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea8fe2a-561d-4fd1-8041-ca835ebca430 service neutron] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:36.438138 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea8fe2a-561d-4fd1-8041-ca835ebca430 service neutron] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:36.438413 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea8fe2a-561d-4fd1-8041-ca835ebca430 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:36.447725 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea8fe2a-561d-4fd1-8041-ca835ebca430 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:36.449125 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea8fe2a-561d-4fd1-8041-ca835ebca430 service neutron] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:36.458366 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1199/2395] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:17:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:17:37.113327 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad1c318-b6f2-40f7-bf86-4e411ac4c776 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:37.113748 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad1c318-b6f2-40f7-bf86-4e411ac4c776 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:37.114200 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad1c318-b6f2-40f7-bf86-4e411ac4c776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:37.142330 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f81bd-fcb8-42d7-b486-ee4cc043ae26 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:37.142330 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f81bd-fcb8-42d7-b486-ee4cc043ae26 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:37.142330 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f81bd-fcb8-42d7-b486-ee4cc043ae26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:37.142925 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-7ad1c318-b6f2-40f7-bf86-4e411ac4c776 None None] MFA Rules not processed for user `02208b5dec274c9286ad5187ef699359`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:17:37.142925 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-7ad1c318-b6f2-40f7-bf86-4e411ac4c776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:37.158074 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:17:37.164779 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-2c2f81bd-fcb8-42d7-b486-ee4cc043ae26 None None] MFA Rules not processed for user `ffd5f03eba4a429ba02ae8b305a59a56`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:17:37.166346 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-2c2f81bd-fcb8-42d7-b486-ee4cc043ae26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:37.209844 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1197/2396] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:17:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:17:37.250791 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1200/2397] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:17:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 11:17:37.255638 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad1c318-b6f2-40f7-bf86-4e411ac4c776 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:37.266891 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad1c318-b6f2-40f7-bf86-4e411ac4c776 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:37.272288 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d2cfa-c13a-474a-970e-278d14a332f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:37.272585 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d2cfa-c13a-474a-970e-278d14a332f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:37.272932 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d2cfa-c13a-474a-970e-278d14a332f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:37.273275 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d2cfa-c13a-474a-970e-278d14a332f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:37.274335 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532d2cfa-c13a-474a-970e-278d14a332f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:37.276328 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532d2cfa-c13a-474a-970e-278d14a332f1 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:37.316077 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f81bd-fcb8-42d7-b486-ee4cc043ae26 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:37.317148 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1198/2398] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:17:37 2022] POST /identity/v3/projects => generated 373 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:17:37.330549 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f81bd-fcb8-42d7-b486-ee4cc043ae26 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:37.387609 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50689b2-8d58-426b-ad69-923702aaa9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:37.388212 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50689b2-8d58-426b-ad69-923702aaa9c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:37.388491 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50689b2-8d58-426b-ad69-923702aaa9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:37.388762 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50689b2-8d58-426b-ad69-923702aaa9c9 admin admin] PATH_INFO: `/v3/users` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:37.389383 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50689b2-8d58-426b-ad69-923702aaa9c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:37.391424 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50689b2-8d58-426b-ad69-923702aaa9c9 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:37.413534 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1201/2399] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:17:37 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 11:17:37.417630 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d2cfa-c13a-474a-970e-278d14a332f1 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:37.427838 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d2cfa-c13a-474a-970e-278d14a332f1 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:37.432987 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69339dea-588c-4a1f-8f7e-ec6b808378a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:37.433579 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69339dea-588c-4a1f-8f7e-ec6b808378a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:37.433858 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69339dea-588c-4a1f-8f7e-ec6b808378a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:37.434149 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69339dea-588c-4a1f-8f7e-ec6b808378a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:37.434789 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69339dea-588c-4a1f-8f7e-ec6b808378a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:37.436403 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69339dea-588c-4a1f-8f7e-ec6b808378a5 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:37.446345 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1199/2400] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:17:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:17:37.450501 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50689b2-8d58-426b-ad69-923702aaa9c9 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:37.460617 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50689b2-8d58-426b-ad69-923702aaa9c9 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:37.466523 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d75075-94c6-48c7-86b7-d32642a55e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:37.467178 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d75075-94c6-48c7-86b7-d32642a55e4c admin admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:37.467457 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d75075-94c6-48c7-86b7-d32642a55e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:37.467762 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d75075-94c6-48c7-86b7-d32642a55e4c admin admin] PATH_INFO: `/v3/projects/e02685efeb894b52a0d7092575e6ee02/users/97fe59a4be0249c9b08d2dc6a880cfcd/roles/ea564961b1db4eb4a1d4d880964611b2` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:37.483110 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d75075-94c6-48c7-86b7-d32642a55e4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e02685efeb894b52a0d7092575e6ee02, user_id=97fe59a4be0249c9b08d2dc6a880cfcd, role_id=ea564961b1db4eb4a1d4d880964611b2)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:37.485752 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d75075-94c6-48c7-86b7-d32642a55e4c admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:37.500115 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1202/2401] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:17:37 2022] PUT /identity/v3/projects/e02685efeb894b52a0d7092575e6ee02/users/97fe59a4be0249c9b08d2dc6a880cfcd/roles/ea564961b1db4eb4a1d4d880964611b2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:17:37.504289 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69339dea-588c-4a1f-8f7e-ec6b808378a5 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:37.514282 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69339dea-588c-4a1f-8f7e-ec6b808378a5 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:37.571205 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4694431-139f-4ad9-ac68-08ca524ace17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:37.571857 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4694431-139f-4ad9-ac68-08ca524ace17 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:37.572080 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4694431-139f-4ad9-ac68-08ca524ace17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:37.572357 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4694431-139f-4ad9-ac68-08ca524ace17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:37.573022 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4694431-139f-4ad9-ac68-08ca524ace17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:37.574822 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4694431-139f-4ad9-ac68-08ca524ace17 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:37.585042 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1200/2402] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:17:37 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:17:37.589647 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d75075-94c6-48c7-86b7-d32642a55e4c admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:37.600031 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d75075-94c6-48c7-86b7-d32642a55e4c admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:37.605218 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628292e2-a2b2-49ba-8d91-b370ec12096a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:37.605864 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628292e2-a2b2-49ba-8d91-b370ec12096a admin admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:37.606191 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628292e2-a2b2-49ba-8d91-b370ec12096a admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:37.606577 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628292e2-a2b2-49ba-8d91-b370ec12096a admin admin] PATH_INFO: `/v3/projects/e02685efeb894b52a0d7092575e6ee02/users/97fe59a4be0249c9b08d2dc6a880cfcd/roles/ea564961b1db4eb4a1d4d880964611b2` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:37.608532 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628292e2-a2b2-49ba-8d91-b370ec12096a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e02685efeb894b52a0d7092575e6ee02, user_id=97fe59a4be0249c9b08d2dc6a880cfcd, role_id=ea564961b1db4eb4a1d4d880964611b2)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:37.611178 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628292e2-a2b2-49ba-8d91-b370ec12096a admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:37.621471 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1203/2403] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:17:37 2022] PUT /identity/v3/projects/e02685efeb894b52a0d7092575e6ee02/users/97fe59a4be0249c9b08d2dc6a880cfcd/roles/ea564961b1db4eb4a1d4d880964611b2 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:17:38.599856 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00494c6-b281-4ae0-aae8-b2b61a62b4e6 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:38.600360 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00494c6-b281-4ae0-aae8-b2b61a62b4e6 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:38.600459 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00494c6-b281-4ae0-aae8-b2b61a62b4e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:38.629207 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-e00494c6-b281-4ae0-aae8-b2b61a62b4e6 None None] MFA Rules not processed for user `97fe59a4be0249c9b08d2dc6a880cfcd`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:17:38.630475 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-e00494c6-b281-4ae0-aae8-b2b61a62b4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:38.712753 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1201/2404] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:17:38 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:17:38.723340 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97620ab-30f7-4b8c-8d00-07ab220ab0a9 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:38.724307 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97620ab-30f7-4b8c-8d00-07ab220ab0a9 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:38.724776 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97620ab-30f7-4b8c-8d00-07ab220ab0a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:38.747728 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-f97620ab-30f7-4b8c-8d00-07ab220ab0a9 None None] MFA Rules not processed for user `ffd5f03eba4a429ba02ae8b305a59a56`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:17:38.749110 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-f97620ab-30f7-4b8c-8d00-07ab220ab0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:38.754055 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:17:38.840643 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1204/2405] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:17:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:17:38.852090 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00494c6-b281-4ae0-aae8-b2b61a62b4e6 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:38.854176 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-e00494c6-b281-4ae0-aae8-b2b61a62b4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:38.870005 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:17:38.953617 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00494c6-b281-4ae0-aae8-b2b61a62b4e6 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:38.959087 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797537da-7636-40c7-a1de-45c5ac1240f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78384fbffdd346578855e7214b335d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:38.959690 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797537da-7636-40c7-a1de-45c5ac1240f0 service nova] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:38.959964 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797537da-7636-40c7-a1de-45c5ac1240f0 service nova] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:38.960238 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797537da-7636-40c7-a1de-45c5ac1240f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:38.968086 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797537da-7636-40c7-a1de-45c5ac1240f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:38.969766 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797537da-7636-40c7-a1de-45c5ac1240f0 service nova] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:38.979570 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1202/2406] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:17:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:17:48.831961 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=21 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:17:48.975003 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=29 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:17:52.024443 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb582ca9-c7bf-48eb-ab6e-ef9c2aad5781 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:52.025465 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb582ca9-c7bf-48eb-ab6e-ef9c2aad5781 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:52.025564 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb582ca9-c7bf-48eb-ab6e-ef9c2aad5781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:52.045113 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-bb582ca9-c7bf-48eb-ab6e-ef9c2aad5781 None None] MFA Rules not processed for user `dd538e9a9b08439a84ae6e3a2c78d862`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:17:52.046396 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-bb582ca9-c7bf-48eb-ab6e-ef9c2aad5781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:52.101479 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1205/2407] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:17:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:17:57.215662 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddcb1f8-d2a4-4498-b6f8-2f61dc468386 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:57.216193 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddcb1f8-d2a4-4498-b6f8-2f61dc468386 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:57.216383 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddcb1f8-d2a4-4498-b6f8-2f61dc468386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:57.236680 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-5ddcb1f8-d2a4-4498-b6f8-2f61dc468386 None None] MFA Rules not processed for user `6e803a9cc6114c4f93869e50bca313e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:17:57.245014 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-5ddcb1f8-d2a4-4498-b6f8-2f61dc468386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:57.301201 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1203/2408] 10.222.0.25 () {58 vars in 1009 bytes} [Thu Oct 13 11:17:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:17:57.351828 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb582ca9-c7bf-48eb-ab6e-ef9c2aad5781 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:57.354040 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-bb582ca9-c7bf-48eb-ab6e-ef9c2aad5781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:57.481273 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb582ca9-c7bf-48eb-ab6e-ef9c2aad5781 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:57.486337 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3f69db-d076-4b11-98fa-841d4a9b6111 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e24c779d0a604ef28dfc1235ee76a711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:57.486947 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f69db-d076-4b11-98fa-841d4a9b6111 service swift] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:57.487223 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f69db-d076-4b11-98fa-841d4a9b6111 service swift] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:57.487494 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f69db-d076-4b11-98fa-841d4a9b6111 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:57.496605 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3f69db-d076-4b11-98fa-841d4a9b6111 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:57.498233 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3f69db-d076-4b11-98fa-841d4a9b6111 service swift] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:57.506442 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1206/2409] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Oct 13 11:17:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 13 11:17:58.016940 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddcb1f8-d2a4-4498-b6f8-2f61dc468386 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:58.018466 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-5ddcb1f8-d2a4-4498-b6f8-2f61dc468386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:58.044303 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86269c9-171e-43a8-a18a-c25d1afc555d None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:58.044662 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86269c9-171e-43a8-a18a-c25d1afc555d None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:58.045003 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86269c9-171e-43a8-a18a-c25d1afc555d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:58.065124 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-f86269c9-171e-43a8-a18a-c25d1afc555d None None] MFA Rules not processed for user `6e803a9cc6114c4f93869e50bca313e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:17:58.066284 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-f86269c9-171e-43a8-a18a-c25d1afc555d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:58.073541 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1207/2410] 10.222.0.25 () {58 vars in 967 bytes} [Thu Oct 13 11:17:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 11:17:58.075738 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddcb1f8-d2a4-4498-b6f8-2f61dc468386 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:58.079285 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341ca0e1-5453-44e3-a228-6ea584fee73b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f4c2fc51f54f0e977648b13efaed1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:58.079884 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ca0e1-5453-44e3-a228-6ea584fee73b service cinder] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:58.080163 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ca0e1-5453-44e3-a228-6ea584fee73b service cinder] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:58.080547 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ca0e1-5453-44e3-a228-6ea584fee73b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:58.086366 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86269c9-171e-43a8-a18a-c25d1afc555d None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:58.090941 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341ca0e1-5453-44e3-a228-6ea584fee73b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:58.092376 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341ca0e1-5453-44e3-a228-6ea584fee73b service cinder] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:58.098387 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86269c9-171e-43a8-a18a-c25d1afc555d None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:58.103447 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1204/2411] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:17:58 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:17:58.104021 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd5a14b-5183-40f2-a6ed-096e4f8ce131 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e24c779d0a604ef28dfc1235ee76a711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:58.104698 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd5a14b-5183-40f2-a6ed-096e4f8ce131 service swift] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:58.104978 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd5a14b-5183-40f2-a6ed-096e4f8ce131 service swift] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:58.105266 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd5a14b-5183-40f2-a6ed-096e4f8ce131 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:58.113468 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd5a14b-5183-40f2-a6ed-096e4f8ce131 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:58.115075 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd5a14b-5183-40f2-a6ed-096e4f8ce131 service swift] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:58.123132 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1208/2412] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Oct 13 11:17:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 13 11:17:58.358989 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b2bba2-a3f4-482f-9056-ffdb458da4bc None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:58.359463 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b2bba2-a3f4-482f-9056-ffdb458da4bc None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:58.359568 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b2bba2-a3f4-482f-9056-ffdb458da4bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:58.379603 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-b8b2bba2-a3f4-482f-9056-ffdb458da4bc None None] MFA Rules not processed for user `6e803a9cc6114c4f93869e50bca313e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:17:58.380800 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-b8b2bba2-a3f4-482f-9056-ffdb458da4bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:58.388944 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1205/2413] 10.222.0.25 () {58 vars in 1009 bytes} [Thu Oct 13 11:17:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:17:58.401604 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd5a14b-5183-40f2-a6ed-096e4f8ce131 service swift] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:58.412169 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd5a14b-5183-40f2-a6ed-096e4f8ce131 service swift] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:58.417296 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eee0f7-34f3-4f01-89be-7a5b986866c0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e24c779d0a604ef28dfc1235ee76a711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:58.417863 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eee0f7-34f3-4f01-89be-7a5b986866c0 service swift] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:58.418169 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eee0f7-34f3-4f01-89be-7a5b986866c0 service swift] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:58.418440 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eee0f7-34f3-4f01-89be-7a5b986866c0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:58.426435 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eee0f7-34f3-4f01-89be-7a5b986866c0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:58.427991 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eee0f7-34f3-4f01-89be-7a5b986866c0 service swift] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:58.435828 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1209/2414] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Oct 13 11:17:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 13 11:17:58.792641 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd5a6a-273c-4123-b997-d776ca8785aa None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:58.793263 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd5a6a-273c-4123-b997-d776ca8785aa None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:58.793818 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd5a6a-273c-4123-b997-d776ca8785aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:58.814678 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-b4fd5a6a-273c-4123-b997-d776ca8785aa None None] MFA Rules not processed for user `6e803a9cc6114c4f93869e50bca313e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:17:58.816181 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-b4fd5a6a-273c-4123-b997-d776ca8785aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:17:58.824461 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1206/2415] 10.222.0.25 () {58 vars in 967 bytes} [Thu Oct 13 11:17:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:17:58.841038 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eee0f7-34f3-4f01-89be-7a5b986866c0 service swift] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:17:58.855557 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eee0f7-34f3-4f01-89be-7a5b986866c0 service swift] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:17:58.862484 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c882b72-5d07-4cba-b821-81af4ab75a5a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e24c779d0a604ef28dfc1235ee76a711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:17:58.863259 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c882b72-5d07-4cba-b821-81af4ab75a5a service swift] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:17:58.863668 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c882b72-5d07-4cba-b821-81af4ab75a5a service swift] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:17:58.864181 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c882b72-5d07-4cba-b821-81af4ab75a5a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:17:58.874235 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c882b72-5d07-4cba-b821-81af4ab75a5a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:17:58.876175 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c882b72-5d07-4cba-b821-81af4ab75a5a service swift] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:17:58.887401 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1210/2416] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Oct 13 11:17:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 13 11:18:00.987964 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fd5a6a-273c-4123-b997-d776ca8785aa None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:18:00.990513 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-b4fd5a6a-273c-4123-b997-d776ca8785aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:18:01.070676 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fd5a6a-273c-4123-b997-d776ca8785aa None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:18:01.075684 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b6b43-dfd4-4801-bd75-31948f1d2def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:18:01.076312 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b6b43-dfd4-4801-bd75-31948f1d2def admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:18:01.076586 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b6b43-dfd4-4801-bd75-31948f1d2def admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:18:01.076852 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b6b43-dfd4-4801-bd75-31948f1d2def admin admin] PATH_INFO: `/v3/users/02208b5dec274c9286ad5187ef699359` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:18:01.078002 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91b6b43-dfd4-4801-bd75-31948f1d2def admin admin] RBAC: Authorizing `identity:delete_user(user_id=02208b5dec274c9286ad5187ef699359)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:18:01.080012 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91b6b43-dfd4-4801-bd75-31948f1d2def admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:18:01.120269 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:18:01.129867 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-b91b6b43-dfd4-4801-bd75-31948f1d2def admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02208b5dec274c9286ad5187ef699359'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:18:01.130541 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-b91b6b43-dfd4-4801-bd75-31948f1d2def admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02208b5dec274c9286ad5187ef699359'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:18:01.131158 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-b91b6b43-dfd4-4801-bd75-31948f1d2def admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02208b5dec274c9286ad5187ef699359'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:18:01.143358 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-b91b6b43-dfd4-4801-bd75-31948f1d2def admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02208b5dec274c9286ad5187ef699359'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:18:01.150757 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-b91b6b43-dfd4-4801-bd75-31948f1d2def admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02208b5dec274c9286ad5187ef699359'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:18:01.163455 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1207/2417] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:18:00 2022] DELETE /identity/v3/users/02208b5dec274c9286ad5187ef699359 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:18:01.168023 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fdfc1b-45bd-42e4-9ae9-0953e88d1873 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:18:01.168464 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fdfc1b-45bd-42e4-9ae9-0953e88d1873 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:18:01.168675 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fdfc1b-45bd-42e4-9ae9-0953e88d1873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:18:01.188148 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-52fdfc1b-45bd-42e4-9ae9-0953e88d1873 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:18:01.189259 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-52fdfc1b-45bd-42e4-9ae9-0953e88d1873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:18:01.233218 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:18:01.249558 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1211/2418] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:18:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:18:01.259290 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b6b43-dfd4-4801-bd75-31948f1d2def admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:18:01.260747 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-b91b6b43-dfd4-4801-bd75-31948f1d2def admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:18:01.325072 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b6b43-dfd4-4801-bd75-31948f1d2def admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:18:01.328844 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea05781-34fd-4207-a473-2575f0d3a653 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:18:01.329453 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea05781-34fd-4207-a473-2575f0d3a653 service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:18:01.329733 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea05781-34fd-4207-a473-2575f0d3a653 service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:18:01.330039 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea05781-34fd-4207-a473-2575f0d3a653 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:18:01.339809 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea05781-34fd-4207-a473-2575f0d3a653 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:18:01.341237 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea05781-34fd-4207-a473-2575f0d3a653 service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:18:01.350863 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1208/2419] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:18:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:18:01.518963 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fdfc1b-45bd-42e4-9ae9-0953e88d1873 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:18:01.520422 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-52fdfc1b-45bd-42e4-9ae9-0953e88d1873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:18:01.532511 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fdfc1b-45bd-42e4-9ae9-0953e88d1873 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:18:01.537221 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb2427a-ecc9-4155-a5cc-98652f9c8149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:18:01.537869 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2427a-ecc9-4155-a5cc-98652f9c8149 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:18:01.538173 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2427a-ecc9-4155-a5cc-98652f9c8149 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:18:01.538446 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2427a-ecc9-4155-a5cc-98652f9c8149 admin admin] PATH_INFO: `/v3/projects/ae8e5e7de9204f15a5b5d73329023c90` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:18:01.539560 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb2427a-ecc9-4155-a5cc-98652f9c8149 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae8e5e7de9204f15a5b5d73329023c90)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:18:01.550356 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb2427a-ecc9-4155-a5cc-98652f9c8149 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:18:01.597849 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-8eb2427a-ecc9-4155-a5cc-98652f9c8149 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae8e5e7de9204f15a5b5d73329023c90', 'request_id': 'req-8eb2427a-ecc9-4155-a5cc-98652f9c8149'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:18:01.604668 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-8eb2427a-ecc9-4155-a5cc-98652f9c8149 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae8e5e7de9204f15a5b5d73329023c90', 'request_id': 'req-8eb2427a-ecc9-4155-a5cc-98652f9c8149'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:18:01.610585 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-8eb2427a-ecc9-4155-a5cc-98652f9c8149 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae8e5e7de9204f15a5b5d73329023c90', 'request_id': 'req-8eb2427a-ecc9-4155-a5cc-98652f9c8149'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:18:01.624747 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-8eb2427a-ecc9-4155-a5cc-98652f9c8149 admin admin] The token cache is being invalidate because project ae8e5e7de9204f15a5b5d73329023c90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:18:01.625040 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-8eb2427a-ecc9-4155-a5cc-98652f9c8149 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:18:01.625742 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-8eb2427a-ecc9-4155-a5cc-98652f9c8149 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:18:01.627258 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1212/2420] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:18:01 2022] DELETE /identity/v3/projects/ae8e5e7de9204f15a5b5d73329023c90 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:18:11.346495 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=41,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:18:11.621671 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=32,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:18:18.078386 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea05781-34fd-4207-a473-2575f0d3a653 service neutron] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:18:18.079833 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-aea05781-34fd-4207-a473-2575f0d3a653 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:18:18.157508 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea05781-34fd-4207-a473-2575f0d3a653 service neutron] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:18:18.210769 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2866995b-285c-43af-ac97-7d5a9667b38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:18:18.211391 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866995b-285c-43af-ac97-7d5a9667b38f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:18:18.211669 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866995b-285c-43af-ac97-7d5a9667b38f admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:18:18.211944 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866995b-285c-43af-ac97-7d5a9667b38f admin admin] PATH_INFO: `/v3/users/ffd5f03eba4a429ba02ae8b305a59a56` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:18:18.213089 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2866995b-285c-43af-ac97-7d5a9667b38f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffd5f03eba4a429ba02ae8b305a59a56)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:18:18.215512 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2866995b-285c-43af-ac97-7d5a9667b38f admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:18:18.260124 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-2866995b-285c-43af-ac97-7d5a9667b38f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffd5f03eba4a429ba02ae8b305a59a56'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:18:18.260752 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-2866995b-285c-43af-ac97-7d5a9667b38f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffd5f03eba4a429ba02ae8b305a59a56'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:18:18.261349 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-2866995b-285c-43af-ac97-7d5a9667b38f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffd5f03eba4a429ba02ae8b305a59a56'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:18:18.273054 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-2866995b-285c-43af-ac97-7d5a9667b38f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffd5f03eba4a429ba02ae8b305a59a56'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:18:18.280825 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-2866995b-285c-43af-ac97-7d5a9667b38f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffd5f03eba4a429ba02ae8b305a59a56'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:18:18.293257 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1209/2421] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:18:18 2022] DELETE /identity/v3/users/ffd5f03eba4a429ba02ae8b305a59a56 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:18:18.464560 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb2427a-ecc9-4155-a5cc-98652f9c8149 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:18:18.466091 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-8eb2427a-ecc9-4155-a5cc-98652f9c8149 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:18:18.526070 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb2427a-ecc9-4155-a5cc-98652f9c8149 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:18:18.580727 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e5afb5-3109-477f-9fd6-845885420a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:18:18.581281 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e5afb5-3109-477f-9fd6-845885420a53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:18:18.581568 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e5afb5-3109-477f-9fd6-845885420a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:18:18.581840 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e5afb5-3109-477f-9fd6-845885420a53 admin admin] PATH_INFO: `/v3/projects/9e19b5f2cac2480bb84384e3973af613` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:18:18.583009 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e5afb5-3109-477f-9fd6-845885420a53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e19b5f2cac2480bb84384e3973af613)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:18:18.584897 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e5afb5-3109-477f-9fd6-845885420a53 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:18:18.631443 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-b1e5afb5-3109-477f-9fd6-845885420a53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e19b5f2cac2480bb84384e3973af613', 'request_id': 'req-b1e5afb5-3109-477f-9fd6-845885420a53'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:18:18.638405 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-b1e5afb5-3109-477f-9fd6-845885420a53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e19b5f2cac2480bb84384e3973af613', 'request_id': 'req-b1e5afb5-3109-477f-9fd6-845885420a53'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:18:18.643829 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-b1e5afb5-3109-477f-9fd6-845885420a53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e19b5f2cac2480bb84384e3973af613', 'request_id': 'req-b1e5afb5-3109-477f-9fd6-845885420a53'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:18:18.656280 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-b1e5afb5-3109-477f-9fd6-845885420a53 admin admin] The token cache is being invalidate because project 9e19b5f2cac2480bb84384e3973af613 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:18:18.656566 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-b1e5afb5-3109-477f-9fd6-845885420a53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:18:18.657180 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-b1e5afb5-3109-477f-9fd6-845885420a53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:18:18.658688 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1213/2422] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:18:18 2022] DELETE /identity/v3/projects/9e19b5f2cac2480bb84384e3973af613 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:18:18.662720 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2866995b-285c-43af-ac97-7d5a9667b38f admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:18:18.664207 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-2866995b-285c-43af-ac97-7d5a9667b38f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:18:18.677033 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2866995b-285c-43af-ac97-7d5a9667b38f admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:18:18.688729 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:18:18.734252 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f758c0c9-fa9b-412c-a3e2-61c83a3da870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:18:18.734866 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f758c0c9-fa9b-412c-a3e2-61c83a3da870 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:18:18.735144 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f758c0c9-fa9b-412c-a3e2-61c83a3da870 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:18:18.735413 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f758c0c9-fa9b-412c-a3e2-61c83a3da870 admin admin] PATH_INFO: `/v3/users/97fe59a4be0249c9b08d2dc6a880cfcd` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:18:18.736512 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f758c0c9-fa9b-412c-a3e2-61c83a3da870 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97fe59a4be0249c9b08d2dc6a880cfcd)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:18:18.738442 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f758c0c9-fa9b-412c-a3e2-61c83a3da870 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:18:18.783885 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-f758c0c9-fa9b-412c-a3e2-61c83a3da870 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97fe59a4be0249c9b08d2dc6a880cfcd'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:18:18.784510 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-f758c0c9-fa9b-412c-a3e2-61c83a3da870 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97fe59a4be0249c9b08d2dc6a880cfcd'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:18:18.785102 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-f758c0c9-fa9b-412c-a3e2-61c83a3da870 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97fe59a4be0249c9b08d2dc6a880cfcd'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:18:18.796562 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-f758c0c9-fa9b-412c-a3e2-61c83a3da870 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97fe59a4be0249c9b08d2dc6a880cfcd'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:18:18.803225 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-f758c0c9-fa9b-412c-a3e2-61c83a3da870 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97fe59a4be0249c9b08d2dc6a880cfcd'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:18:18.815737 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1210/2423] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:18:18 2022] DELETE /identity/v3/users/97fe59a4be0249c9b08d2dc6a880cfcd => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:18:18.986061 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e5afb5-3109-477f-9fd6-845885420a53 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:18:18.987476 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-b1e5afb5-3109-477f-9fd6-845885420a53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:18:19.003439 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e5afb5-3109-477f-9fd6-845885420a53 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:18:19.047613 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:18:19.063065 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7c9c62-e1d6-4ccc-9b29-e7de66a8e357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:18:19.063696 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7c9c62-e1d6-4ccc-9b29-e7de66a8e357 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:18:19.063979 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7c9c62-e1d6-4ccc-9b29-e7de66a8e357 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:18:19.064254 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7c9c62-e1d6-4ccc-9b29-e7de66a8e357 admin admin] PATH_INFO: `/v3/projects/e02685efeb894b52a0d7092575e6ee02` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:18:19.065371 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7c9c62-e1d6-4ccc-9b29-e7de66a8e357 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e02685efeb894b52a0d7092575e6ee02)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:18:19.067290 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7c9c62-e1d6-4ccc-9b29-e7de66a8e357 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:18:19.111632 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-fe7c9c62-e1d6-4ccc-9b29-e7de66a8e357 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e02685efeb894b52a0d7092575e6ee02', 'request_id': 'req-fe7c9c62-e1d6-4ccc-9b29-e7de66a8e357'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:18:19.118114 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-fe7c9c62-e1d6-4ccc-9b29-e7de66a8e357 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e02685efeb894b52a0d7092575e6ee02', 'request_id': 'req-fe7c9c62-e1d6-4ccc-9b29-e7de66a8e357'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:18:19.123963 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-fe7c9c62-e1d6-4ccc-9b29-e7de66a8e357 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e02685efeb894b52a0d7092575e6ee02', 'request_id': 'req-fe7c9c62-e1d6-4ccc-9b29-e7de66a8e357'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:18:19.136854 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-fe7c9c62-e1d6-4ccc-9b29-e7de66a8e357 admin admin] The token cache is being invalidate because project e02685efeb894b52a0d7092575e6ee02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:18:19.137135 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-fe7c9c62-e1d6-4ccc-9b29-e7de66a8e357 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:18:19.137742 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-fe7c9c62-e1d6-4ccc-9b29-e7de66a8e357 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:18:19.139212 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1214/2424] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:18:18 2022] DELETE /identity/v3/projects/e02685efeb894b52a0d7092575e6ee02 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:18:19.144061 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e109c9d6-2853-4a16-8105-32fc5e62d976 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:18:19.144519 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e109c9d6-2853-4a16-8105-32fc5e62d976 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:18:19.144614 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e109c9d6-2853-4a16-8105-32fc5e62d976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:18:19.202448 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-e109c9d6-2853-4a16-8105-32fc5e62d976 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:18:19.203642 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-e109c9d6-2853-4a16-8105-32fc5e62d976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:18:19.261500 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1211/2425] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:18:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:18:19.269346 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce87c254-8a20-437b-a56a-b930a486f292 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:18:19.269634 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce87c254-8a20-437b-a56a-b930a486f292 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:18:19.269906 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce87c254-8a20-437b-a56a-b930a486f292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:18:19.288783 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-ce87c254-8a20-437b-a56a-b930a486f292 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:18:19.290049 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-ce87c254-8a20-437b-a56a-b930a486f292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:18:19.298212 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1215/2426] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:18:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:18:19.302122 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e109c9d6-2853-4a16-8105-32fc5e62d976 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:18:19.312185 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e109c9d6-2853-4a16-8105-32fc5e62d976 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:18:19.316711 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e8d51-44f8-4667-900d-b410783d13c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:18:19.317297 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e8d51-44f8-4667-900d-b410783d13c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:18:19.317575 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e8d51-44f8-4667-900d-b410783d13c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:18:19.317846 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e8d51-44f8-4667-900d-b410783d13c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:18:19.318521 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6e8d51-44f8-4667-900d-b410783d13c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:18:19.318825 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6e8d51-44f8-4667-900d-b410783d13c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:18:19.320400 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6e8d51-44f8-4667-900d-b410783d13c2 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:18:19.321837 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:18:19.334730 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1212/2427] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 11:18:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:18:19.338934 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce87c254-8a20-437b-a56a-b930a486f292 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:18:19.348222 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce87c254-8a20-437b-a56a-b930a486f292 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:18:19.352731 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be3a4b0-f603-46a6-9109-725a157dc634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:18:19.353342 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be3a4b0-f603-46a6-9109-725a157dc634 admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:18:19.353618 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be3a4b0-f603-46a6-9109-725a157dc634 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:18:19.353888 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be3a4b0-f603-46a6-9109-725a157dc634 admin admin] PATH_INFO: `/v3/projects` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:18:19.355065 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be3a4b0-f603-46a6-9109-725a157dc634 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:18:19.356917 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be3a4b0-f603-46a6-9109-725a157dc634 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:18:19.383998 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1216/2428] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:18:19 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:18:19.387959 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e8d51-44f8-4667-900d-b410783d13c2 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:18:19.397766 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e8d51-44f8-4667-900d-b410783d13c2 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:18:19.452709 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e9f45-4a68-4e44-bf4a-bab296d1faa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:18:19.453326 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e9f45-4a68-4e44-bf4a-bab296d1faa1 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:18:19.453608 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e9f45-4a68-4e44-bf4a-bab296d1faa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:18:19.453877 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e9f45-4a68-4e44-bf4a-bab296d1faa1 admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:18:19.454517 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6e9f45-4a68-4e44-bf4a-bab296d1faa1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:18:19.456738 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6e9f45-4a68-4e44-bf4a-bab296d1faa1 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:18:19.477543 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1213/2429] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:18:19 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:18:19.481762 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be3a4b0-f603-46a6-9109-725a157dc634 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:18:19.491872 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be3a4b0-f603-46a6-9109-725a157dc634 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:18:19.497227 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f8c89e-b926-4e31-afb4-9d39f663cf54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:18:19.497902 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8c89e-b926-4e31-afb4-9d39f663cf54 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:18:19.498265 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8c89e-b926-4e31-afb4-9d39f663cf54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:18:19.498541 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8c89e-b926-4e31-afb4-9d39f663cf54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:18:19.499266 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f8c89e-b926-4e31-afb4-9d39f663cf54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:18:19.500751 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f8c89e-b926-4e31-afb4-9d39f663cf54 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:18:19.510994 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1217/2430] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:18:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:18:19.514521 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e9f45-4a68-4e44-bf4a-bab296d1faa1 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:18:19.524112 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e9f45-4a68-4e44-bf4a-bab296d1faa1 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:18:19.529078 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9013da-d4c6-4ecb-8d01-8f6bc44b7d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:18:19.529658 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9013da-d4c6-4ecb-8d01-8f6bc44b7d88 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:18:19.529934 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9013da-d4c6-4ecb-8d01-8f6bc44b7d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:18:19.530235 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9013da-d4c6-4ecb-8d01-8f6bc44b7d88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:18:19.530863 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9013da-d4c6-4ecb-8d01-8f6bc44b7d88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:18:19.532425 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9013da-d4c6-4ecb-8d01-8f6bc44b7d88 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:18:19.543798 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1214/2431] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:18:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:18:19.547689 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f8c89e-b926-4e31-afb4-9d39f663cf54 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:18:19.557477 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f8c89e-b926-4e31-afb4-9d39f663cf54 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:18:19.562160 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afabe37-c4a7-491f-bd24-c3809b1e538f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:18:19.562805 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afabe37-c4a7-491f-bd24-c3809b1e538f admin admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:18:19.563112 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afabe37-c4a7-491f-bd24-c3809b1e538f admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:18:19.563384 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afabe37-c4a7-491f-bd24-c3809b1e538f admin admin] PATH_INFO: `/v3/projects/a8c8c8c6c640407d9df6245bbc4e6ac2/users/b3935ed9a2f24ad8a27a3a68682d1f0a/roles/7c3871c0ab68438b9014489d50b53a22` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:18:19.578558 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afabe37-c4a7-491f-bd24-c3809b1e538f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8c8c8c6c640407d9df6245bbc4e6ac2, user_id=b3935ed9a2f24ad8a27a3a68682d1f0a, role_id=7c3871c0ab68438b9014489d50b53a22)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:18:19.581185 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afabe37-c4a7-491f-bd24-c3809b1e538f admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:18:19.594345 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1218/2432] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:18:19 2022] PUT /identity/v3/projects/a8c8c8c6c640407d9df6245bbc4e6ac2/users/b3935ed9a2f24ad8a27a3a68682d1f0a/roles/7c3871c0ab68438b9014489d50b53a22 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:18:19.605193 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882cb9e5-07b3-4b1f-8d5a-3ca18b778455 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:18:19.605474 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882cb9e5-07b3-4b1f-8d5a-3ca18b778455 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:18:19.605745 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882cb9e5-07b3-4b1f-8d5a-3ca18b778455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:18:19.632343 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-882cb9e5-07b3-4b1f-8d5a-3ca18b778455 None None] MFA Rules not processed for user `b3935ed9a2f24ad8a27a3a68682d1f0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:18:19.633534 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-882cb9e5-07b3-4b1f-8d5a-3ca18b778455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:18:19.696425 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1215/2433] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:18:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:18:19.700910 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afabe37-c4a7-491f-bd24-c3809b1e538f admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:18:19.760920 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afabe37-c4a7-491f-bd24-c3809b1e538f admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:18:19.765543 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826504a5-9026-4978-8137-dbca0b5f757e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:18:19.766176 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826504a5-9026-4978-8137-dbca0b5f757e admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:18:19.766456 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826504a5-9026-4978-8137-dbca0b5f757e admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:18:19.766727 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826504a5-9026-4978-8137-dbca0b5f757e admin admin] PATH_INFO: `/v3/projects` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:18:19.767361 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826504a5-9026-4978-8137-dbca0b5f757e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:18:19.769223 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826504a5-9026-4978-8137-dbca0b5f757e admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:18:19.788998 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:18:19.798405 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1219/2434] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:18:19 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:18:19.802587 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882cb9e5-07b3-4b1f-8d5a-3ca18b778455 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:18:19.813117 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882cb9e5-07b3-4b1f-8d5a-3ca18b778455 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:18:19.868453 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3590511-b8be-4480-8419-420eed76e7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:18:19.869048 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3590511-b8be-4480-8419-420eed76e7ef admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:18:19.869323 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3590511-b8be-4480-8419-420eed76e7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:18:19.869616 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3590511-b8be-4480-8419-420eed76e7ef admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:18:19.870293 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3590511-b8be-4480-8419-420eed76e7ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:18:19.872178 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3590511-b8be-4480-8419-420eed76e7ef admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:18:19.881151 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:18:19.899328 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1216/2435] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:18:19 2022] POST /identity/v3/users => generated 299 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:18:19.900958 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826504a5-9026-4978-8137-dbca0b5f757e admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:18:19.911736 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826504a5-9026-4978-8137-dbca0b5f757e admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:18:19.916245 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f82510-29f2-4a2c-baa9-9304ce2fca5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:18:19.916829 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f82510-29f2-4a2c-baa9-9304ce2fca5c admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:18:19.917151 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f82510-29f2-4a2c-baa9-9304ce2fca5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:18:19.917423 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f82510-29f2-4a2c-baa9-9304ce2fca5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:18:19.918087 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f82510-29f2-4a2c-baa9-9304ce2fca5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:18:19.919647 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f82510-29f2-4a2c-baa9-9304ce2fca5c admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:18:19.929783 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1220/2436] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:18:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:18:19.933801 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3590511-b8be-4480-8419-420eed76e7ef admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:18:19.943657 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3590511-b8be-4480-8419-420eed76e7ef admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:18:19.948712 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dbea9f-9314-4086-a10b-89d36ff7563e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:18:19.949287 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dbea9f-9314-4086-a10b-89d36ff7563e admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:18:19.949562 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dbea9f-9314-4086-a10b-89d36ff7563e admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:18:19.949834 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dbea9f-9314-4086-a10b-89d36ff7563e admin admin] PATH_INFO: `/v3/projects/2fbb62fbce2b45d684b7490b415b3f8a/users/ad262fdf5a084ace8c87793996af8d65/roles/ea564961b1db4eb4a1d4d880964611b2` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:18:19.964807 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dbea9f-9314-4086-a10b-89d36ff7563e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fbb62fbce2b45d684b7490b415b3f8a, user_id=ad262fdf5a084ace8c87793996af8d65, role_id=ea564961b1db4eb4a1d4d880964611b2)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:18:19.967428 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dbea9f-9314-4086-a10b-89d36ff7563e admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:18:19.981517 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1217/2437] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:18:19 2022] PUT /identity/v3/projects/2fbb62fbce2b45d684b7490b415b3f8a/users/ad262fdf5a084ace8c87793996af8d65/roles/ea564961b1db4eb4a1d4d880964611b2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:18:19.985345 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f82510-29f2-4a2c-baa9-9304ce2fca5c admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:18:19.995295 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f82510-29f2-4a2c-baa9-9304ce2fca5c admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:18:20.050366 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b173b1-2b51-40eb-9632-f47478abe3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:18:20.050968 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b173b1-2b51-40eb-9632-f47478abe3a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:18:20.051245 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b173b1-2b51-40eb-9632-f47478abe3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:18:20.051515 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b173b1-2b51-40eb-9632-f47478abe3a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:18:20.052149 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b173b1-2b51-40eb-9632-f47478abe3a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:18:20.053724 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b173b1-2b51-40eb-9632-f47478abe3a4 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:18:20.063320 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1221/2438] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:18:19 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:18:20.067141 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dbea9f-9314-4086-a10b-89d36ff7563e admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:18:20.077562 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dbea9f-9314-4086-a10b-89d36ff7563e admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:18:20.082069 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee39d836-581c-4a6e-825f-e0f075e3b09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:18:20.082707 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee39d836-581c-4a6e-825f-e0f075e3b09a admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:18:20.082983 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee39d836-581c-4a6e-825f-e0f075e3b09a admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:18:20.083252 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee39d836-581c-4a6e-825f-e0f075e3b09a admin admin] PATH_INFO: `/v3/projects/2fbb62fbce2b45d684b7490b415b3f8a/users/ad262fdf5a084ace8c87793996af8d65/roles/ea564961b1db4eb4a1d4d880964611b2` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:18:20.085127 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee39d836-581c-4a6e-825f-e0f075e3b09a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fbb62fbce2b45d684b7490b415b3f8a, user_id=ad262fdf5a084ace8c87793996af8d65, role_id=ea564961b1db4eb4a1d4d880964611b2)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:18:20.087735 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee39d836-581c-4a6e-825f-e0f075e3b09a admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:18:20.098072 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1218/2439] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:18:20 2022] PUT /identity/v3/projects/2fbb62fbce2b45d684b7490b415b3f8a/users/ad262fdf5a084ace8c87793996af8d65/roles/ea564961b1db4eb4a1d4d880964611b2 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 11:18:20.162910 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da8ce0f-2e24-492f-b8f1-51773e2b63f3 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:18:20.163230 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da8ce0f-2e24-492f-b8f1-51773e2b63f3 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:18:20.163511 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da8ce0f-2e24-492f-b8f1-51773e2b63f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:18:20.190950 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-8da8ce0f-2e24-492f-b8f1-51773e2b63f3 None None] MFA Rules not processed for user `ad262fdf5a084ace8c87793996af8d65`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:18:20.192156 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-8da8ce0f-2e24-492f-b8f1-51773e2b63f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:18:20.258000 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1222/2440] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:18:20 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:18:20.269112 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee39d836-581c-4a6e-825f-e0f075e3b09a admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:18:20.270897 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-ee39d836-581c-4a6e-825f-e0f075e3b09a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:18:20.342297 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee39d836-581c-4a6e-825f-e0f075e3b09a admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:18:20.345873 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d489fcea-ca01-435e-b240-38aa99744067 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f4c2fc51f54f0e977648b13efaed1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:18:20.346567 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489fcea-ca01-435e-b240-38aa99744067 service cinder] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:18:20.346849 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489fcea-ca01-435e-b240-38aa99744067 service cinder] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:18:20.347123 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489fcea-ca01-435e-b240-38aa99744067 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:18:20.402293 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d489fcea-ca01-435e-b240-38aa99744067 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:18:20.403716 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d489fcea-ca01-435e-b240-38aa99744067 service cinder] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:18:20.412506 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1219/2441] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:18:20 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:18:24.633243 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da8ce0f-2e24-492f-b8f1-51773e2b63f3 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:18:24.634768 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-8da8ce0f-2e24-492f-b8f1-51773e2b63f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:18:24.648065 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da8ce0f-2e24-492f-b8f1-51773e2b63f3 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:18:24.651625 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7a19cb-38ce-45f0-891e-e8b4b2b0bd03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f4c2fc51f54f0e977648b13efaed1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:18:24.652222 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a19cb-38ce-45f0-891e-e8b4b2b0bd03 service cinder] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:18:24.652501 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a19cb-38ce-45f0-891e-e8b4b2b0bd03 service cinder] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:18:24.652773 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a19cb-38ce-45f0-891e-e8b4b2b0bd03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:18:24.661539 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7a19cb-38ce-45f0-891e-e8b4b2b0bd03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:18:24.662976 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7a19cb-38ce-45f0-891e-e8b4b2b0bd03 service cinder] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:18:24.672867 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1223/2442] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:18:24 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:18:29.545227 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d489fcea-ca01-435e-b240-38aa99744067 service cinder] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:18:29.595090 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:18:29.608778 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d489fcea-ca01-435e-b240-38aa99744067 service cinder] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:18:29.613270 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa11ebf-05b5-49e8-ae8f-f20368541838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:18:29.613896 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa11ebf-05b5-49e8-ae8f-f20368541838 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:18:29.614216 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa11ebf-05b5-49e8-ae8f-f20368541838 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:18:29.614483 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa11ebf-05b5-49e8-ae8f-f20368541838 admin admin] PATH_INFO: `/v3/users/b3935ed9a2f24ad8a27a3a68682d1f0a` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:18:29.615598 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa11ebf-05b5-49e8-ae8f-f20368541838 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3935ed9a2f24ad8a27a3a68682d1f0a)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:18:29.617500 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa11ebf-05b5-49e8-ae8f-f20368541838 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:18:29.671652 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-9aa11ebf-05b5-49e8-ae8f-f20368541838 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3935ed9a2f24ad8a27a3a68682d1f0a'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:18:29.672312 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-9aa11ebf-05b5-49e8-ae8f-f20368541838 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3935ed9a2f24ad8a27a3a68682d1f0a'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:18:29.672913 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-9aa11ebf-05b5-49e8-ae8f-f20368541838 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3935ed9a2f24ad8a27a3a68682d1f0a'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:18:29.684475 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-9aa11ebf-05b5-49e8-ae8f-f20368541838 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3935ed9a2f24ad8a27a3a68682d1f0a'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:18:29.691588 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-9aa11ebf-05b5-49e8-ae8f-f20368541838 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3935ed9a2f24ad8a27a3a68682d1f0a'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:18:29.703849 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1220/2443] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:18:29 2022] DELETE /identity/v3/users/b3935ed9a2f24ad8a27a3a68682d1f0a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:18:29.708460 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c8475-d747-4541-8c98-0e378e3ff0b4 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:18:29.708949 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c8475-d747-4541-8c98-0e378e3ff0b4 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:18:29.709061 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c8475-d747-4541-8c98-0e378e3ff0b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:18:29.730352 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-529c8475-d747-4541-8c98-0e378e3ff0b4 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:18:29.731538 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-529c8475-d747-4541-8c98-0e378e3ff0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:18:29.778278 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:18:29.789537 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1224/2444] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:18:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:18:29.799183 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa11ebf-05b5-49e8-ae8f-f20368541838 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:18:29.800602 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-9aa11ebf-05b5-49e8-ae8f-f20368541838 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:18:29.855861 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa11ebf-05b5-49e8-ae8f-f20368541838 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:18:29.859479 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86eee54-3f1c-4bcc-a252-7df9fb8a01d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:18:29.860080 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86eee54-3f1c-4bcc-a252-7df9fb8a01d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:18:29.860353 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86eee54-3f1c-4bcc-a252-7df9fb8a01d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:18:29.860624 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86eee54-3f1c-4bcc-a252-7df9fb8a01d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:18:29.869334 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86eee54-3f1c-4bcc-a252-7df9fb8a01d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:18:29.870815 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86eee54-3f1c-4bcc-a252-7df9fb8a01d1 service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:18:29.880374 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1221/2445] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:18:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:18:30.142313 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529c8475-d747-4541-8c98-0e378e3ff0b4 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:18:30.143781 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-529c8475-d747-4541-8c98-0e378e3ff0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:18:30.155779 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529c8475-d747-4541-8c98-0e378e3ff0b4 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:18:30.160314 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494951d9-c7df-4337-8213-fe154f366bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:18:30.160945 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494951d9-c7df-4337-8213-fe154f366bda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:18:30.161225 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494951d9-c7df-4337-8213-fe154f366bda admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:18:30.161500 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494951d9-c7df-4337-8213-fe154f366bda admin admin] PATH_INFO: `/v3/projects/a8c8c8c6c640407d9df6245bbc4e6ac2` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:18:30.162640 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494951d9-c7df-4337-8213-fe154f366bda admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8c8c8c6c640407d9df6245bbc4e6ac2)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:18:30.164603 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494951d9-c7df-4337-8213-fe154f366bda admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:18:30.210970 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-494951d9-c7df-4337-8213-fe154f366bda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8c8c8c6c640407d9df6245bbc4e6ac2', 'request_id': 'req-494951d9-c7df-4337-8213-fe154f366bda'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:18:30.217447 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-494951d9-c7df-4337-8213-fe154f366bda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8c8c8c6c640407d9df6245bbc4e6ac2', 'request_id': 'req-494951d9-c7df-4337-8213-fe154f366bda'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:18:30.222907 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-494951d9-c7df-4337-8213-fe154f366bda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8c8c8c6c640407d9df6245bbc4e6ac2', 'request_id': 'req-494951d9-c7df-4337-8213-fe154f366bda'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:18:30.234691 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-494951d9-c7df-4337-8213-fe154f366bda admin admin] The token cache is being invalidate because project a8c8c8c6c640407d9df6245bbc4e6ac2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:18:30.234976 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-494951d9-c7df-4337-8213-fe154f366bda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:18:30.235597 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-494951d9-c7df-4337-8213-fe154f366bda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:18:30.237062 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1225/2446] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:18:30 2022] DELETE /identity/v3/projects/a8c8c8c6c640407d9df6245bbc4e6ac2 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:18:30.241027 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86eee54-3f1c-4bcc-a252-7df9fb8a01d1 service neutron] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:18:30.251169 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86eee54-3f1c-4bcc-a252-7df9fb8a01d1 service neutron] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:18:30.304859 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cadbbaa-b22e-4499-9a66-5dd35ac2520e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:18:30.305467 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cadbbaa-b22e-4499-9a66-5dd35ac2520e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:18:30.305743 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cadbbaa-b22e-4499-9a66-5dd35ac2520e admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:18:30.306042 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cadbbaa-b22e-4499-9a66-5dd35ac2520e admin admin] PATH_INFO: `/v3/users/ad262fdf5a084ace8c87793996af8d65` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:18:30.307141 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cadbbaa-b22e-4499-9a66-5dd35ac2520e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad262fdf5a084ace8c87793996af8d65)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:18:30.309544 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cadbbaa-b22e-4499-9a66-5dd35ac2520e admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:18:30.325443 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:18:30.357059 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-2cadbbaa-b22e-4499-9a66-5dd35ac2520e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad262fdf5a084ace8c87793996af8d65'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:18:30.357696 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-2cadbbaa-b22e-4499-9a66-5dd35ac2520e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad262fdf5a084ace8c87793996af8d65'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:18:30.358311 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-2cadbbaa-b22e-4499-9a66-5dd35ac2520e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad262fdf5a084ace8c87793996af8d65'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:18:30.370282 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-2cadbbaa-b22e-4499-9a66-5dd35ac2520e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad262fdf5a084ace8c87793996af8d65'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:18:30.378224 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-2cadbbaa-b22e-4499-9a66-5dd35ac2520e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad262fdf5a084ace8c87793996af8d65'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:18:30.390185 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1222/2447] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:18:30 2022] DELETE /identity/v3/users/ad262fdf5a084ace8c87793996af8d65 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:18:30.649230 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494951d9-c7df-4337-8213-fe154f366bda admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:18:30.650748 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-494951d9-c7df-4337-8213-fe154f366bda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:18:30.665289 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494951d9-c7df-4337-8213-fe154f366bda admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:18:30.722760 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc174e-b1f9-40e8-bb4f-21120175be28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:18:30.723455 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc174e-b1f9-40e8-bb4f-21120175be28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:18:30.723656 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc174e-b1f9-40e8-bb4f-21120175be28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:18:30.723932 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc174e-b1f9-40e8-bb4f-21120175be28 admin admin] PATH_INFO: `/v3/projects/2fbb62fbce2b45d684b7490b415b3f8a` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:18:30.725038 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfc174e-b1f9-40e8-bb4f-21120175be28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fbb62fbce2b45d684b7490b415b3f8a)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:18:30.727133 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfc174e-b1f9-40e8-bb4f-21120175be28 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:18:30.772706 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-7cfc174e-b1f9-40e8-bb4f-21120175be28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fbb62fbce2b45d684b7490b415b3f8a', 'request_id': 'req-7cfc174e-b1f9-40e8-bb4f-21120175be28'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:18:30.779445 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-7cfc174e-b1f9-40e8-bb4f-21120175be28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fbb62fbce2b45d684b7490b415b3f8a', 'request_id': 'req-7cfc174e-b1f9-40e8-bb4f-21120175be28'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:18:30.784832 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-7cfc174e-b1f9-40e8-bb4f-21120175be28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fbb62fbce2b45d684b7490b415b3f8a', 'request_id': 'req-7cfc174e-b1f9-40e8-bb4f-21120175be28'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:18:30.797795 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-7cfc174e-b1f9-40e8-bb4f-21120175be28 admin admin] The token cache is being invalidate because project 2fbb62fbce2b45d684b7490b415b3f8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:18:30.798130 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-7cfc174e-b1f9-40e8-bb4f-21120175be28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:18:30.798750 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-7cfc174e-b1f9-40e8-bb4f-21120175be28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:18:30.800260 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1226/2448] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:18:30 2022] DELETE /identity/v3/projects/2fbb62fbce2b45d684b7490b415b3f8a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:18:30.806280 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea24c2be-d72e-4207-99fc-e4ff6f446001 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:18:30.806768 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea24c2be-d72e-4207-99fc-e4ff6f446001 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:18:30.806870 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea24c2be-d72e-4207-99fc-e4ff6f446001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:18:30.826249 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-ea24c2be-d72e-4207-99fc-e4ff6f446001 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:18:30.827451 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-ea24c2be-d72e-4207-99fc-e4ff6f446001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:18:30.884914 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1223/2449] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:18:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:18:30.893451 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c1c0c-cb3b-4f97-b018-551ce2edaa02 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:18:30.893742 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c1c0c-cb3b-4f97-b018-551ce2edaa02 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:18:30.894054 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c1c0c-cb3b-4f97-b018-551ce2edaa02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:18:30.914296 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-d38c1c0c-cb3b-4f97-b018-551ce2edaa02 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:18:30.915507 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-d38c1c0c-cb3b-4f97-b018-551ce2edaa02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:18:30.925972 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1227/2450] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:18:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:18:30.929440 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea24c2be-d72e-4207-99fc-e4ff6f446001 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:18:30.939330 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea24c2be-d72e-4207-99fc-e4ff6f446001 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:18:30.943906 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f964a76c-dde2-42b6-963c-af9997d6c5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:18:30.944509 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964a76c-dde2-42b6-963c-af9997d6c5e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:18:30.944791 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964a76c-dde2-42b6-963c-af9997d6c5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:18:30.945065 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964a76c-dde2-42b6-963c-af9997d6c5e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:18:30.945735 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f964a76c-dde2-42b6-963c-af9997d6c5e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:18:30.946067 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f964a76c-dde2-42b6-963c-af9997d6c5e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:18:30.947642 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f964a76c-dde2-42b6-963c-af9997d6c5e2 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:18:30.959146 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1224/2451] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 11:18:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:18:30.963530 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c1c0c-cb3b-4f97-b018-551ce2edaa02 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:18:30.968510 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:18:30.975008 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c1c0c-cb3b-4f97-b018-551ce2edaa02 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:18:30.981385 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413f40c2-a5c9-4384-b33b-f67cbf27d4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:18:30.982013 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f40c2-a5c9-4384-b33b-f67cbf27d4d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:18:30.982296 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f40c2-a5c9-4384-b33b-f67cbf27d4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:18:30.982567 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f40c2-a5c9-4384-b33b-f67cbf27d4d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:18:30.983194 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413f40c2-a5c9-4384-b33b-f67cbf27d4d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:18:30.985069 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413f40c2-a5c9-4384-b33b-f67cbf27d4d2 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:18:31.018462 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1228/2452] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:18:30 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:18:31.019811 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f964a76c-dde2-42b6-963c-af9997d6c5e2 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:18:31.030978 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f964a76c-dde2-42b6-963c-af9997d6c5e2 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:18:31.087534 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f10ce7b-624c-41e5-9458-a6f22ce86722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:18:31.088169 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f10ce7b-624c-41e5-9458-a6f22ce86722 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:18:31.088450 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f10ce7b-624c-41e5-9458-a6f22ce86722 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:18:31.088728 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f10ce7b-624c-41e5-9458-a6f22ce86722 admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:18:31.089880 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f10ce7b-624c-41e5-9458-a6f22ce86722 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:18:31.091805 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f10ce7b-624c-41e5-9458-a6f22ce86722 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:18:31.113729 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1225/2453] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:18:31 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:18:31.117921 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413f40c2-a5c9-4384-b33b-f67cbf27d4d2 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:18:31.128277 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413f40c2-a5c9-4384-b33b-f67cbf27d4d2 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:18:31.132793 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dfdc3e-1e8c-4024-b161-53112621b0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:18:31.133401 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dfdc3e-1e8c-4024-b161-53112621b0e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:18:31.133728 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dfdc3e-1e8c-4024-b161-53112621b0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:18:31.133967 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dfdc3e-1e8c-4024-b161-53112621b0e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:18:31.134604 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dfdc3e-1e8c-4024-b161-53112621b0e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:18:31.136669 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dfdc3e-1e8c-4024-b161-53112621b0e5 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:18:31.146300 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1229/2454] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:18:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:18:31.150152 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f10ce7b-624c-41e5-9458-a6f22ce86722 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:18:31.160516 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f10ce7b-624c-41e5-9458-a6f22ce86722 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:18:31.165162 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7c8fb9-5b92-45d2-bc12-d32d1bd24f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:18:31.165745 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c8fb9-5b92-45d2-bc12-d32d1bd24f70 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:18:31.166060 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c8fb9-5b92-45d2-bc12-d32d1bd24f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:18:31.166336 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c8fb9-5b92-45d2-bc12-d32d1bd24f70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:18:31.166970 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7c8fb9-5b92-45d2-bc12-d32d1bd24f70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:18:31.168564 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7c8fb9-5b92-45d2-bc12-d32d1bd24f70 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:18:31.173933 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:18:31.180142 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1226/2455] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:18:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:18:31.183887 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dfdc3e-1e8c-4024-b161-53112621b0e5 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:18:31.193679 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dfdc3e-1e8c-4024-b161-53112621b0e5 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:18:31.198195 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05fbe96-bb4f-442b-a2af-814b01b468ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:18:31.199357 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05fbe96-bb4f-442b-a2af-814b01b468ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:18:31.199631 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05fbe96-bb4f-442b-a2af-814b01b468ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:18:31.199901 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05fbe96-bb4f-442b-a2af-814b01b468ce admin admin] PATH_INFO: `/v3/projects/354fb53f53174a64973d2fdcd82c33cc/users/a7cfd5950dcc47fcb11bb665df6b7b3a/roles/7c3871c0ab68438b9014489d50b53a22` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:18:31.213848 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05fbe96-bb4f-442b-a2af-814b01b468ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=354fb53f53174a64973d2fdcd82c33cc, user_id=a7cfd5950dcc47fcb11bb665df6b7b3a, role_id=7c3871c0ab68438b9014489d50b53a22)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:18:31.217049 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05fbe96-bb4f-442b-a2af-814b01b468ce admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:18:31.229224 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1230/2456] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:18:31 2022] PUT /identity/v3/projects/354fb53f53174a64973d2fdcd82c33cc/users/a7cfd5950dcc47fcb11bb665df6b7b3a/roles/7c3871c0ab68438b9014489d50b53a22 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 11:18:31.241672 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a31bd1e-100c-4dfe-bd53-4a65b2296f88 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:18:31.241983 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a31bd1e-100c-4dfe-bd53-4a65b2296f88 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:18:31.242265 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a31bd1e-100c-4dfe-bd53-4a65b2296f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:18:31.269791 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-2a31bd1e-100c-4dfe-bd53-4a65b2296f88 None None] MFA Rules not processed for user `a7cfd5950dcc47fcb11bb665df6b7b3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:18:31.271025 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-2a31bd1e-100c-4dfe-bd53-4a65b2296f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:18:31.334672 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1227/2457] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:18:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:18:31.346199 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05fbe96-bb4f-442b-a2af-814b01b468ce admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:18:31.347893 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-d05fbe96-bb4f-442b-a2af-814b01b468ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:18:31.403427 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05fbe96-bb4f-442b-a2af-814b01b468ce admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:18:31.406983 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9249d2-55f8-4fe0-91d4-387e78cf34e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f4c2fc51f54f0e977648b13efaed1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:18:31.407577 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9249d2-55f8-4fe0-91d4-387e78cf34e8 service cinder] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:18:31.407858 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9249d2-55f8-4fe0-91d4-387e78cf34e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:18:31.408133 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9249d2-55f8-4fe0-91d4-387e78cf34e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:18:31.416171 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9249d2-55f8-4fe0-91d4-387e78cf34e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:18:31.417616 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9249d2-55f8-4fe0-91d4-387e78cf34e8 service cinder] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:18:31.426317 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1231/2458] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:18:31 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:18:36.719105 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a31bd1e-100c-4dfe-bd53-4a65b2296f88 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:18:36.780096 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a31bd1e-100c-4dfe-bd53-4a65b2296f88 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:18:36.784572 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9030f2-e49c-4adf-8ba4-3436cb9a9364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:18:36.785189 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9030f2-e49c-4adf-8ba4-3436cb9a9364 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:18:36.785468 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9030f2-e49c-4adf-8ba4-3436cb9a9364 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:18:36.785746 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9030f2-e49c-4adf-8ba4-3436cb9a9364 admin admin] PATH_INFO: `/v3/users/a7cfd5950dcc47fcb11bb665df6b7b3a` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:18:36.786878 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9030f2-e49c-4adf-8ba4-3436cb9a9364 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7cfd5950dcc47fcb11bb665df6b7b3a)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:18:36.788771 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9030f2-e49c-4adf-8ba4-3436cb9a9364 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:18:36.832617 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-8f9030f2-e49c-4adf-8ba4-3436cb9a9364 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7cfd5950dcc47fcb11bb665df6b7b3a'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:18:36.833259 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-8f9030f2-e49c-4adf-8ba4-3436cb9a9364 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7cfd5950dcc47fcb11bb665df6b7b3a'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:18:36.833855 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-8f9030f2-e49c-4adf-8ba4-3436cb9a9364 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7cfd5950dcc47fcb11bb665df6b7b3a'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:18:36.845969 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-8f9030f2-e49c-4adf-8ba4-3436cb9a9364 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7cfd5950dcc47fcb11bb665df6b7b3a'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:18:36.852843 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-8f9030f2-e49c-4adf-8ba4-3436cb9a9364 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7cfd5950dcc47fcb11bb665df6b7b3a'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:18:36.865277 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1228/2459] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:18:36 2022] DELETE /identity/v3/users/a7cfd5950dcc47fcb11bb665df6b7b3a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:18:36.869725 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf70871f-699f-4614-a94d-279b89c0e1b8 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:18:36.870732 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf70871f-699f-4614-a94d-279b89c0e1b8 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:18:36.870927 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf70871f-699f-4614-a94d-279b89c0e1b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:18:36.891006 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-bf70871f-699f-4614-a94d-279b89c0e1b8 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:18:36.892211 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-bf70871f-699f-4614-a94d-279b89c0e1b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:18:36.950014 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1232/2460] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:18:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:18:36.959547 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9030f2-e49c-4adf-8ba4-3436cb9a9364 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:18:36.960931 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-8f9030f2-e49c-4adf-8ba4-3436cb9a9364 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:18:36.973135 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:18:37.039922 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9030f2-e49c-4adf-8ba4-3436cb9a9364 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:18:37.043518 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b095d44-515c-49b6-87ea-4eb7bb208e42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:18:37.044109 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b095d44-515c-49b6-87ea-4eb7bb208e42 service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:18:37.044384 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b095d44-515c-49b6-87ea-4eb7bb208e42 service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:18:37.044684 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b095d44-515c-49b6-87ea-4eb7bb208e42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:18:37.054221 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b095d44-515c-49b6-87ea-4eb7bb208e42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:18:37.055624 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b095d44-515c-49b6-87ea-4eb7bb208e42 service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:18:37.065262 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1229/2461] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:18:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:18:37.329286 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf70871f-699f-4614-a94d-279b89c0e1b8 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:18:37.330737 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-bf70871f-699f-4614-a94d-279b89c0e1b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:18:37.360461 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf70871f-699f-4614-a94d-279b89c0e1b8 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:18:37.365326 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f574348-3e88-4ee4-a0cf-160b72c836f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:18:37.365991 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f574348-3e88-4ee4-a0cf-160b72c836f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:18:37.366275 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f574348-3e88-4ee4-a0cf-160b72c836f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:18:37.366548 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f574348-3e88-4ee4-a0cf-160b72c836f3 admin admin] PATH_INFO: `/v3/projects/354fb53f53174a64973d2fdcd82c33cc` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:18:37.367672 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f574348-3e88-4ee4-a0cf-160b72c836f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=354fb53f53174a64973d2fdcd82c33cc)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:18:37.369560 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f574348-3e88-4ee4-a0cf-160b72c836f3 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:18:37.412235 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:18:37.416921 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-0f574348-3e88-4ee4-a0cf-160b72c836f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '354fb53f53174a64973d2fdcd82c33cc', 'request_id': 'req-0f574348-3e88-4ee4-a0cf-160b72c836f3'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:18:37.425392 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-0f574348-3e88-4ee4-a0cf-160b72c836f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '354fb53f53174a64973d2fdcd82c33cc', 'request_id': 'req-0f574348-3e88-4ee4-a0cf-160b72c836f3'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:18:37.431104 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-0f574348-3e88-4ee4-a0cf-160b72c836f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '354fb53f53174a64973d2fdcd82c33cc', 'request_id': 'req-0f574348-3e88-4ee4-a0cf-160b72c836f3'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:18:37.442905 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-0f574348-3e88-4ee4-a0cf-160b72c836f3 admin admin] The token cache is being invalidate because project 354fb53f53174a64973d2fdcd82c33cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:18:37.443186 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-0f574348-3e88-4ee4-a0cf-160b72c836f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:18:37.443830 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-0f574348-3e88-4ee4-a0cf-160b72c836f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:18:37.445275 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1233/2462] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:18:37 2022] DELETE /identity/v3/projects/354fb53f53174a64973d2fdcd82c33cc => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:18:37.450202 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f65382f-316a-427d-b87a-bda0be1467e4 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:18:37.450531 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f65382f-316a-427d-b87a-bda0be1467e4 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:18:37.450748 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f65382f-316a-427d-b87a-bda0be1467e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:18:37.469808 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-5f65382f-316a-427d-b87a-bda0be1467e4 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:18:37.471043 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-5f65382f-316a-427d-b87a-bda0be1467e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:18:37.528467 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1230/2463] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:18:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:18:37.536587 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd9ba67-1e2f-46fc-ace9-1ff9688aa936 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:18:37.536883 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd9ba67-1e2f-46fc-ace9-1ff9688aa936 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:18:37.537160 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd9ba67-1e2f-46fc-ace9-1ff9688aa936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:18:37.556867 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-4fd9ba67-1e2f-46fc-ace9-1ff9688aa936 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:18:37.558131 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-4fd9ba67-1e2f-46fc-ace9-1ff9688aa936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:18:37.565878 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1234/2464] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:18:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:18:37.569974 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f65382f-316a-427d-b87a-bda0be1467e4 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:18:37.579493 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f65382f-316a-427d-b87a-bda0be1467e4 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:18:37.584036 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01833bbe-0d6b-4ea3-a3e9-a8c37186e81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:18:37.584624 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01833bbe-0d6b-4ea3-a3e9-a8c37186e81a admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:18:37.584902 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01833bbe-0d6b-4ea3-a3e9-a8c37186e81a admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:18:37.585175 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01833bbe-0d6b-4ea3-a3e9-a8c37186e81a admin admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:18:37.585810 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01833bbe-0d6b-4ea3-a3e9-a8c37186e81a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:18:37.586151 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01833bbe-0d6b-4ea3-a3e9-a8c37186e81a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:18:37.587726 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01833bbe-0d6b-4ea3-a3e9-a8c37186e81a admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:18:37.599380 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1231/2465] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 11:18:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:18:37.603392 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd9ba67-1e2f-46fc-ace9-1ff9688aa936 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:18:37.613221 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd9ba67-1e2f-46fc-ace9-1ff9688aa936 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:18:37.617897 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeaed42-f536-435f-8711-fbf877d43d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:18:37.618507 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeaed42-f536-435f-8711-fbf877d43d9d admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:18:37.618783 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeaed42-f536-435f-8711-fbf877d43d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:18:37.619054 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeaed42-f536-435f-8711-fbf877d43d9d admin admin] PATH_INFO: `/v3/projects` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:18:37.619680 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeaed42-f536-435f-8711-fbf877d43d9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:18:37.621590 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeaed42-f536-435f-8711-fbf877d43d9d admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:18:37.647846 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1235/2466] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:18:37 2022] POST /identity/v3/projects => generated 369 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:18:37.652609 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01833bbe-0d6b-4ea3-a3e9-a8c37186e81a admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:18:37.662474 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01833bbe-0d6b-4ea3-a3e9-a8c37186e81a admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:18:37.717301 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59902534-920b-49c0-a7b6-78d11fa18ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:18:37.717826 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59902534-920b-49c0-a7b6-78d11fa18ea5 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:18:37.718142 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59902534-920b-49c0-a7b6-78d11fa18ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:18:37.718420 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59902534-920b-49c0-a7b6-78d11fa18ea5 admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:18:37.719040 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59902534-920b-49c0-a7b6-78d11fa18ea5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:18:37.720940 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59902534-920b-49c0-a7b6-78d11fa18ea5 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:18:37.742068 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1232/2467] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:18:37 2022] POST /identity/v3/users => generated 285 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:18:37.746217 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeaed42-f536-435f-8711-fbf877d43d9d admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:18:37.756553 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeaed42-f536-435f-8711-fbf877d43d9d admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:18:37.761138 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf64449-7bee-4355-af0f-fb890f6b30de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:18:37.761729 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf64449-7bee-4355-af0f-fb890f6b30de admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:18:37.762050 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf64449-7bee-4355-af0f-fb890f6b30de admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:18:37.762325 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf64449-7bee-4355-af0f-fb890f6b30de admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:18:37.762969 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf64449-7bee-4355-af0f-fb890f6b30de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:18:37.764533 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf64449-7bee-4355-af0f-fb890f6b30de admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:18:37.774485 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1236/2468] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:18:37.778784 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59902534-920b-49c0-a7b6-78d11fa18ea5 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:18:37.788690 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59902534-920b-49c0-a7b6-78d11fa18ea5 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:18:37.794066 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b21174-eee4-4ae2-af0f-5962485d899a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:18:37.794642 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b21174-eee4-4ae2-af0f-5962485d899a admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:18:37.794916 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b21174-eee4-4ae2-af0f-5962485d899a admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:18:37.795185 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b21174-eee4-4ae2-af0f-5962485d899a admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:18:37.795814 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b21174-eee4-4ae2-af0f-5962485d899a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:18:37.797371 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b21174-eee4-4ae2-af0f-5962485d899a admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:18:37.799361 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:18:37.809452 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1233/2469] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:18:37.813276 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf64449-7bee-4355-af0f-fb890f6b30de admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:18:37.822968 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf64449-7bee-4355-af0f-fb890f6b30de admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:18:37.827529 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9d4f44-bf51-4e19-aca2-dea45fe52f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:18:37.828157 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9d4f44-bf51-4e19-aca2-dea45fe52f31 admin admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:18:37.828433 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9d4f44-bf51-4e19-aca2-dea45fe52f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:18:37.828705 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9d4f44-bf51-4e19-aca2-dea45fe52f31 admin admin] PATH_INFO: `/v3/projects/f1658a50ac814a5ebcab092a630bd26c/users/ba65cd74bb6247ceaa2f97adbcad975d/roles/7c3871c0ab68438b9014489d50b53a22` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:18:37.846234 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9d4f44-bf51-4e19-aca2-dea45fe52f31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1658a50ac814a5ebcab092a630bd26c, user_id=ba65cd74bb6247ceaa2f97adbcad975d, role_id=7c3871c0ab68438b9014489d50b53a22)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:18:37.848848 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9d4f44-bf51-4e19-aca2-dea45fe52f31 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:18:37.861863 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1237/2470] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:18:37 2022] PUT /identity/v3/projects/f1658a50ac814a5ebcab092a630bd26c/users/ba65cd74bb6247ceaa2f97adbcad975d/roles/7c3871c0ab68438b9014489d50b53a22 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:18:37.872160 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b81332-362f-40cf-9328-d3563fb485a4 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:18:37.872450 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b81332-362f-40cf-9328-d3563fb485a4 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:18:37.872730 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b81332-362f-40cf-9328-d3563fb485a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:18:37.900889 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-f4b81332-362f-40cf-9328-d3563fb485a4 None None] MFA Rules not processed for user `ba65cd74bb6247ceaa2f97adbcad975d`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:18:37.902781 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-f4b81332-362f-40cf-9328-d3563fb485a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:18:37.967467 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1234/2471] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:18:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:18:37.978583 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9d4f44-bf51-4e19-aca2-dea45fe52f31 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:18:37.980355 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-be9d4f44-bf51-4e19-aca2-dea45fe52f31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:18:38.038780 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9d4f44-bf51-4e19-aca2-dea45fe52f31 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:18:38.042480 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd1d6aa-0207-4846-b35e-7a7e2ec7c47d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '399f7d3700a24cb486e56b409a6e5429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:18:38.043076 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1d6aa-0207-4846-b35e-7a7e2ec7c47d service glance] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:18:38.043379 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1d6aa-0207-4846-b35e-7a7e2ec7c47d service glance] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:18:38.043650 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1d6aa-0207-4846-b35e-7a7e2ec7c47d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:18:38.051750 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd1d6aa-0207-4846-b35e-7a7e2ec7c47d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:18:38.053149 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd1d6aa-0207-4846-b35e-7a7e2ec7c47d service glance] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:18:38.061701 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1238/2472] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:18:37 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:18:47.962294 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=33 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:18:48.057799 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=61,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:18:50.449288 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b81332-362f-40cf-9328-d3563fb485a4 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:18:50.450823 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-f4b81332-362f-40cf-9328-d3563fb485a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:18:50.543736 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b81332-362f-40cf-9328-d3563fb485a4 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:18:50.549366 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc3b3f3-9c35-4fa4-9156-0d86f5cb456f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed4bb75e68a640fc92ddd47fad61a25a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:18:50.550020 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc3b3f3-9c35-4fa4-9156-0d86f5cb456f service placement] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:18:50.550301 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc3b3f3-9c35-4fa4-9156-0d86f5cb456f service placement] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:18:50.550573 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc3b3f3-9c35-4fa4-9156-0d86f5cb456f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:18:50.552444 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-1fc3b3f3-9c35-4fa4-9156-0d86f5cb456f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:18:50.565109 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc3b3f3-9c35-4fa4-9156-0d86f5cb456f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:18:50.566770 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc3b3f3-9c35-4fa4-9156-0d86f5cb456f service placement] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:18:50.577724 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1235/2473] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:18:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:18:53.732940 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e5d74-a322-4bd5-8892-c73424596c04 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:18:53.733473 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e5d74-a322-4bd5-8892-c73424596c04 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:18:53.733473 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e5d74-a322-4bd5-8892-c73424596c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:18:53.753999 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-e33e5d74-a322-4bd5-8892-c73424596c04 None None] MFA Rules not processed for user `dd538e9a9b08439a84ae6e3a2c78d862`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:18:53.755202 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-e33e5d74-a322-4bd5-8892-c73424596c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:18:53.807887 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1239/2474] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:18:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:19:00.572843 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=41 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:19:01.972736 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc3b3f3-9c35-4fa4-9156-0d86f5cb456f service placement] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:19:02.032935 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc3b3f3-9c35-4fa4-9156-0d86f5cb456f service placement] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:19:02.037472 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef535530-8040-4717-b2d8-7d22488e0617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:19:02.038115 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef535530-8040-4717-b2d8-7d22488e0617 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:19:02.038532 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef535530-8040-4717-b2d8-7d22488e0617 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:19:02.038806 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef535530-8040-4717-b2d8-7d22488e0617 admin admin] PATH_INFO: `/v3/users/ba65cd74bb6247ceaa2f97adbcad975d` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:19:02.039944 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef535530-8040-4717-b2d8-7d22488e0617 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba65cd74bb6247ceaa2f97adbcad975d)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:19:02.041836 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef535530-8040-4717-b2d8-7d22488e0617 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:19:02.086997 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-ef535530-8040-4717-b2d8-7d22488e0617 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba65cd74bb6247ceaa2f97adbcad975d'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:19:02.087659 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-ef535530-8040-4717-b2d8-7d22488e0617 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba65cd74bb6247ceaa2f97adbcad975d'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:19:02.088276 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-ef535530-8040-4717-b2d8-7d22488e0617 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba65cd74bb6247ceaa2f97adbcad975d'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:19:02.100335 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-ef535530-8040-4717-b2d8-7d22488e0617 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba65cd74bb6247ceaa2f97adbcad975d'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:19:02.107618 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-ef535530-8040-4717-b2d8-7d22488e0617 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba65cd74bb6247ceaa2f97adbcad975d'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:19:02.120214 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1236/2475] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:19:01 2022] DELETE /identity/v3/users/ba65cd74bb6247ceaa2f97adbcad975d => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:19:02.124709 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3030d5e6-0b92-480e-82a6-e505e2305efa None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:19:02.125200 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3030d5e6-0b92-480e-82a6-e505e2305efa None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:19:02.125310 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3030d5e6-0b92-480e-82a6-e505e2305efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:19:02.145268 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-3030d5e6-0b92-480e-82a6-e505e2305efa None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:19:02.146435 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-3030d5e6-0b92-480e-82a6-e505e2305efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:19:02.202809 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1240/2476] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:19:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:19:02.212406 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef535530-8040-4717-b2d8-7d22488e0617 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:19:02.213832 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-ef535530-8040-4717-b2d8-7d22488e0617 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:19:02.270169 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef535530-8040-4717-b2d8-7d22488e0617 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:19:02.273743 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe389b1-bbb1-44c3-bd76-1910943a0c0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:19:02.274360 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe389b1-bbb1-44c3-bd76-1910943a0c0c service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:19:02.274635 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe389b1-bbb1-44c3-bd76-1910943a0c0c service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:19:02.274905 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe389b1-bbb1-44c3-bd76-1910943a0c0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:19:02.284047 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe389b1-bbb1-44c3-bd76-1910943a0c0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:19:02.285461 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe389b1-bbb1-44c3-bd76-1910943a0c0c service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:19:02.294595 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1237/2477] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:19:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:19:02.628870 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3030d5e6-0b92-480e-82a6-e505e2305efa None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:19:02.630698 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-3030d5e6-0b92-480e-82a6-e505e2305efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:19:02.649690 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3030d5e6-0b92-480e-82a6-e505e2305efa None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:19:02.654542 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7976092b-e92f-470f-a13a-3b0de2303588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:19:02.655171 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7976092b-e92f-470f-a13a-3b0de2303588 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:19:02.655452 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7976092b-e92f-470f-a13a-3b0de2303588 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:19:02.655726 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7976092b-e92f-470f-a13a-3b0de2303588 admin admin] PATH_INFO: `/v3/projects/f1658a50ac814a5ebcab092a630bd26c` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:19:02.656866 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7976092b-e92f-470f-a13a-3b0de2303588 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1658a50ac814a5ebcab092a630bd26c)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:19:02.659333 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7976092b-e92f-470f-a13a-3b0de2303588 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:19:02.709594 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-7976092b-e92f-470f-a13a-3b0de2303588 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1658a50ac814a5ebcab092a630bd26c', 'request_id': 'req-7976092b-e92f-470f-a13a-3b0de2303588'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:19:02.715801 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-7976092b-e92f-470f-a13a-3b0de2303588 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1658a50ac814a5ebcab092a630bd26c', 'request_id': 'req-7976092b-e92f-470f-a13a-3b0de2303588'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:19:02.722382 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-7976092b-e92f-470f-a13a-3b0de2303588 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1658a50ac814a5ebcab092a630bd26c', 'request_id': 'req-7976092b-e92f-470f-a13a-3b0de2303588'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:19:02.735398 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-7976092b-e92f-470f-a13a-3b0de2303588 admin admin] The token cache is being invalidate because project f1658a50ac814a5ebcab092a630bd26c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:19:02.735685 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-7976092b-e92f-470f-a13a-3b0de2303588 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:19:02.736293 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-7976092b-e92f-470f-a13a-3b0de2303588 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:19:02.737763 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1241/2478] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:19:02 2022] DELETE /identity/v3/projects/f1658a50ac814a5ebcab092a630bd26c => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:19:12.290552 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:19:12.731917 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=79,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:19:59.545045 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe389b1-bbb1-44c3-bd76-1910943a0c0c service neutron] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:19:59.546669 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-efe389b1-bbb1-44c3-bd76-1910943a0c0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:19:59.563305 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe389b1-bbb1-44c3-bd76-1910943a0c0c service neutron] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:19:59.621887 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b32fb7d-14cd-4954-aa17-c919f242646f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:19:59.622478 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32fb7d-14cd-4954-aa17-c919f242646f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:19:59.622758 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32fb7d-14cd-4954-aa17-c919f242646f admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:19:59.623035 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32fb7d-14cd-4954-aa17-c919f242646f admin admin] PATH_INFO: `/v3/users/dd538e9a9b08439a84ae6e3a2c78d862` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:19:59.624158 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b32fb7d-14cd-4954-aa17-c919f242646f admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd538e9a9b08439a84ae6e3a2c78d862)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:19:59.626760 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b32fb7d-14cd-4954-aa17-c919f242646f admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:19:59.673903 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-8b32fb7d-14cd-4954-aa17-c919f242646f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd538e9a9b08439a84ae6e3a2c78d862'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:19:59.674573 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-8b32fb7d-14cd-4954-aa17-c919f242646f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd538e9a9b08439a84ae6e3a2c78d862'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:19:59.675164 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-8b32fb7d-14cd-4954-aa17-c919f242646f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd538e9a9b08439a84ae6e3a2c78d862'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:19:59.686602 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-8b32fb7d-14cd-4954-aa17-c919f242646f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd538e9a9b08439a84ae6e3a2c78d862'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:19:59.694520 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-8b32fb7d-14cd-4954-aa17-c919f242646f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd538e9a9b08439a84ae6e3a2c78d862'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:19:59.706957 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1238/2479] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:19:59 2022] DELETE /identity/v3/users/dd538e9a9b08439a84ae6e3a2c78d862 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:19:59.875234 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7976092b-e92f-470f-a13a-3b0de2303588 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:19:59.876912 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-7976092b-e92f-470f-a13a-3b0de2303588 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:19:59.890515 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7976092b-e92f-470f-a13a-3b0de2303588 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:19:59.948908 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba78f850-32cd-416a-aa66-5e925c3a5315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:19:59.949546 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78f850-32cd-416a-aa66-5e925c3a5315 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:19:59.949855 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78f850-32cd-416a-aa66-5e925c3a5315 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:19:59.950161 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78f850-32cd-416a-aa66-5e925c3a5315 admin admin] PATH_INFO: `/v3/projects/8c0dd87e330d471caa030ee7381c2904` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:19:59.951276 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba78f850-32cd-416a-aa66-5e925c3a5315 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c0dd87e330d471caa030ee7381c2904)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:19:59.953160 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba78f850-32cd-416a-aa66-5e925c3a5315 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:19:59.998673 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-ba78f850-32cd-416a-aa66-5e925c3a5315 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c0dd87e330d471caa030ee7381c2904', 'request_id': 'req-ba78f850-32cd-416a-aa66-5e925c3a5315'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:20:00.005234 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-ba78f850-32cd-416a-aa66-5e925c3a5315 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c0dd87e330d471caa030ee7381c2904', 'request_id': 'req-ba78f850-32cd-416a-aa66-5e925c3a5315'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:20:00.010610 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-ba78f850-32cd-416a-aa66-5e925c3a5315 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c0dd87e330d471caa030ee7381c2904', 'request_id': 'req-ba78f850-32cd-416a-aa66-5e925c3a5315'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:20:00.022244 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-ba78f850-32cd-416a-aa66-5e925c3a5315 admin admin] The token cache is being invalidate because project 8c0dd87e330d471caa030ee7381c2904 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:20:00.022523 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-ba78f850-32cd-416a-aa66-5e925c3a5315 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:20:00.023121 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-ba78f850-32cd-416a-aa66-5e925c3a5315 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:20:00.024556 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1242/2480] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:19:59 2022] DELETE /identity/v3/projects/8c0dd87e330d471caa030ee7381c2904 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:20:00.029498 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956cc1f-23a2-4079-b44a-8ada9d5938c6 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:00.029788 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956cc1f-23a2-4079-b44a-8ada9d5938c6 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:00.030108 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956cc1f-23a2-4079-b44a-8ada9d5938c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:00.050390 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-2956cc1f-23a2-4079-b44a-8ada9d5938c6 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:20:00.051601 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-2956cc1f-23a2-4079-b44a-8ada9d5938c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:20:00.108169 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1239/2481] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:20:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:20:00.116695 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe7f4c-a814-412a-95f7-2f5b4201b8f0 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:00.116985 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe7f4c-a814-412a-95f7-2f5b4201b8f0 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:00.117288 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe7f4c-a814-412a-95f7-2f5b4201b8f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:00.137046 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-bcbe7f4c-a814-412a-95f7-2f5b4201b8f0 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:20:00.138205 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-bcbe7f4c-a814-412a-95f7-2f5b4201b8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:20:00.146011 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1243/2482] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:20:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:20:00.150119 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2956cc1f-23a2-4079-b44a-8ada9d5938c6 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:20:00.160407 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2956cc1f-23a2-4079-b44a-8ada9d5938c6 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:20:00.165015 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d443966c-f9f4-46c0-b6b4-8b97ed6f8b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:20:00.165610 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d443966c-f9f4-46c0-b6b4-8b97ed6f8b37 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:00.165894 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d443966c-f9f4-46c0-b6b4-8b97ed6f8b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:00.166203 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d443966c-f9f4-46c0-b6b4-8b97ed6f8b37 admin admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:00.166873 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d443966c-f9f4-46c0-b6b4-8b97ed6f8b37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:20:00.167173 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d443966c-f9f4-46c0-b6b4-8b97ed6f8b37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:20:00.168749 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d443966c-f9f4-46c0-b6b4-8b97ed6f8b37 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:20:00.180755 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1240/2483] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 11:20:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:20:00.184937 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbe7f4c-a814-412a-95f7-2f5b4201b8f0 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:20:00.194133 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbe7f4c-a814-412a-95f7-2f5b4201b8f0 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:20:00.199003 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc29fd-fcf2-43a6-ab8c-3b205f723eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:20:00.199597 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc29fd-fcf2-43a6-ab8c-3b205f723eeb admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:00.199878 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc29fd-fcf2-43a6-ab8c-3b205f723eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:00.200159 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc29fd-fcf2-43a6-ab8c-3b205f723eeb admin admin] PATH_INFO: `/v3/projects` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:00.200787 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cc29fd-fcf2-43a6-ab8c-3b205f723eeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:20:00.202698 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cc29fd-fcf2-43a6-ab8c-3b205f723eeb admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:20:00.230250 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1244/2484] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:20:00 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:20:00.234255 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d443966c-f9f4-46c0-b6b4-8b97ed6f8b37 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:20:00.243867 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d443966c-f9f4-46c0-b6b4-8b97ed6f8b37 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:20:00.247365 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:20:00.303917 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e68bd-a1f7-4487-86d4-6eb11299f3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:20:00.304515 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e68bd-a1f7-4487-86d4-6eb11299f3a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:00.304790 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e68bd-a1f7-4487-86d4-6eb11299f3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:00.305059 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e68bd-a1f7-4487-86d4-6eb11299f3a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:00.305687 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316e68bd-a1f7-4487-86d4-6eb11299f3a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:20:00.307634 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316e68bd-a1f7-4487-86d4-6eb11299f3a9 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:20:00.328279 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1241/2485] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:20:00 2022] POST /identity/v3/users => generated 283 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:20:00.332952 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc29fd-fcf2-43a6-ab8c-3b205f723eeb admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:20:00.343211 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc29fd-fcf2-43a6-ab8c-3b205f723eeb admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:20:00.348285 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa736e1-2d4c-4021-b215-b7880a83ebf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:20:00.348874 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa736e1-2d4c-4021-b215-b7880a83ebf4 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:00.349150 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa736e1-2d4c-4021-b215-b7880a83ebf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:00.349417 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa736e1-2d4c-4021-b215-b7880a83ebf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:00.350117 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa736e1-2d4c-4021-b215-b7880a83ebf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:20:00.351665 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa736e1-2d4c-4021-b215-b7880a83ebf4 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:20:00.361166 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1245/2486] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:20:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:20:00.364724 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e68bd-a1f7-4487-86d4-6eb11299f3a9 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:20:00.374254 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e68bd-a1f7-4487-86d4-6eb11299f3a9 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:20:00.379047 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e52fc-80b6-400b-9691-8f81db3a8d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:20:00.379622 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e52fc-80b6-400b-9691-8f81db3a8d5d admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:00.379906 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e52fc-80b6-400b-9691-8f81db3a8d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:00.380177 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e52fc-80b6-400b-9691-8f81db3a8d5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:00.380800 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4e52fc-80b6-400b-9691-8f81db3a8d5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:20:00.382381 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4e52fc-80b6-400b-9691-8f81db3a8d5d admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:20:00.393042 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1242/2487] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:20:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:20:00.396698 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa736e1-2d4c-4021-b215-b7880a83ebf4 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:20:00.406317 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa736e1-2d4c-4021-b215-b7880a83ebf4 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:20:00.411416 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b2e473-7a5d-4701-847f-ee753da1814e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:20:00.412042 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b2e473-7a5d-4701-847f-ee753da1814e admin admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:00.412318 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b2e473-7a5d-4701-847f-ee753da1814e admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:00.412587 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b2e473-7a5d-4701-847f-ee753da1814e admin admin] PATH_INFO: `/v3/projects/263588a2b3944a339d500c0ce2a4f53d/users/64844c220b034eef9dc30b1a36d9091d/roles/7c3871c0ab68438b9014489d50b53a22` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:00.426837 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b2e473-7a5d-4701-847f-ee753da1814e admin admin] RBAC: Authorizing `identity:create_grant(project_id=263588a2b3944a339d500c0ce2a4f53d, user_id=64844c220b034eef9dc30b1a36d9091d, role_id=7c3871c0ab68438b9014489d50b53a22)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:20:00.429516 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b2e473-7a5d-4701-847f-ee753da1814e admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:20:00.441702 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1246/2488] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:20:00 2022] PUT /identity/v3/projects/263588a2b3944a339d500c0ce2a4f53d/users/64844c220b034eef9dc30b1a36d9091d/roles/7c3871c0ab68438b9014489d50b53a22 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 11:20:00.452556 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11712e1-f7a4-4c4c-894b-4db809e2a01c None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:00.452836 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11712e1-f7a4-4c4c-894b-4db809e2a01c None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:00.453103 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11712e1-f7a4-4c4c-894b-4db809e2a01c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:00.480724 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-d11712e1-f7a4-4c4c-894b-4db809e2a01c None None] MFA Rules not processed for user `64844c220b034eef9dc30b1a36d9091d`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:20:00.481917 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-d11712e1-f7a4-4c4c-894b-4db809e2a01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:20:00.543427 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1243/2489] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:20:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:20:00.547992 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b2e473-7a5d-4701-847f-ee753da1814e admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:20:00.577168 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:20:00.610792 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b2e473-7a5d-4701-847f-ee753da1814e admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:20:00.615370 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc33472-bb01-4237-a340-5e094e9b33ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:20:00.615963 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc33472-bb01-4237-a340-5e094e9b33ad admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:00.616241 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc33472-bb01-4237-a340-5e094e9b33ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:00.616512 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc33472-bb01-4237-a340-5e094e9b33ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:00.617133 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc33472-bb01-4237-a340-5e094e9b33ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:20:00.619064 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc33472-bb01-4237-a340-5e094e9b33ad admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:20:00.645474 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1247/2490] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:20:00 2022] POST /identity/v3/projects => generated 363 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:20:00.650079 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11712e1-f7a4-4c4c-894b-4db809e2a01c None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:20:00.660818 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11712e1-f7a4-4c4c-894b-4db809e2a01c None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:20:00.715586 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0052f68f-f9ea-48cd-b2ce-6b7307fe682a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:20:00.716191 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0052f68f-f9ea-48cd-b2ce-6b7307fe682a admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:00.716472 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0052f68f-f9ea-48cd-b2ce-6b7307fe682a admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:00.716750 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0052f68f-f9ea-48cd-b2ce-6b7307fe682a admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:00.717371 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0052f68f-f9ea-48cd-b2ce-6b7307fe682a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:20:00.719306 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0052f68f-f9ea-48cd-b2ce-6b7307fe682a admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:20:00.739978 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1244/2491] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:20:00 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:20:00.743906 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc33472-bb01-4237-a340-5e094e9b33ad admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:20:00.754726 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc33472-bb01-4237-a340-5e094e9b33ad admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:20:00.759338 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a1c75-8806-4219-8af6-a8f41a014281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:20:00.759956 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a1c75-8806-4219-8af6-a8f41a014281 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:00.760237 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a1c75-8806-4219-8af6-a8f41a014281 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:00.760510 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a1c75-8806-4219-8af6-a8f41a014281 admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:00.761154 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334a1c75-8806-4219-8af6-a8f41a014281 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:20:00.762758 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334a1c75-8806-4219-8af6-a8f41a014281 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:20:00.773572 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1248/2492] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:20:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:20:00.777432 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0052f68f-f9ea-48cd-b2ce-6b7307fe682a admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:20:00.783795 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:20:00.787873 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0052f68f-f9ea-48cd-b2ce-6b7307fe682a admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:20:00.793760 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d91dbe-cbca-4b23-aab4-f195ff412b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:20:00.794435 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d91dbe-cbca-4b23-aab4-f195ff412b86 admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:00.794713 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d91dbe-cbca-4b23-aab4-f195ff412b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:00.794990 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d91dbe-cbca-4b23-aab4-f195ff412b86 admin admin] PATH_INFO: `/v3/projects/596139bd30c444e29fa24aa95fabb20d/users/2925f98dc4324c199cead7676e4eb972/roles/ea564961b1db4eb4a1d4d880964611b2` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:00.809247 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d91dbe-cbca-4b23-aab4-f195ff412b86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=596139bd30c444e29fa24aa95fabb20d, user_id=2925f98dc4324c199cead7676e4eb972, role_id=ea564961b1db4eb4a1d4d880964611b2)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:20:00.812208 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d91dbe-cbca-4b23-aab4-f195ff412b86 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:20:00.825251 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1245/2493] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:20:00 2022] PUT /identity/v3/projects/596139bd30c444e29fa24aa95fabb20d/users/2925f98dc4324c199cead7676e4eb972/roles/ea564961b1db4eb4a1d4d880964611b2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:20:00.829919 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a1c75-8806-4219-8af6-a8f41a014281 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:20:00.839944 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a1c75-8806-4219-8af6-a8f41a014281 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:20:00.895804 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b2aa16-b157-47c3-a826-8f2f591314a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:20:00.896364 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b2aa16-b157-47c3-a826-8f2f591314a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:00.896616 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b2aa16-b157-47c3-a826-8f2f591314a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:00.896886 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b2aa16-b157-47c3-a826-8f2f591314a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:00.897525 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b2aa16-b157-47c3-a826-8f2f591314a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:20:00.899128 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b2aa16-b157-47c3-a826-8f2f591314a5 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:20:00.908700 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1249/2494] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:20:00 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:20:00.912906 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d91dbe-cbca-4b23-aab4-f195ff412b86 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:20:00.923824 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d91dbe-cbca-4b23-aab4-f195ff412b86 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:20:00.928503 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08bfdce-67df-4f71-92cb-0a7e87126d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:20:00.929149 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08bfdce-67df-4f71-92cb-0a7e87126d2a admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:00.929429 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08bfdce-67df-4f71-92cb-0a7e87126d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:00.929703 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08bfdce-67df-4f71-92cb-0a7e87126d2a admin admin] PATH_INFO: `/v3/projects/596139bd30c444e29fa24aa95fabb20d/users/2925f98dc4324c199cead7676e4eb972/roles/ea564961b1db4eb4a1d4d880964611b2` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:00.931654 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08bfdce-67df-4f71-92cb-0a7e87126d2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=596139bd30c444e29fa24aa95fabb20d, user_id=2925f98dc4324c199cead7676e4eb972, role_id=ea564961b1db4eb4a1d4d880964611b2)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:20:00.934296 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08bfdce-67df-4f71-92cb-0a7e87126d2a admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:20:00.944832 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1246/2495] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:20:00 2022] PUT /identity/v3/projects/596139bd30c444e29fa24aa95fabb20d/users/2925f98dc4324c199cead7676e4eb972/roles/ea564961b1db4eb4a1d4d880964611b2 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:20:00.955004 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123b41f-3949-477d-886b-8ecad436cfa9 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:00.955292 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123b41f-3949-477d-886b-8ecad436cfa9 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:00.955563 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123b41f-3949-477d-886b-8ecad436cfa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:00.982414 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-b123b41f-3949-477d-886b-8ecad436cfa9 None None] MFA Rules not processed for user `2925f98dc4324c199cead7676e4eb972`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:20:00.983619 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-b123b41f-3949-477d-886b-8ecad436cfa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:20:01.049719 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1250/2496] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:20:00 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:20:01.060986 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08bfdce-67df-4f71-92cb-0a7e87126d2a admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:20:01.062740 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-c08bfdce-67df-4f71-92cb-0a7e87126d2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:20:01.139579 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08bfdce-67df-4f71-92cb-0a7e87126d2a admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:20:01.143173 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ce68d0-2bec-462a-859e-de85c5d9c702 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f4c2fc51f54f0e977648b13efaed1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:20:01.143769 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce68d0-2bec-462a-859e-de85c5d9c702 service cinder] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:01.144049 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce68d0-2bec-462a-859e-de85c5d9c702 service cinder] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:01.144324 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce68d0-2bec-462a-859e-de85c5d9c702 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:01.153149 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ce68d0-2bec-462a-859e-de85c5d9c702 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:20:01.154549 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ce68d0-2bec-462a-859e-de85c5d9c702 service cinder] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:20:01.163762 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1247/2497] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:20:01 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:20:01.237724 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b123b41f-3949-477d-886b-8ecad436cfa9 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:20:01.247125 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b123b41f-3949-477d-886b-8ecad436cfa9 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:20:01.250758 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d67ea4-9660-4c3d-8ac2-f450070f83ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f4c2fc51f54f0e977648b13efaed1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:20:01.251926 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d67ea4-9660-4c3d-8ac2-f450070f83ab service cinder] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:01.252216 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d67ea4-9660-4c3d-8ac2-f450070f83ab service cinder] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:01.252495 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d67ea4-9660-4c3d-8ac2-f450070f83ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:01.271223 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:20:01.308546 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d67ea4-9660-4c3d-8ac2-f450070f83ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:20:01.310017 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d67ea4-9660-4c3d-8ac2-f450070f83ab service cinder] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:20:01.319624 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1251/2498] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:20:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:20:04.022168 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ce68d0-2bec-462a-859e-de85c5d9c702 service cinder] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:20:04.082921 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ce68d0-2bec-462a-859e-de85c5d9c702 service cinder] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:20:04.087406 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41581b53-a0ba-4ef3-b02b-eec4f19d692f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:20:04.088024 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41581b53-a0ba-4ef3-b02b-eec4f19d692f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:04.088307 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41581b53-a0ba-4ef3-b02b-eec4f19d692f admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:04.088579 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41581b53-a0ba-4ef3-b02b-eec4f19d692f admin admin] PATH_INFO: `/v3/users/64844c220b034eef9dc30b1a36d9091d` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:04.089679 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41581b53-a0ba-4ef3-b02b-eec4f19d692f admin admin] RBAC: Authorizing `identity:delete_user(user_id=64844c220b034eef9dc30b1a36d9091d)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:20:04.091617 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41581b53-a0ba-4ef3-b02b-eec4f19d692f admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:20:04.138135 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-41581b53-a0ba-4ef3-b02b-eec4f19d692f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64844c220b034eef9dc30b1a36d9091d'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:20:04.138697 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-41581b53-a0ba-4ef3-b02b-eec4f19d692f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64844c220b034eef9dc30b1a36d9091d'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:20:04.139284 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-41581b53-a0ba-4ef3-b02b-eec4f19d692f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64844c220b034eef9dc30b1a36d9091d'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:20:04.143557 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:20:04.153868 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-41581b53-a0ba-4ef3-b02b-eec4f19d692f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64844c220b034eef9dc30b1a36d9091d'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:20:04.161149 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-41581b53-a0ba-4ef3-b02b-eec4f19d692f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64844c220b034eef9dc30b1a36d9091d'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:20:04.173987 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1248/2499] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:20:04 2022] DELETE /identity/v3/users/64844c220b034eef9dc30b1a36d9091d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:20:04.178663 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93df35c3-13d7-46b1-9db5-5d0a921a6de4 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:04.179261 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93df35c3-13d7-46b1-9db5-5d0a921a6de4 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:04.179261 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93df35c3-13d7-46b1-9db5-5d0a921a6de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:04.198776 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-93df35c3-13d7-46b1-9db5-5d0a921a6de4 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:20:04.199967 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-93df35c3-13d7-46b1-9db5-5d0a921a6de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:20:04.262907 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1252/2500] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:20:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 11:20:04.272815 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41581b53-a0ba-4ef3-b02b-eec4f19d692f admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:20:04.274273 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-41581b53-a0ba-4ef3-b02b-eec4f19d692f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:20:04.330297 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41581b53-a0ba-4ef3-b02b-eec4f19d692f admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:20:04.333906 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4e1ba0-4f0c-4c43-9c4a-0a35b3888278 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:20:04.334536 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e1ba0-4f0c-4c43-9c4a-0a35b3888278 service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:04.334811 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e1ba0-4f0c-4c43-9c4a-0a35b3888278 service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:04.335081 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e1ba0-4f0c-4c43-9c4a-0a35b3888278 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:04.343880 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4e1ba0-4f0c-4c43-9c4a-0a35b3888278 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:20:04.345824 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4e1ba0-4f0c-4c43-9c4a-0a35b3888278 service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:20:04.355213 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1249/2501] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:20:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:20:04.619626 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93df35c3-13d7-46b1-9db5-5d0a921a6de4 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:20:04.621125 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-93df35c3-13d7-46b1-9db5-5d0a921a6de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:20:04.634856 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93df35c3-13d7-46b1-9db5-5d0a921a6de4 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:20:04.640235 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba723c-d222-4a53-ba76-a5c1c0385065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:20:04.641013 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba723c-d222-4a53-ba76-a5c1c0385065 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:04.641449 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba723c-d222-4a53-ba76-a5c1c0385065 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:04.641880 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba723c-d222-4a53-ba76-a5c1c0385065 admin admin] PATH_INFO: `/v3/projects/263588a2b3944a339d500c0ce2a4f53d` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:04.643342 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daba723c-d222-4a53-ba76-a5c1c0385065 admin admin] RBAC: Authorizing `identity:delete_project(project_id=263588a2b3944a339d500c0ce2a4f53d)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:20:04.645695 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daba723c-d222-4a53-ba76-a5c1c0385065 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:20:04.692898 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-daba723c-d222-4a53-ba76-a5c1c0385065 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '263588a2b3944a339d500c0ce2a4f53d', 'request_id': 'req-daba723c-d222-4a53-ba76-a5c1c0385065'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:20:04.699163 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-daba723c-d222-4a53-ba76-a5c1c0385065 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '263588a2b3944a339d500c0ce2a4f53d', 'request_id': 'req-daba723c-d222-4a53-ba76-a5c1c0385065'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:20:04.705453 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-daba723c-d222-4a53-ba76-a5c1c0385065 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '263588a2b3944a339d500c0ce2a4f53d', 'request_id': 'req-daba723c-d222-4a53-ba76-a5c1c0385065'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:20:04.717617 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-daba723c-d222-4a53-ba76-a5c1c0385065 admin admin] The token cache is being invalidate because project 263588a2b3944a339d500c0ce2a4f53d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:20:04.717904 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-daba723c-d222-4a53-ba76-a5c1c0385065 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:20:04.718541 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-daba723c-d222-4a53-ba76-a5c1c0385065 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:20:04.720703 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1253/2502] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:20:04 2022] DELETE /identity/v3/projects/263588a2b3944a339d500c0ce2a4f53d => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 11:20:04.724714 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4e1ba0-4f0c-4c43-9c4a-0a35b3888278 service neutron] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:20:04.734341 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4e1ba0-4f0c-4c43-9c4a-0a35b3888278 service neutron] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:20:04.789106 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfcb05c-1981-414d-b8a8-9b7650982b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:20:04.789776 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfcb05c-1981-414d-b8a8-9b7650982b40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:04.790093 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfcb05c-1981-414d-b8a8-9b7650982b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:04.790368 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfcb05c-1981-414d-b8a8-9b7650982b40 admin admin] PATH_INFO: `/v3/users/2925f98dc4324c199cead7676e4eb972` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:04.791501 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfcb05c-1981-414d-b8a8-9b7650982b40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2925f98dc4324c199cead7676e4eb972)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:20:04.793403 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfcb05c-1981-414d-b8a8-9b7650982b40 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:20:04.837672 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-0cfcb05c-1981-414d-b8a8-9b7650982b40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2925f98dc4324c199cead7676e4eb972'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:20:04.838319 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-0cfcb05c-1981-414d-b8a8-9b7650982b40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2925f98dc4324c199cead7676e4eb972'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:20:04.838923 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-0cfcb05c-1981-414d-b8a8-9b7650982b40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2925f98dc4324c199cead7676e4eb972'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:20:04.851118 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-0cfcb05c-1981-414d-b8a8-9b7650982b40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2925f98dc4324c199cead7676e4eb972'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:20:04.858611 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-0cfcb05c-1981-414d-b8a8-9b7650982b40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2925f98dc4324c199cead7676e4eb972'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:20:04.860789 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:20:04.873157 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1250/2503] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:20:04 2022] DELETE /identity/v3/users/2925f98dc4324c199cead7676e4eb972 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:20:05.136389 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba723c-d222-4a53-ba76-a5c1c0385065 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:20:05.137838 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-daba723c-d222-4a53-ba76-a5c1c0385065 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:20:05.152246 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba723c-d222-4a53-ba76-a5c1c0385065 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:20:05.192679 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:20:05.210223 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27637777-2375-4c19-8860-7928fc4936b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:20:05.210853 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27637777-2375-4c19-8860-7928fc4936b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:05.211135 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27637777-2375-4c19-8860-7928fc4936b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:05.211407 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27637777-2375-4c19-8860-7928fc4936b9 admin admin] PATH_INFO: `/v3/projects/596139bd30c444e29fa24aa95fabb20d` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:05.212519 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27637777-2375-4c19-8860-7928fc4936b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=596139bd30c444e29fa24aa95fabb20d)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:20:05.214478 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27637777-2375-4c19-8860-7928fc4936b9 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:20:05.258979 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-27637777-2375-4c19-8860-7928fc4936b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '596139bd30c444e29fa24aa95fabb20d', 'request_id': 'req-27637777-2375-4c19-8860-7928fc4936b9'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:20:05.265019 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-27637777-2375-4c19-8860-7928fc4936b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '596139bd30c444e29fa24aa95fabb20d', 'request_id': 'req-27637777-2375-4c19-8860-7928fc4936b9'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:20:05.271050 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-27637777-2375-4c19-8860-7928fc4936b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '596139bd30c444e29fa24aa95fabb20d', 'request_id': 'req-27637777-2375-4c19-8860-7928fc4936b9'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:20:05.283040 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-27637777-2375-4c19-8860-7928fc4936b9 admin admin] The token cache is being invalidate because project 596139bd30c444e29fa24aa95fabb20d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:20:05.283325 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-27637777-2375-4c19-8860-7928fc4936b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:20:05.283941 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-27637777-2375-4c19-8860-7928fc4936b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:20:05.285401 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1254/2504] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:20:05 2022] DELETE /identity/v3/projects/596139bd30c444e29fa24aa95fabb20d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:20:05.290369 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce517f-4d6b-48f2-af0a-e010ff310a65 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:05.290861 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce517f-4d6b-48f2-af0a-e010ff310a65 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:05.290966 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce517f-4d6b-48f2-af0a-e010ff310a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:05.309966 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-81ce517f-4d6b-48f2-af0a-e010ff310a65 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:20:05.311162 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-81ce517f-4d6b-48f2-af0a-e010ff310a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:20:05.368374 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1251/2505] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:20:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 11:20:05.376538 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d7a03-e6c7-4e2c-a8b6-1c5e354b17d7 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:05.376820 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d7a03-e6c7-4e2c-a8b6-1c5e354b17d7 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:05.377091 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d7a03-e6c7-4e2c-a8b6-1c5e354b17d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:05.397082 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-577d7a03-e6c7-4e2c-a8b6-1c5e354b17d7 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:20:05.398315 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-577d7a03-e6c7-4e2c-a8b6-1c5e354b17d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:20:05.406084 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1255/2506] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:20:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:20:05.410128 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce517f-4d6b-48f2-af0a-e010ff310a65 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:20:05.419782 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce517f-4d6b-48f2-af0a-e010ff310a65 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:20:05.424795 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c6a5dc-5596-46bc-8b8b-12a6e0fc0ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:20:05.425377 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6a5dc-5596-46bc-8b8b-12a6e0fc0ba7 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:05.425654 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6a5dc-5596-46bc-8b8b-12a6e0fc0ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:05.425928 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6a5dc-5596-46bc-8b8b-12a6e0fc0ba7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:05.426593 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c6a5dc-5596-46bc-8b8b-12a6e0fc0ba7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:20:05.426896 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c6a5dc-5596-46bc-8b8b-12a6e0fc0ba7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:20:05.428530 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c6a5dc-5596-46bc-8b8b-12a6e0fc0ba7 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:20:05.440340 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1252/2507] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 11:20:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:20:05.444416 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577d7a03-e6c7-4e2c-a8b6-1c5e354b17d7 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:20:05.453637 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577d7a03-e6c7-4e2c-a8b6-1c5e354b17d7 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:20:05.458463 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a187e06-6101-42ff-a7f3-827670018986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:20:05.459052 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a187e06-6101-42ff-a7f3-827670018986 admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:05.459329 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a187e06-6101-42ff-a7f3-827670018986 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:05.459596 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a187e06-6101-42ff-a7f3-827670018986 admin admin] PATH_INFO: `/v3/projects` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:05.460246 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a187e06-6101-42ff-a7f3-827670018986 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:20:05.462137 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a187e06-6101-42ff-a7f3-827670018986 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:20:05.488563 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1256/2508] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:20:05 2022] POST /identity/v3/projects => generated 401 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:20:05.492487 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c6a5dc-5596-46bc-8b8b-12a6e0fc0ba7 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:20:05.502770 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c6a5dc-5596-46bc-8b8b-12a6e0fc0ba7 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:20:05.556086 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a9b5d3-4bd5-4f2f-8ecc-b55d8b22c0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:20:05.556675 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a9b5d3-4bd5-4f2f-8ecc-b55d8b22c0d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:05.556951 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a9b5d3-4bd5-4f2f-8ecc-b55d8b22c0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:05.557220 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a9b5d3-4bd5-4f2f-8ecc-b55d8b22c0d6 admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:05.557839 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a9b5d3-4bd5-4f2f-8ecc-b55d8b22c0d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:20:05.559749 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a9b5d3-4bd5-4f2f-8ecc-b55d8b22c0d6 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:20:05.581782 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1253/2509] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:20:05 2022] POST /identity/v3/users => generated 301 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 11:20:05.585952 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a187e06-6101-42ff-a7f3-827670018986 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:20:05.596336 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a187e06-6101-42ff-a7f3-827670018986 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:20:05.600916 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095432d4-18e8-4c81-a98b-d0d6e7b8e847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:20:05.601502 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095432d4-18e8-4c81-a98b-d0d6e7b8e847 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:05.601776 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095432d4-18e8-4c81-a98b-d0d6e7b8e847 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:05.602075 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095432d4-18e8-4c81-a98b-d0d6e7b8e847 admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:05.602735 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095432d4-18e8-4c81-a98b-d0d6e7b8e847 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:20:05.604268 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095432d4-18e8-4c81-a98b-d0d6e7b8e847 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:20:05.615028 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1257/2510] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:20:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:20:05.618727 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a9b5d3-4bd5-4f2f-8ecc-b55d8b22c0d6 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:20:05.630493 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a9b5d3-4bd5-4f2f-8ecc-b55d8b22c0d6 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:20:05.635513 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582a3f51-deb4-487a-8b03-ec847b82ba10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:20:05.636120 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a3f51-deb4-487a-8b03-ec847b82ba10 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:05.636401 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a3f51-deb4-487a-8b03-ec847b82ba10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:05.636678 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a3f51-deb4-487a-8b03-ec847b82ba10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:05.637323 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582a3f51-deb4-487a-8b03-ec847b82ba10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:20:05.638933 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582a3f51-deb4-487a-8b03-ec847b82ba10 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:20:05.650467 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1254/2511] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:20:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 13 11:20:05.654595 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095432d4-18e8-4c81-a98b-d0d6e7b8e847 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:20:05.664409 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095432d4-18e8-4c81-a98b-d0d6e7b8e847 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:20:05.668936 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d84d61-76b2-46ac-8739-fb6ddde709a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:20:05.669568 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d84d61-76b2-46ac-8739-fb6ddde709a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:05.669846 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d84d61-76b2-46ac-8739-fb6ddde709a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:05.670167 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d84d61-76b2-46ac-8739-fb6ddde709a3 admin admin] PATH_INFO: `/v3/projects/fed1d26023774b12bf14641e2525e348/users/dbcfadd138d74dada96669484bedacc4/roles/7c3871c0ab68438b9014489d50b53a22` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:05.684651 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d84d61-76b2-46ac-8739-fb6ddde709a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fed1d26023774b12bf14641e2525e348, user_id=dbcfadd138d74dada96669484bedacc4, role_id=7c3871c0ab68438b9014489d50b53a22)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:20:05.687291 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d84d61-76b2-46ac-8739-fb6ddde709a3 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:20:05.700497 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1258/2512] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:20:05 2022] PUT /identity/v3/projects/fed1d26023774b12bf14641e2525e348/users/dbcfadd138d74dada96669484bedacc4/roles/7c3871c0ab68438b9014489d50b53a22 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:20:05.712294 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f545076-5162-4258-bb68-3b0c073c7ef0 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:05.712579 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f545076-5162-4258-bb68-3b0c073c7ef0 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:05.712851 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f545076-5162-4258-bb68-3b0c073c7ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:05.740910 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-3f545076-5162-4258-bb68-3b0c073c7ef0 None None] MFA Rules not processed for user `dbcfadd138d74dada96669484bedacc4`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:20:05.742048 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-3f545076-5162-4258-bb68-3b0c073c7ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:20:05.786826 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:20:05.808316 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1255/2513] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:20:05 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:20:05.813149 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d84d61-76b2-46ac-8739-fb6ddde709a3 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:20:05.874334 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d84d61-76b2-46ac-8739-fb6ddde709a3 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:20:05.879723 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeb6928-229d-42c9-8346-2b5b016588f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:20:05.880324 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb6928-229d-42c9-8346-2b5b016588f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:05.880605 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb6928-229d-42c9-8346-2b5b016588f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:05.880884 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb6928-229d-42c9-8346-2b5b016588f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:05.881527 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeb6928-229d-42c9-8346-2b5b016588f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:20:05.883877 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeb6928-229d-42c9-8346-2b5b016588f3 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:20:05.899445 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:20:05.913604 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1259/2514] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:20:05 2022] POST /identity/v3/projects => generated 401 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:20:05.917724 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f545076-5162-4258-bb68-3b0c073c7ef0 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:20:05.928149 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f545076-5162-4258-bb68-3b0c073c7ef0 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:20:05.982448 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f4e358-8955-4884-8972-fef779bbb395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:20:05.983047 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4e358-8955-4884-8972-fef779bbb395 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:05.983313 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4e358-8955-4884-8972-fef779bbb395 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:05.983587 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4e358-8955-4884-8972-fef779bbb395 admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:05.984207 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f4e358-8955-4884-8972-fef779bbb395 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:20:05.986117 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f4e358-8955-4884-8972-fef779bbb395 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:20:06.006668 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1256/2515] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:20:05 2022] POST /identity/v3/users => generated 307 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:20:06.010569 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeb6928-229d-42c9-8346-2b5b016588f3 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:20:06.021553 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeb6928-229d-42c9-8346-2b5b016588f3 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:20:06.026496 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca09ca-ed37-4b4a-8b8a-88616e612673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:20:06.027082 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca09ca-ed37-4b4a-8b8a-88616e612673 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:06.027358 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca09ca-ed37-4b4a-8b8a-88616e612673 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:06.027629 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca09ca-ed37-4b4a-8b8a-88616e612673 admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:06.028329 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccca09ca-ed37-4b4a-8b8a-88616e612673 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:20:06.029907 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccca09ca-ed37-4b4a-8b8a-88616e612673 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:20:06.040217 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1260/2516] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:20:06.044091 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f4e358-8955-4884-8972-fef779bbb395 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:20:06.054060 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f4e358-8955-4884-8972-fef779bbb395 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:20:06.058629 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c28a3d-a7d5-48b8-bc88-971ffb55d048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:20:06.059264 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c28a3d-a7d5-48b8-bc88-971ffb55d048 admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:06.059544 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c28a3d-a7d5-48b8-bc88-971ffb55d048 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:06.059821 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c28a3d-a7d5-48b8-bc88-971ffb55d048 admin admin] PATH_INFO: `/v3/projects/e1a6cbb74cf448969bfc4be1031e2e29/users/e92840a52b1341ce96658f690089957b/roles/ea564961b1db4eb4a1d4d880964611b2` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:06.074608 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c28a3d-a7d5-48b8-bc88-971ffb55d048 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1a6cbb74cf448969bfc4be1031e2e29, user_id=e92840a52b1341ce96658f690089957b, role_id=ea564961b1db4eb4a1d4d880964611b2)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:20:06.077216 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c28a3d-a7d5-48b8-bc88-971ffb55d048 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:20:06.090789 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1257/2517] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:20:06 2022] PUT /identity/v3/projects/e1a6cbb74cf448969bfc4be1031e2e29/users/e92840a52b1341ce96658f690089957b/roles/ea564961b1db4eb4a1d4d880964611b2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:20:06.094632 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca09ca-ed37-4b4a-8b8a-88616e612673 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:20:06.104648 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca09ca-ed37-4b4a-8b8a-88616e612673 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:20:06.162971 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bf0593-8ff7-4e5e-9a2e-ce06c5d3ac63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:20:06.163582 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf0593-8ff7-4e5e-9a2e-ce06c5d3ac63 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:06.163863 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf0593-8ff7-4e5e-9a2e-ce06c5d3ac63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:06.164137 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf0593-8ff7-4e5e-9a2e-ce06c5d3ac63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:06.164777 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bf0593-8ff7-4e5e-9a2e-ce06c5d3ac63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:20:06.166441 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bf0593-8ff7-4e5e-9a2e-ce06c5d3ac63 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:20:06.176391 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1261/2518] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:20:06.180564 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c28a3d-a7d5-48b8-bc88-971ffb55d048 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:20:06.191488 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c28a3d-a7d5-48b8-bc88-971ffb55d048 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:20:06.196104 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b528a346-4613-4bd4-abed-6ac2cdfc04e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:20:06.196757 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528a346-4613-4bd4-abed-6ac2cdfc04e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:06.197035 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528a346-4613-4bd4-abed-6ac2cdfc04e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:06.197312 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528a346-4613-4bd4-abed-6ac2cdfc04e6 admin admin] PATH_INFO: `/v3/projects/e1a6cbb74cf448969bfc4be1031e2e29/users/e92840a52b1341ce96658f690089957b/roles/ea564961b1db4eb4a1d4d880964611b2` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:06.199283 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b528a346-4613-4bd4-abed-6ac2cdfc04e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1a6cbb74cf448969bfc4be1031e2e29, user_id=e92840a52b1341ce96658f690089957b, role_id=ea564961b1db4eb4a1d4d880964611b2)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:20:06.201883 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b528a346-4613-4bd4-abed-6ac2cdfc04e6 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:20:06.212120 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1258/2519] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:20:06 2022] PUT /identity/v3/projects/e1a6cbb74cf448969bfc4be1031e2e29/users/e92840a52b1341ce96658f690089957b/roles/ea564961b1db4eb4a1d4d880964611b2 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:20:06.222246 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34376be-1cf7-4ed5-866f-812ce75929e2 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:06.222717 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34376be-1cf7-4ed5-866f-812ce75929e2 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:06.222835 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34376be-1cf7-4ed5-866f-812ce75929e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:06.250147 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-f34376be-1cf7-4ed5-866f-812ce75929e2 None None] MFA Rules not processed for user `e92840a52b1341ce96658f690089957b`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:20:06.251367 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-f34376be-1cf7-4ed5-866f-812ce75929e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:20:06.320082 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1262/2520] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:20:06 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:20:06.330886 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b528a346-4613-4bd4-abed-6ac2cdfc04e6 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:20:06.332590 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-b528a346-4613-4bd4-abed-6ac2cdfc04e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:20:06.390184 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b528a346-4613-4bd4-abed-6ac2cdfc04e6 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:20:06.393715 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110a1480-a5ee-4e91-b8e3-0decb29de37e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f4c2fc51f54f0e977648b13efaed1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:20:06.394325 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a1480-a5ee-4e91-b8e3-0decb29de37e service cinder] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:06.394601 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a1480-a5ee-4e91-b8e3-0decb29de37e service cinder] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:06.394868 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a1480-a5ee-4e91-b8e3-0decb29de37e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:06.403494 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110a1480-a5ee-4e91-b8e3-0decb29de37e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:20:06.404898 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110a1480-a5ee-4e91-b8e3-0decb29de37e service cinder] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:20:06.414073 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1259/2521] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:20:06 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:20:06.489225 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34376be-1cf7-4ed5-866f-812ce75929e2 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:20:06.498753 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34376be-1cf7-4ed5-866f-812ce75929e2 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:20:06.502902 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaef243-b05b-406d-bcb0-1c2ec75985bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f4c2fc51f54f0e977648b13efaed1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:20:06.503514 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaef243-b05b-406d-bcb0-1c2ec75985bf service cinder] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:06.504043 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaef243-b05b-406d-bcb0-1c2ec75985bf service cinder] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:06.504316 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaef243-b05b-406d-bcb0-1c2ec75985bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:06.559985 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaef243-b05b-406d-bcb0-1c2ec75985bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:20:06.561390 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaef243-b05b-406d-bcb0-1c2ec75985bf service cinder] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:20:06.569948 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1263/2522] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:20:06 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:20:10.605934 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110a1480-a5ee-4e91-b8e3-0decb29de37e service cinder] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:20:10.650465 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:20:10.668682 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110a1480-a5ee-4e91-b8e3-0decb29de37e service cinder] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:20:10.673122 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df3ca5-cf94-4b30-bd8d-36cc585ac14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:20:10.673744 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df3ca5-cf94-4b30-bd8d-36cc585ac14f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:10.674044 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df3ca5-cf94-4b30-bd8d-36cc585ac14f admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:10.674318 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df3ca5-cf94-4b30-bd8d-36cc585ac14f admin admin] PATH_INFO: `/v3/users/dbcfadd138d74dada96669484bedacc4` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:10.675914 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4df3ca5-cf94-4b30-bd8d-36cc585ac14f admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbcfadd138d74dada96669484bedacc4)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:20:10.677847 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4df3ca5-cf94-4b30-bd8d-36cc585ac14f admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:20:10.721711 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-f4df3ca5-cf94-4b30-bd8d-36cc585ac14f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbcfadd138d74dada96669484bedacc4'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:20:10.722310 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-f4df3ca5-cf94-4b30-bd8d-36cc585ac14f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbcfadd138d74dada96669484bedacc4'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:20:10.722913 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-f4df3ca5-cf94-4b30-bd8d-36cc585ac14f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbcfadd138d74dada96669484bedacc4'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:20:10.734771 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-f4df3ca5-cf94-4b30-bd8d-36cc585ac14f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbcfadd138d74dada96669484bedacc4'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:20:10.742239 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-f4df3ca5-cf94-4b30-bd8d-36cc585ac14f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbcfadd138d74dada96669484bedacc4'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:20:10.755117 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1260/2523] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:20:10 2022] DELETE /identity/v3/users/dbcfadd138d74dada96669484bedacc4 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:20:10.759508 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ad3f5-95a9-4558-b58d-00cf2f9027d3 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:10.759988 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ad3f5-95a9-4558-b58d-00cf2f9027d3 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:10.760094 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ad3f5-95a9-4558-b58d-00cf2f9027d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:10.767839 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=100 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:20:10.778989 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-810ad3f5-95a9-4558-b58d-00cf2f9027d3 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:20:10.780193 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-810ad3f5-95a9-4558-b58d-00cf2f9027d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:20:10.839158 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1264/2524] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:20:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:20:10.848729 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df3ca5-cf94-4b30-bd8d-36cc585ac14f admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:20:10.850330 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-f4df3ca5-cf94-4b30-bd8d-36cc585ac14f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:20:10.907679 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df3ca5-cf94-4b30-bd8d-36cc585ac14f admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:20:10.911267 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f086a6f-ddb1-48aa-856a-07849359d5e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:20:10.911870 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f086a6f-ddb1-48aa-856a-07849359d5e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:10.912149 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f086a6f-ddb1-48aa-856a-07849359d5e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:10.912421 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f086a6f-ddb1-48aa-856a-07849359d5e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:10.921124 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f086a6f-ddb1-48aa-856a-07849359d5e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:20:10.922574 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f086a6f-ddb1-48aa-856a-07849359d5e8 service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:20:10.932302 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1261/2525] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:20:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:20:11.197298 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810ad3f5-95a9-4558-b58d-00cf2f9027d3 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:20:11.198810 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-810ad3f5-95a9-4558-b58d-00cf2f9027d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:20:11.211193 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810ad3f5-95a9-4558-b58d-00cf2f9027d3 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:20:11.216126 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1902cd07-3dbb-4c75-9f50-baf2dcf91099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:20:11.216754 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1902cd07-3dbb-4c75-9f50-baf2dcf91099 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:11.217032 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1902cd07-3dbb-4c75-9f50-baf2dcf91099 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:11.217302 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1902cd07-3dbb-4c75-9f50-baf2dcf91099 admin admin] PATH_INFO: `/v3/projects/fed1d26023774b12bf14641e2525e348` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:11.218516 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1902cd07-3dbb-4c75-9f50-baf2dcf91099 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fed1d26023774b12bf14641e2525e348)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:20:11.220660 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1902cd07-3dbb-4c75-9f50-baf2dcf91099 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:20:11.267492 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-1902cd07-3dbb-4c75-9f50-baf2dcf91099 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fed1d26023774b12bf14641e2525e348', 'request_id': 'req-1902cd07-3dbb-4c75-9f50-baf2dcf91099'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:20:11.273602 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-1902cd07-3dbb-4c75-9f50-baf2dcf91099 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fed1d26023774b12bf14641e2525e348', 'request_id': 'req-1902cd07-3dbb-4c75-9f50-baf2dcf91099'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:20:11.278924 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-1902cd07-3dbb-4c75-9f50-baf2dcf91099 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fed1d26023774b12bf14641e2525e348', 'request_id': 'req-1902cd07-3dbb-4c75-9f50-baf2dcf91099'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:20:11.292273 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-1902cd07-3dbb-4c75-9f50-baf2dcf91099 admin admin] The token cache is being invalidate because project fed1d26023774b12bf14641e2525e348 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:20:11.292565 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-1902cd07-3dbb-4c75-9f50-baf2dcf91099 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:20:11.293185 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-1902cd07-3dbb-4c75-9f50-baf2dcf91099 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:20:11.294737 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1265/2526] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:20:11 2022] DELETE /identity/v3/projects/fed1d26023774b12bf14641e2525e348 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:20:11.298744 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f086a6f-ddb1-48aa-856a-07849359d5e8 service neutron] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:20:11.309320 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f086a6f-ddb1-48aa-856a-07849359d5e8 service neutron] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:20:11.364377 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c439f0-5458-410c-bc02-24d7c2f87ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:20:11.364990 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c439f0-5458-410c-bc02-24d7c2f87ed3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:11.365264 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c439f0-5458-410c-bc02-24d7c2f87ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:11.365534 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c439f0-5458-410c-bc02-24d7c2f87ed3 admin admin] PATH_INFO: `/v3/users/e92840a52b1341ce96658f690089957b` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:11.366670 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c439f0-5458-410c-bc02-24d7c2f87ed3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e92840a52b1341ce96658f690089957b)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:20:11.368556 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c439f0-5458-410c-bc02-24d7c2f87ed3 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:20:11.372900 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:20:11.416160 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-62c439f0-5458-410c-bc02-24d7c2f87ed3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e92840a52b1341ce96658f690089957b'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:20:11.416802 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-62c439f0-5458-410c-bc02-24d7c2f87ed3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e92840a52b1341ce96658f690089957b'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:20:11.417420 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-62c439f0-5458-410c-bc02-24d7c2f87ed3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e92840a52b1341ce96658f690089957b'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:20:11.429059 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-62c439f0-5458-410c-bc02-24d7c2f87ed3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e92840a52b1341ce96658f690089957b'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:20:11.436031 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-62c439f0-5458-410c-bc02-24d7c2f87ed3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e92840a52b1341ce96658f690089957b'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:20:11.447593 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1262/2527] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:20:11 2022] DELETE /identity/v3/users/e92840a52b1341ce96658f690089957b => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:20:11.715255 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1902cd07-3dbb-4c75-9f50-baf2dcf91099 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:20:11.716793 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-1902cd07-3dbb-4c75-9f50-baf2dcf91099 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:20:11.730553 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1902cd07-3dbb-4c75-9f50-baf2dcf91099 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:20:11.787105 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd43ad6-48b6-4d56-944e-a7495828e5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:20:11.787769 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd43ad6-48b6-4d56-944e-a7495828e5b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:11.788001 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd43ad6-48b6-4d56-944e-a7495828e5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:11.788273 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd43ad6-48b6-4d56-944e-a7495828e5b4 admin admin] PATH_INFO: `/v3/projects/e1a6cbb74cf448969bfc4be1031e2e29` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:11.789383 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd43ad6-48b6-4d56-944e-a7495828e5b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1a6cbb74cf448969bfc4be1031e2e29)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:20:11.791493 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd43ad6-48b6-4d56-944e-a7495828e5b4 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:20:11.825040 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:20:11.839784 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-ffd43ad6-48b6-4d56-944e-a7495828e5b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1a6cbb74cf448969bfc4be1031e2e29', 'request_id': 'req-ffd43ad6-48b6-4d56-944e-a7495828e5b4'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:20:11.845876 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-ffd43ad6-48b6-4d56-944e-a7495828e5b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1a6cbb74cf448969bfc4be1031e2e29', 'request_id': 'req-ffd43ad6-48b6-4d56-944e-a7495828e5b4'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:20:11.851892 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-ffd43ad6-48b6-4d56-944e-a7495828e5b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1a6cbb74cf448969bfc4be1031e2e29', 'request_id': 'req-ffd43ad6-48b6-4d56-944e-a7495828e5b4'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:20:11.864417 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-ffd43ad6-48b6-4d56-944e-a7495828e5b4 admin admin] The token cache is being invalidate because project e1a6cbb74cf448969bfc4be1031e2e29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:20:11.864692 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-ffd43ad6-48b6-4d56-944e-a7495828e5b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:20:11.865304 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-ffd43ad6-48b6-4d56-944e-a7495828e5b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:20:11.866787 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1266/2528] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:20:11 2022] DELETE /identity/v3/projects/e1a6cbb74cf448969bfc4be1031e2e29 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:20:11.871610 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5143eb-bf87-4d8b-bee9-b3cb1425ad0d None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:11.872114 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5143eb-bf87-4d8b-bee9-b3cb1425ad0d None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:11.872229 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5143eb-bf87-4d8b-bee9-b3cb1425ad0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:11.891554 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-cb5143eb-bf87-4d8b-bee9-b3cb1425ad0d None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:20:11.892748 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-cb5143eb-bf87-4d8b-bee9-b3cb1425ad0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:20:11.949525 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1263/2529] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:20:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:20:11.958027 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79cf00f-530e-4bb0-9a11-8a738a439b94 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:11.958312 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79cf00f-530e-4bb0-9a11-8a738a439b94 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:11.958582 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79cf00f-530e-4bb0-9a11-8a738a439b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:11.978119 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-d79cf00f-530e-4bb0-9a11-8a738a439b94 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:20:11.979303 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-d79cf00f-530e-4bb0-9a11-8a738a439b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:20:11.987620 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1267/2530] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:20:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:20:11.991554 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5143eb-bf87-4d8b-bee9-b3cb1425ad0d None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:20:12.000963 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5143eb-bf87-4d8b-bee9-b3cb1425ad0d None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:20:12.005673 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a707eff-f8ef-4a56-9680-1e96006042a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:20:12.006311 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a707eff-f8ef-4a56-9680-1e96006042a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:12.006584 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a707eff-f8ef-4a56-9680-1e96006042a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:12.006855 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a707eff-f8ef-4a56-9680-1e96006042a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:12.007489 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a707eff-f8ef-4a56-9680-1e96006042a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:20:12.007792 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a707eff-f8ef-4a56-9680-1e96006042a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:20:12.009359 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a707eff-f8ef-4a56-9680-1e96006042a7 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:20:12.020536 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1264/2531] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 11:20:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:20:12.024555 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79cf00f-530e-4bb0-9a11-8a738a439b94 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:20:12.033533 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79cf00f-530e-4bb0-9a11-8a738a439b94 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:20:12.038786 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb11663d-8a74-4553-9819-af832c75b40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:20:12.039392 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11663d-8a74-4553-9819-af832c75b40e admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:12.039674 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11663d-8a74-4553-9819-af832c75b40e admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:12.039944 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11663d-8a74-4553-9819-af832c75b40e admin admin] PATH_INFO: `/v3/projects` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:12.040573 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb11663d-8a74-4553-9819-af832c75b40e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:20:12.042481 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb11663d-8a74-4553-9819-af832c75b40e admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:20:12.078631 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1268/2532] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:20:12 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 11:20:12.082726 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a707eff-f8ef-4a56-9680-1e96006042a7 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:20:12.092346 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a707eff-f8ef-4a56-9680-1e96006042a7 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:20:12.148413 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4ef001-7667-4a35-8bac-3c60409b4e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:20:12.149004 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ef001-7667-4a35-8bac-3c60409b4e29 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:12.149280 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ef001-7667-4a35-8bac-3c60409b4e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:12.149549 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ef001-7667-4a35-8bac-3c60409b4e29 admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:12.150211 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4ef001-7667-4a35-8bac-3c60409b4e29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:20:12.152110 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4ef001-7667-4a35-8bac-3c60409b4e29 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:20:12.168873 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:20:12.177129 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1265/2533] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:20:12 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 11:20:12.178335 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb11663d-8a74-4553-9819-af832c75b40e admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:20:12.188327 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb11663d-8a74-4553-9819-af832c75b40e admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:20:12.192843 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76b8a38-bf6f-4cf7-ab79-04790fcb1aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:20:12.193431 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b8a38-bf6f-4cf7-ab79-04790fcb1aca admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:12.193703 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b8a38-bf6f-4cf7-ab79-04790fcb1aca admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:12.193997 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b8a38-bf6f-4cf7-ab79-04790fcb1aca admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:12.194638 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76b8a38-bf6f-4cf7-ab79-04790fcb1aca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:20:12.196209 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76b8a38-bf6f-4cf7-ab79-04790fcb1aca admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:20:12.206198 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1269/2534] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:20:12.209878 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4ef001-7667-4a35-8bac-3c60409b4e29 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:20:12.219478 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4ef001-7667-4a35-8bac-3c60409b4e29 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:20:12.224630 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8673bcf1-2c4d-460b-9254-9ec4124dd774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:20:12.225210 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8673bcf1-2c4d-460b-9254-9ec4124dd774 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:12.225480 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8673bcf1-2c4d-460b-9254-9ec4124dd774 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:12.225751 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8673bcf1-2c4d-460b-9254-9ec4124dd774 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:12.226408 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8673bcf1-2c4d-460b-9254-9ec4124dd774 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:20:12.227966 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8673bcf1-2c4d-460b-9254-9ec4124dd774 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:20:12.238180 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1266/2535] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 13 11:20:12.242157 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76b8a38-bf6f-4cf7-ab79-04790fcb1aca admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:20:12.251923 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76b8a38-bf6f-4cf7-ab79-04790fcb1aca admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:20:12.256765 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411258f0-8a9d-4b74-ae68-9adfc4b40fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:20:12.257400 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411258f0-8a9d-4b74-ae68-9adfc4b40fdc admin admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:12.257679 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411258f0-8a9d-4b74-ae68-9adfc4b40fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:12.257986 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411258f0-8a9d-4b74-ae68-9adfc4b40fdc admin admin] PATH_INFO: `/v3/projects/b1256cb4ff3c4da3af2dc207a8e3d111/users/106847447ce04ccf9b47ebbf0efae7ff/roles/7c3871c0ab68438b9014489d50b53a22` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:12.273638 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411258f0-8a9d-4b74-ae68-9adfc4b40fdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1256cb4ff3c4da3af2dc207a8e3d111, user_id=106847447ce04ccf9b47ebbf0efae7ff, role_id=7c3871c0ab68438b9014489d50b53a22)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:20:12.276279 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411258f0-8a9d-4b74-ae68-9adfc4b40fdc admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:20:12.293824 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1270/2536] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:20:12 2022] PUT /identity/v3/projects/b1256cb4ff3c4da3af2dc207a8e3d111/users/106847447ce04ccf9b47ebbf0efae7ff/roles/7c3871c0ab68438b9014489d50b53a22 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:20:12.356057 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d6c7e-5218-435e-9834-3b1fa6a5a6fc None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:12.356277 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d6c7e-5218-435e-9834-3b1fa6a5a6fc None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:12.356509 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d6c7e-5218-435e-9834-3b1fa6a5a6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:12.383651 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-428d6c7e-5218-435e-9834-3b1fa6a5a6fc None None] MFA Rules not processed for user `106847447ce04ccf9b47ebbf0efae7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:20:12.384855 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-428d6c7e-5218-435e-9834-3b1fa6a5a6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:20:12.447193 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1267/2537] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:20:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:20:12.451591 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411258f0-8a9d-4b74-ae68-9adfc4b40fdc admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:20:12.511323 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411258f0-8a9d-4b74-ae68-9adfc4b40fdc admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:20:12.515837 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8e9fe6-de4e-492d-9d01-f821c689884d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:20:12.516427 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e9fe6-de4e-492d-9d01-f821c689884d admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:12.516703 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e9fe6-de4e-492d-9d01-f821c689884d admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:12.516967 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e9fe6-de4e-492d-9d01-f821c689884d admin admin] PATH_INFO: `/v3/projects` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:12.517589 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8e9fe6-de4e-492d-9d01-f821c689884d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:20:12.520065 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8e9fe6-de4e-492d-9d01-f821c689884d admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:20:12.545199 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1271/2538] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:20:12 2022] POST /identity/v3/projects => generated 377 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:20:12.549190 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428d6c7e-5218-435e-9834-3b1fa6a5a6fc None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:20:12.559736 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428d6c7e-5218-435e-9834-3b1fa6a5a6fc None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:20:12.614345 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca6295f-646a-4a8a-82ca-fea67e254f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:20:12.614898 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6295f-646a-4a8a-82ca-fea67e254f96 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:12.615436 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6295f-646a-4a8a-82ca-fea67e254f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:12.615895 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6295f-646a-4a8a-82ca-fea67e254f96 admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:12.616529 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca6295f-646a-4a8a-82ca-fea67e254f96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:20:12.618453 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca6295f-646a-4a8a-82ca-fea67e254f96 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:20:12.639160 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1268/2539] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:20:12 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 11:20:12.643113 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8e9fe6-de4e-492d-9d01-f821c689884d admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:20:12.654851 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8e9fe6-de4e-492d-9d01-f821c689884d admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:20:12.659606 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1b3474-1219-49ec-aabc-b51b6375dffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:20:12.660202 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b3474-1219-49ec-aabc-b51b6375dffb admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:12.660524 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b3474-1219-49ec-aabc-b51b6375dffb admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:12.660899 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b3474-1219-49ec-aabc-b51b6375dffb admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:12.661552 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1b3474-1219-49ec-aabc-b51b6375dffb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:20:12.663174 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1b3474-1219-49ec-aabc-b51b6375dffb admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:20:12.673564 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1272/2540] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:20:12.677321 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca6295f-646a-4a8a-82ca-fea67e254f96 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:20:12.687082 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca6295f-646a-4a8a-82ca-fea67e254f96 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:20:12.692065 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747a2e39-e617-4799-982f-3fe0c437a9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:20:12.692667 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a2e39-e617-4799-982f-3fe0c437a9d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:12.692941 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a2e39-e617-4799-982f-3fe0c437a9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:12.693208 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a2e39-e617-4799-982f-3fe0c437a9d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:12.693836 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747a2e39-e617-4799-982f-3fe0c437a9d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:20:12.695476 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747a2e39-e617-4799-982f-3fe0c437a9d7 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:20:12.704974 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1269/2541] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:20:12.709581 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1b3474-1219-49ec-aabc-b51b6375dffb admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:20:12.719256 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1b3474-1219-49ec-aabc-b51b6375dffb admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:20:12.723986 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccc174e-6fb3-4cbf-a050-ff979ae007a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:20:12.724616 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc174e-6fb3-4cbf-a050-ff979ae007a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:12.724891 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc174e-6fb3-4cbf-a050-ff979ae007a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:12.725161 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc174e-6fb3-4cbf-a050-ff979ae007a7 admin admin] PATH_INFO: `/v3/projects/dbe126aaa84a466298ccf4274792d6a5/users/51d68b4503f74c7989f13f503f90254e/roles/7c3871c0ab68438b9014489d50b53a22` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:12.739420 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccc174e-6fb3-4cbf-a050-ff979ae007a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbe126aaa84a466298ccf4274792d6a5, user_id=51d68b4503f74c7989f13f503f90254e, role_id=7c3871c0ab68438b9014489d50b53a22)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:20:12.742077 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccc174e-6fb3-4cbf-a050-ff979ae007a7 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:20:12.744950 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:20:12.757199 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1273/2542] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:20:12 2022] PUT /identity/v3/projects/dbe126aaa84a466298ccf4274792d6a5/users/51d68b4503f74c7989f13f503f90254e/roles/7c3871c0ab68438b9014489d50b53a22 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:20:12.767196 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f1045-199c-4280-bc17-ef7b5c5b6ccc None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:12.767481 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f1045-199c-4280-bc17-ef7b5c5b6ccc None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:12.767773 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f1045-199c-4280-bc17-ef7b5c5b6ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:12.796003 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-8b7f1045-199c-4280-bc17-ef7b5c5b6ccc None None] MFA Rules not processed for user `51d68b4503f74c7989f13f503f90254e`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:20:12.797232 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-8b7f1045-199c-4280-bc17-ef7b5c5b6ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:20:12.840996 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:20:12.861218 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1270/2543] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:20:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:20:12.866432 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccc174e-6fb3-4cbf-a050-ff979ae007a7 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:20:12.928403 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccc174e-6fb3-4cbf-a050-ff979ae007a7 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:20:12.933084 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec936e3-5c24-4cd7-8fd6-9faf7d1f56d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:20:12.933685 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec936e3-5c24-4cd7-8fd6-9faf7d1f56d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:12.933987 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec936e3-5c24-4cd7-8fd6-9faf7d1f56d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:12.934267 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec936e3-5c24-4cd7-8fd6-9faf7d1f56d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:12.934906 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec936e3-5c24-4cd7-8fd6-9faf7d1f56d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:20:12.936807 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec936e3-5c24-4cd7-8fd6-9faf7d1f56d1 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:20:12.962806 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1274/2544] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:20:12 2022] POST /identity/v3/projects => generated 377 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:20:12.967093 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7f1045-199c-4280-bc17-ef7b5c5b6ccc None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:20:12.977653 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7f1045-199c-4280-bc17-ef7b5c5b6ccc None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:20:13.032493 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d21829f-3e75-46b0-b398-8727e933d12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:20:13.033083 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d21829f-3e75-46b0-b398-8727e933d12a admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:13.033365 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d21829f-3e75-46b0-b398-8727e933d12a admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:13.033633 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d21829f-3e75-46b0-b398-8727e933d12a admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:13.034318 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d21829f-3e75-46b0-b398-8727e933d12a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:20:13.036324 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d21829f-3e75-46b0-b398-8727e933d12a admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:20:13.057150 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1271/2545] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:20:12 2022] POST /identity/v3/users => generated 295 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 11:20:13.061257 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec936e3-5c24-4cd7-8fd6-9faf7d1f56d1 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:20:13.072183 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec936e3-5c24-4cd7-8fd6-9faf7d1f56d1 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:20:13.076783 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed45dc9f-af90-4181-95e5-7a6476fd5982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:20:13.077371 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed45dc9f-af90-4181-95e5-7a6476fd5982 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:13.077651 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed45dc9f-af90-4181-95e5-7a6476fd5982 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:13.077926 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed45dc9f-af90-4181-95e5-7a6476fd5982 admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:13.078595 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed45dc9f-af90-4181-95e5-7a6476fd5982 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:20:13.080165 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed45dc9f-af90-4181-95e5-7a6476fd5982 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:20:13.090585 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1275/2546] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:20:13.094456 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d21829f-3e75-46b0-b398-8727e933d12a admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:20:13.104122 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d21829f-3e75-46b0-b398-8727e933d12a admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:20:13.108702 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e896a2a-57bd-4aba-a29e-2f14f6dd0cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:20:13.109330 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e896a2a-57bd-4aba-a29e-2f14f6dd0cbd admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:13.109605 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e896a2a-57bd-4aba-a29e-2f14f6dd0cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:13.109878 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e896a2a-57bd-4aba-a29e-2f14f6dd0cbd admin admin] PATH_INFO: `/v3/projects/7b31a28533b34044be66520dcac769b3/users/ceb7da2ad41d4e6cb146ec6bb1529ecd/roles/ea564961b1db4eb4a1d4d880964611b2` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:13.125121 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e896a2a-57bd-4aba-a29e-2f14f6dd0cbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b31a28533b34044be66520dcac769b3, user_id=ceb7da2ad41d4e6cb146ec6bb1529ecd, role_id=ea564961b1db4eb4a1d4d880964611b2)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:20:13.128316 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e896a2a-57bd-4aba-a29e-2f14f6dd0cbd admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:20:13.140871 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1272/2547] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:20:13 2022] PUT /identity/v3/projects/7b31a28533b34044be66520dcac769b3/users/ceb7da2ad41d4e6cb146ec6bb1529ecd/roles/ea564961b1db4eb4a1d4d880964611b2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:20:13.144730 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed45dc9f-af90-4181-95e5-7a6476fd5982 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:20:13.154655 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed45dc9f-af90-4181-95e5-7a6476fd5982 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:20:13.208949 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be118ff4-9129-44e8-9f9b-3c905fecd900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:20:13.209543 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be118ff4-9129-44e8-9f9b-3c905fecd900 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:13.209819 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be118ff4-9129-44e8-9f9b-3c905fecd900 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:13.210124 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be118ff4-9129-44e8-9f9b-3c905fecd900 admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:13.210769 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be118ff4-9129-44e8-9f9b-3c905fecd900 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:20:13.212417 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be118ff4-9129-44e8-9f9b-3c905fecd900 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:20:13.221828 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1276/2548] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:20:13.225831 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e896a2a-57bd-4aba-a29e-2f14f6dd0cbd admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:20:13.236301 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e896a2a-57bd-4aba-a29e-2f14f6dd0cbd admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:20:13.241448 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cdd985-d539-4dc1-9aa2-56510707d68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:20:13.242120 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cdd985-d539-4dc1-9aa2-56510707d68a admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:13.242401 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cdd985-d539-4dc1-9aa2-56510707d68a admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:13.242678 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cdd985-d539-4dc1-9aa2-56510707d68a admin admin] PATH_INFO: `/v3/projects/7b31a28533b34044be66520dcac769b3/users/ceb7da2ad41d4e6cb146ec6bb1529ecd/roles/ea564961b1db4eb4a1d4d880964611b2` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:13.244589 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cdd985-d539-4dc1-9aa2-56510707d68a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b31a28533b34044be66520dcac769b3, user_id=ceb7da2ad41d4e6cb146ec6bb1529ecd, role_id=ea564961b1db4eb4a1d4d880964611b2)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:20:13.247273 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cdd985-d539-4dc1-9aa2-56510707d68a admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:20:13.257906 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1273/2549] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:20:13 2022] PUT /identity/v3/projects/7b31a28533b34044be66520dcac769b3/users/ceb7da2ad41d4e6cb146ec6bb1529ecd/roles/ea564961b1db4eb4a1d4d880964611b2 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:20:13.268955 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b28a01-ec63-4f94-bd74-1a593ab11354 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:13.269266 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b28a01-ec63-4f94-bd74-1a593ab11354 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:13.269540 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b28a01-ec63-4f94-bd74-1a593ab11354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:13.296693 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-f2b28a01-ec63-4f94-bd74-1a593ab11354 None None] MFA Rules not processed for user `ceb7da2ad41d4e6cb146ec6bb1529ecd`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:20:13.297908 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-f2b28a01-ec63-4f94-bd74-1a593ab11354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:20:13.347081 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:20:13.365104 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1277/2550] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:20:13 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:20:13.376068 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cdd985-d539-4dc1-9aa2-56510707d68a admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:20:13.377774 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-b7cdd985-d539-4dc1-9aa2-56510707d68a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:20:13.434704 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cdd985-d539-4dc1-9aa2-56510707d68a admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:20:13.438350 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2acbc4b-c2c3-44e2-acb9-121bd76fc45a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f4c2fc51f54f0e977648b13efaed1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:20:13.438953 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2acbc4b-c2c3-44e2-acb9-121bd76fc45a service cinder] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:13.439230 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2acbc4b-c2c3-44e2-acb9-121bd76fc45a service cinder] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:13.439501 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2acbc4b-c2c3-44e2-acb9-121bd76fc45a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:13.448495 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2acbc4b-c2c3-44e2-acb9-121bd76fc45a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:20:13.449915 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2acbc4b-c2c3-44e2-acb9-121bd76fc45a service cinder] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:20:13.459458 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1274/2551] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:20:13 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:20:13.501844 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b28a01-ec63-4f94-bd74-1a593ab11354 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:20:13.503312 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-f2b28a01-ec63-4f94-bd74-1a593ab11354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:20:13.515991 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b28a01-ec63-4f94-bd74-1a593ab11354 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:20:13.519890 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a780b30f-0246-4bbf-9e6b-8dbfff2c0171 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f4c2fc51f54f0e977648b13efaed1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:20:13.520512 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780b30f-0246-4bbf-9e6b-8dbfff2c0171 service cinder] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:13.520792 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780b30f-0246-4bbf-9e6b-8dbfff2c0171 service cinder] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:13.521070 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780b30f-0246-4bbf-9e6b-8dbfff2c0171 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:13.583115 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a780b30f-0246-4bbf-9e6b-8dbfff2c0171 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:20:13.584584 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a780b30f-0246-4bbf-9e6b-8dbfff2c0171 service cinder] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:20:13.594757 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1278/2552] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:20:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:20:16.457852 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2acbc4b-c2c3-44e2-acb9-121bd76fc45a service cinder] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:20:16.500062 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:20:16.519441 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2acbc4b-c2c3-44e2-acb9-121bd76fc45a service cinder] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:20:16.523868 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea706d1-147f-4d16-9c97-0076f451a296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:20:16.524482 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea706d1-147f-4d16-9c97-0076f451a296 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:16.524758 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea706d1-147f-4d16-9c97-0076f451a296 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:16.525027 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea706d1-147f-4d16-9c97-0076f451a296 admin admin] PATH_INFO: `/v3/users/106847447ce04ccf9b47ebbf0efae7ff` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:16.526167 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea706d1-147f-4d16-9c97-0076f451a296 admin admin] RBAC: Authorizing `identity:delete_user(user_id=106847447ce04ccf9b47ebbf0efae7ff)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:20:16.528318 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea706d1-147f-4d16-9c97-0076f451a296 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:20:16.572332 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-fea706d1-147f-4d16-9c97-0076f451a296 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '106847447ce04ccf9b47ebbf0efae7ff'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:20:16.572960 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-fea706d1-147f-4d16-9c97-0076f451a296 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '106847447ce04ccf9b47ebbf0efae7ff'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:20:16.573554 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-fea706d1-147f-4d16-9c97-0076f451a296 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '106847447ce04ccf9b47ebbf0efae7ff'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:20:16.586518 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-fea706d1-147f-4d16-9c97-0076f451a296 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '106847447ce04ccf9b47ebbf0efae7ff'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:20:16.593786 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-fea706d1-147f-4d16-9c97-0076f451a296 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '106847447ce04ccf9b47ebbf0efae7ff'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:20:16.605632 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1275/2553] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:20:16 2022] DELETE /identity/v3/users/106847447ce04ccf9b47ebbf0efae7ff => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:20:16.610003 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640c46a-442b-4b45-91b0-651771b74369 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:16.610469 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640c46a-442b-4b45-91b0-651771b74369 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:16.610667 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640c46a-442b-4b45-91b0-651771b74369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:16.630749 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-2640c46a-442b-4b45-91b0-651771b74369 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:20:16.631955 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-2640c46a-442b-4b45-91b0-651771b74369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:20:16.691242 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1279/2554] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:20:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 11:20:16.700754 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea706d1-147f-4d16-9c97-0076f451a296 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:20:16.702178 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-fea706d1-147f-4d16-9c97-0076f451a296 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:20:16.758839 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea706d1-147f-4d16-9c97-0076f451a296 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:20:16.762457 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d002027-e4b1-4636-ad33-2099d621bfe4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:20:16.763060 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d002027-e4b1-4636-ad33-2099d621bfe4 service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:16.763340 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d002027-e4b1-4636-ad33-2099d621bfe4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:16.763624 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d002027-e4b1-4636-ad33-2099d621bfe4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:16.772550 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d002027-e4b1-4636-ad33-2099d621bfe4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:20:16.774032 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d002027-e4b1-4636-ad33-2099d621bfe4 service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:20:16.783323 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1276/2555] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:20:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:20:17.048558 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2640c46a-442b-4b45-91b0-651771b74369 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:20:17.050522 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-2640c46a-442b-4b45-91b0-651771b74369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:20:17.062417 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2640c46a-442b-4b45-91b0-651771b74369 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:20:17.066999 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d029aeb3-757e-4ef3-99e1-f85715df52f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:20:17.067626 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029aeb3-757e-4ef3-99e1-f85715df52f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:17.067909 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029aeb3-757e-4ef3-99e1-f85715df52f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:17.068182 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029aeb3-757e-4ef3-99e1-f85715df52f9 admin admin] PATH_INFO: `/v3/projects/b1256cb4ff3c4da3af2dc207a8e3d111` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:17.069349 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d029aeb3-757e-4ef3-99e1-f85715df52f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1256cb4ff3c4da3af2dc207a8e3d111)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:20:17.071276 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d029aeb3-757e-4ef3-99e1-f85715df52f9 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:20:17.117812 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-d029aeb3-757e-4ef3-99e1-f85715df52f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1256cb4ff3c4da3af2dc207a8e3d111', 'request_id': 'req-d029aeb3-757e-4ef3-99e1-f85715df52f9'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:20:17.124115 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-d029aeb3-757e-4ef3-99e1-f85715df52f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1256cb4ff3c4da3af2dc207a8e3d111', 'request_id': 'req-d029aeb3-757e-4ef3-99e1-f85715df52f9'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:20:17.129727 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-d029aeb3-757e-4ef3-99e1-f85715df52f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1256cb4ff3c4da3af2dc207a8e3d111', 'request_id': 'req-d029aeb3-757e-4ef3-99e1-f85715df52f9'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:20:17.142193 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-d029aeb3-757e-4ef3-99e1-f85715df52f9 admin admin] The token cache is being invalidate because project b1256cb4ff3c4da3af2dc207a8e3d111 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:20:17.142466 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-d029aeb3-757e-4ef3-99e1-f85715df52f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:20:17.143101 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-d029aeb3-757e-4ef3-99e1-f85715df52f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:20:17.144585 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1280/2556] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:20:17 2022] DELETE /identity/v3/projects/b1256cb4ff3c4da3af2dc207a8e3d111 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:20:17.148618 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d002027-e4b1-4636-ad33-2099d621bfe4 service neutron] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:20:17.158422 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d002027-e4b1-4636-ad33-2099d621bfe4 service neutron] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:20:17.213444 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6fecd0-8e69-494f-96f2-2e63e5c1b043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:20:17.214088 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6fecd0-8e69-494f-96f2-2e63e5c1b043 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:17.214366 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6fecd0-8e69-494f-96f2-2e63e5c1b043 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:17.214637 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6fecd0-8e69-494f-96f2-2e63e5c1b043 admin admin] PATH_INFO: `/v3/users/51d68b4503f74c7989f13f503f90254e` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:17.215768 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6fecd0-8e69-494f-96f2-2e63e5c1b043 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51d68b4503f74c7989f13f503f90254e)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:20:17.217656 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6fecd0-8e69-494f-96f2-2e63e5c1b043 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:20:17.222778 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:20:17.265863 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-fc6fecd0-8e69-494f-96f2-2e63e5c1b043 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51d68b4503f74c7989f13f503f90254e'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:20:17.266530 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-fc6fecd0-8e69-494f-96f2-2e63e5c1b043 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51d68b4503f74c7989f13f503f90254e'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:20:17.267120 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-fc6fecd0-8e69-494f-96f2-2e63e5c1b043 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51d68b4503f74c7989f13f503f90254e'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:20:17.278739 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-fc6fecd0-8e69-494f-96f2-2e63e5c1b043 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51d68b4503f74c7989f13f503f90254e'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:20:17.286273 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-fc6fecd0-8e69-494f-96f2-2e63e5c1b043 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51d68b4503f74c7989f13f503f90254e'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:20:17.297985 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1277/2557] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:20:17 2022] DELETE /identity/v3/users/51d68b4503f74c7989f13f503f90254e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:20:17.563180 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d029aeb3-757e-4ef3-99e1-f85715df52f9 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:20:17.564676 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-d029aeb3-757e-4ef3-99e1-f85715df52f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:20:17.581510 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d029aeb3-757e-4ef3-99e1-f85715df52f9 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:20:17.590592 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:20:17.639280 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c69306-c33d-4da1-8c9f-5146f7fb0354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:20:17.639942 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c69306-c33d-4da1-8c9f-5146f7fb0354 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:17.640166 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c69306-c33d-4da1-8c9f-5146f7fb0354 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:17.640432 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c69306-c33d-4da1-8c9f-5146f7fb0354 admin admin] PATH_INFO: `/v3/projects/dbe126aaa84a466298ccf4274792d6a5` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:17.641549 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c69306-c33d-4da1-8c9f-5146f7fb0354 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbe126aaa84a466298ccf4274792d6a5)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:20:17.643947 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c69306-c33d-4da1-8c9f-5146f7fb0354 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:20:17.688920 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-31c69306-c33d-4da1-8c9f-5146f7fb0354 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbe126aaa84a466298ccf4274792d6a5', 'request_id': 'req-31c69306-c33d-4da1-8c9f-5146f7fb0354'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:20:17.694864 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-31c69306-c33d-4da1-8c9f-5146f7fb0354 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbe126aaa84a466298ccf4274792d6a5', 'request_id': 'req-31c69306-c33d-4da1-8c9f-5146f7fb0354'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:20:17.700147 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-31c69306-c33d-4da1-8c9f-5146f7fb0354 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbe126aaa84a466298ccf4274792d6a5', 'request_id': 'req-31c69306-c33d-4da1-8c9f-5146f7fb0354'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:20:17.712180 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-31c69306-c33d-4da1-8c9f-5146f7fb0354 admin admin] The token cache is being invalidate because project dbe126aaa84a466298ccf4274792d6a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:20:17.712465 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-31c69306-c33d-4da1-8c9f-5146f7fb0354 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:20:17.713104 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-31c69306-c33d-4da1-8c9f-5146f7fb0354 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:20:17.714579 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1281/2558] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:20:17 2022] DELETE /identity/v3/projects/dbe126aaa84a466298ccf4274792d6a5 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:20:17.718658 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6fecd0-8e69-494f-96f2-2e63e5c1b043 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:20:17.720067 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-fc6fecd0-8e69-494f-96f2-2e63e5c1b043 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:20:17.733175 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6fecd0-8e69-494f-96f2-2e63e5c1b043 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:20:17.787392 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8e2ad8-9e3f-4e9d-8592-e243f1095aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:20:17.788014 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e2ad8-9e3f-4e9d-8592-e243f1095aea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:17.788290 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e2ad8-9e3f-4e9d-8592-e243f1095aea admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:17.788563 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e2ad8-9e3f-4e9d-8592-e243f1095aea admin admin] PATH_INFO: `/v3/users/ceb7da2ad41d4e6cb146ec6bb1529ecd` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:17.789694 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8e2ad8-9e3f-4e9d-8592-e243f1095aea admin admin] RBAC: Authorizing `identity:delete_user(user_id=ceb7da2ad41d4e6cb146ec6bb1529ecd)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:20:17.791634 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8e2ad8-9e3f-4e9d-8592-e243f1095aea admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:20:17.837074 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-bb8e2ad8-9e3f-4e9d-8592-e243f1095aea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ceb7da2ad41d4e6cb146ec6bb1529ecd'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:20:17.837712 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-bb8e2ad8-9e3f-4e9d-8592-e243f1095aea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ceb7da2ad41d4e6cb146ec6bb1529ecd'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:20:17.838335 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-bb8e2ad8-9e3f-4e9d-8592-e243f1095aea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ceb7da2ad41d4e6cb146ec6bb1529ecd'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:20:17.850045 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-bb8e2ad8-9e3f-4e9d-8592-e243f1095aea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ceb7da2ad41d4e6cb146ec6bb1529ecd'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:20:17.858277 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-bb8e2ad8-9e3f-4e9d-8592-e243f1095aea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ceb7da2ad41d4e6cb146ec6bb1529ecd'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:20:17.870500 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1278/2559] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:20:17 2022] DELETE /identity/v3/users/ceb7da2ad41d4e6cb146ec6bb1529ecd => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:20:18.134941 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c69306-c33d-4da1-8c9f-5146f7fb0354 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:20:18.136363 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-31c69306-c33d-4da1-8c9f-5146f7fb0354 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:20:18.148748 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c69306-c33d-4da1-8c9f-5146f7fb0354 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:20:18.203583 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d514b5-b79e-40e6-b171-20b4c6b014c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:20:18.204206 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d514b5-b79e-40e6-b171-20b4c6b014c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:18.204479 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d514b5-b79e-40e6-b171-20b4c6b014c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:18.204748 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d514b5-b79e-40e6-b171-20b4c6b014c2 admin admin] PATH_INFO: `/v3/projects/7b31a28533b34044be66520dcac769b3` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:18.205878 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d514b5-b79e-40e6-b171-20b4c6b014c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b31a28533b34044be66520dcac769b3)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:20:18.207789 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d514b5-b79e-40e6-b171-20b4c6b014c2 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:20:18.248933 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:20:18.251990 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-a1d514b5-b79e-40e6-b171-20b4c6b014c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b31a28533b34044be66520dcac769b3', 'request_id': 'req-a1d514b5-b79e-40e6-b171-20b4c6b014c2'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:20:18.260230 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-a1d514b5-b79e-40e6-b171-20b4c6b014c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b31a28533b34044be66520dcac769b3', 'request_id': 'req-a1d514b5-b79e-40e6-b171-20b4c6b014c2'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:20:18.265650 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-a1d514b5-b79e-40e6-b171-20b4c6b014c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b31a28533b34044be66520dcac769b3', 'request_id': 'req-a1d514b5-b79e-40e6-b171-20b4c6b014c2'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:20:18.277251 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-a1d514b5-b79e-40e6-b171-20b4c6b014c2 admin admin] The token cache is being invalidate because project 7b31a28533b34044be66520dcac769b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:20:18.277532 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-a1d514b5-b79e-40e6-b171-20b4c6b014c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:20:18.278197 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-a1d514b5-b79e-40e6-b171-20b4c6b014c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:20:18.279642 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1282/2560] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:20:18 2022] DELETE /identity/v3/projects/7b31a28533b34044be66520dcac769b3 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:20:18.285704 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69706a95-01fa-471e-a76b-106e7995d837 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:18.286023 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69706a95-01fa-471e-a76b-106e7995d837 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:18.286302 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69706a95-01fa-471e-a76b-106e7995d837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:18.293896 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:20:18.308644 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-69706a95-01fa-471e-a76b-106e7995d837 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:20:18.310456 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-69706a95-01fa-471e-a76b-106e7995d837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:20:18.367625 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1279/2561] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:20:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:20:18.375853 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eafb741-b388-4838-9669-e5b148497083 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:18.376145 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eafb741-b388-4838-9669-e5b148497083 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:18.376418 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eafb741-b388-4838-9669-e5b148497083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:18.396606 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-0eafb741-b388-4838-9669-e5b148497083 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:20:18.397816 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-0eafb741-b388-4838-9669-e5b148497083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:20:18.405644 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1283/2562] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:20:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:20:18.409895 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69706a95-01fa-471e-a76b-106e7995d837 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:20:18.419690 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69706a95-01fa-471e-a76b-106e7995d837 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:20:18.424191 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532acff3-cbe5-460f-afa1-db422159c36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:20:18.425282 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532acff3-cbe5-460f-afa1-db422159c36f admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:18.425579 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532acff3-cbe5-460f-afa1-db422159c36f admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:18.425846 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532acff3-cbe5-460f-afa1-db422159c36f admin admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:18.426507 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532acff3-cbe5-460f-afa1-db422159c36f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:20:18.426807 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532acff3-cbe5-460f-afa1-db422159c36f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:20:18.428380 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532acff3-cbe5-460f-afa1-db422159c36f admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:20:18.439500 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1280/2563] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 11:20:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 11:20:18.444242 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eafb741-b388-4838-9669-e5b148497083 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:20:18.453324 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eafb741-b388-4838-9669-e5b148497083 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:20:18.457970 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5484c7-dc57-4c19-b350-999b3b129277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:20:18.458567 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5484c7-dc57-4c19-b350-999b3b129277 admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:18.458845 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5484c7-dc57-4c19-b350-999b3b129277 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:18.459115 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5484c7-dc57-4c19-b350-999b3b129277 admin admin] PATH_INFO: `/v3/projects` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:18.459739 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5484c7-dc57-4c19-b350-999b3b129277 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:20:18.461603 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5484c7-dc57-4c19-b350-999b3b129277 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:20:18.488493 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1284/2564] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:20:18 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:20:18.492959 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532acff3-cbe5-460f-afa1-db422159c36f admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:20:18.503703 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532acff3-cbe5-460f-afa1-db422159c36f admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:20:18.558300 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f89474-b5cb-4f96-ac15-186edd1f8a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:20:18.558895 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f89474-b5cb-4f96-ac15-186edd1f8a02 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:18.559175 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f89474-b5cb-4f96-ac15-186edd1f8a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:18.559450 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f89474-b5cb-4f96-ac15-186edd1f8a02 admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:18.560081 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f89474-b5cb-4f96-ac15-186edd1f8a02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:20:18.562000 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f89474-b5cb-4f96-ac15-186edd1f8a02 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:20:18.582383 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1281/2565] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:20:18 2022] POST /identity/v3/users => generated 286 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:20:18.586596 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5484c7-dc57-4c19-b350-999b3b129277 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:20:18.597185 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5484c7-dc57-4c19-b350-999b3b129277 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:20:18.604179 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a1631c-e53d-464f-838f-e1e4db8ac0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:20:18.604927 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a1631c-e53d-464f-838f-e1e4db8ac0e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:18.605234 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a1631c-e53d-464f-838f-e1e4db8ac0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:18.605542 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a1631c-e53d-464f-838f-e1e4db8ac0e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:18.606280 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a1631c-e53d-464f-838f-e1e4db8ac0e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:20:18.608059 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a1631c-e53d-464f-838f-e1e4db8ac0e0 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:20:18.619561 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1285/2566] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:20:18.623564 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f89474-b5cb-4f96-ac15-186edd1f8a02 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:20:18.633501 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f89474-b5cb-4f96-ac15-186edd1f8a02 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:20:18.637980 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d0a069-0fb9-48e0-a7b5-17a22d525630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:20:18.638566 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d0a069-0fb9-48e0-a7b5-17a22d525630 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:18.638841 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d0a069-0fb9-48e0-a7b5-17a22d525630 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:18.639111 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d0a069-0fb9-48e0-a7b5-17a22d525630 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:18.639747 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d0a069-0fb9-48e0-a7b5-17a22d525630 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:20:18.641530 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d0a069-0fb9-48e0-a7b5-17a22d525630 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:20:18.655209 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1282/2567] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:20:18.659830 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a1631c-e53d-464f-838f-e1e4db8ac0e0 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:20:18.669640 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a1631c-e53d-464f-838f-e1e4db8ac0e0 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:20:18.674127 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12990def-abe8-4d79-9da1-0123d53b49e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:20:18.675391 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12990def-abe8-4d79-9da1-0123d53b49e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:18.675665 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12990def-abe8-4d79-9da1-0123d53b49e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:18.675934 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12990def-abe8-4d79-9da1-0123d53b49e2 admin admin] PATH_INFO: `/v3/projects/0ea04522374749c993e1017cdde4bd8c/users/faee00b574e5446a8dbb85622ba27be5/roles/7c3871c0ab68438b9014489d50b53a22` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:18.689796 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12990def-abe8-4d79-9da1-0123d53b49e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ea04522374749c993e1017cdde4bd8c, user_id=faee00b574e5446a8dbb85622ba27be5, role_id=7c3871c0ab68438b9014489d50b53a22)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:20:18.692413 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12990def-abe8-4d79-9da1-0123d53b49e2 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:20:18.704472 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1286/2568] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:20:18 2022] PUT /identity/v3/projects/0ea04522374749c993e1017cdde4bd8c/users/faee00b574e5446a8dbb85622ba27be5/roles/7c3871c0ab68438b9014489d50b53a22 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:20:18.709419 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc591d-c32a-4024-b1b9-b68b653eb7e4 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:18.709704 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc591d-c32a-4024-b1b9-b68b653eb7e4 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:18.710008 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc591d-c32a-4024-b1b9-b68b653eb7e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:18.729165 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-57bc591d-c32a-4024-b1b9-b68b653eb7e4 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:20:18.730394 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-57bc591d-c32a-4024-b1b9-b68b653eb7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:20:18.787709 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1283/2569] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:20:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:20:18.797176 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12990def-abe8-4d79-9da1-0123d53b49e2 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:20:18.798888 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-12990def-abe8-4d79-9da1-0123d53b49e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:20:18.853751 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12990def-abe8-4d79-9da1-0123d53b49e2 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:20:18.857354 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74072c80-032a-4911-a2d4-eb39ea1a76c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:20:18.857964 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74072c80-032a-4911-a2d4-eb39ea1a76c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:18.858260 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74072c80-032a-4911-a2d4-eb39ea1a76c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:18.858534 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74072c80-032a-4911-a2d4-eb39ea1a76c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:18.867801 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74072c80-032a-4911-a2d4-eb39ea1a76c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:20:18.869208 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74072c80-032a-4911-a2d4-eb39ea1a76c1 service neutron] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:20:18.878468 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1287/2570] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:20:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:20:19.482143 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d42f6-7339-411e-a433-4ab99ca863d4 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:19.482432 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d42f6-7339-411e-a433-4ab99ca863d4 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:19.482708 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d42f6-7339-411e-a433-4ab99ca863d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:19.502326 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:20:19.512601 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-c15d42f6-7339-411e-a433-4ab99ca863d4 None None] MFA Rules not processed for user `faee00b574e5446a8dbb85622ba27be5`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:20:19.514293 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-c15d42f6-7339-411e-a433-4ab99ca863d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:20:19.584162 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1284/2571] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:20:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:20:19.591573 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74072c80-032a-4911-a2d4-eb39ea1a76c1 service neutron] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:20:19.592964 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-74072c80-032a-4911-a2d4-eb39ea1a76c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:20:19.653238 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74072c80-032a-4911-a2d4-eb39ea1a76c1 service neutron] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:20:19.657106 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4d3481-c82a-4028-8b83-a5ad3866894e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f4c2fc51f54f0e977648b13efaed1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:20:19.657716 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d3481-c82a-4028-8b83-a5ad3866894e service cinder] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:19.658023 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d3481-c82a-4028-8b83-a5ad3866894e service cinder] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:19.658297 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d3481-c82a-4028-8b83-a5ad3866894e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:19.667018 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4d3481-c82a-4028-8b83-a5ad3866894e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:20:19.668439 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4d3481-c82a-4028-8b83-a5ad3866894e service cinder] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:20:19.677657 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1288/2572] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:20:19 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:20:21.032652 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17605594-e1b0-4841-be00-2382e38b922a None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:21.033161 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17605594-e1b0-4841-be00-2382e38b922a None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:21.033272 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17605594-e1b0-4841-be00-2382e38b922a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:21.051930 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-17605594-e1b0-4841-be00-2382e38b922a None None] MFA Rules not processed for user `faee00b574e5446a8dbb85622ba27be5`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:20:21.053108 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-17605594-e1b0-4841-be00-2382e38b922a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:20:21.059764 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1285/2573] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:20:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:20:21.101732 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4d3481-c82a-4028-8b83-a5ad3866894e service cinder] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:20:21.103149 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-bb4d3481-c82a-4028-8b83-a5ad3866894e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:20:21.121369 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:20:21.161416 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4d3481-c82a-4028-8b83-a5ad3866894e service cinder] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:20:21.164854 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a422b4-4807-433f-acae-1691cad9deb4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '399f7d3700a24cb486e56b409a6e5429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:20:21.165446 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a422b4-4807-433f-acae-1691cad9deb4 service glance] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:21.165723 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a422b4-4807-433f-acae-1691cad9deb4 service glance] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:21.166023 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a422b4-4807-433f-acae-1691cad9deb4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:21.167733 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-e3a422b4-4807-433f-acae-1691cad9deb4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:20:21.254963 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a422b4-4807-433f-acae-1691cad9deb4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:20:21.256408 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a422b4-4807-433f-acae-1691cad9deb4 service glance] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:20:21.275708 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1289/2574] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:20:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:20:21.786540 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17605594-e1b0-4841-be00-2382e38b922a None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:20:21.787978 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-17605594-e1b0-4841-be00-2382e38b922a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:20:21.800243 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17605594-e1b0-4841-be00-2382e38b922a None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:20:21.803873 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0538b251-80a6-4f37-9e27-f455c284d887 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:20:21.804464 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538b251-80a6-4f37-9e27-f455c284d887 service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:21.804738 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538b251-80a6-4f37-9e27-f455c284d887 service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:21.805006 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538b251-80a6-4f37-9e27-f455c284d887 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:21.806692 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-0538b251-80a6-4f37-9e27-f455c284d887 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:20:21.820411 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0538b251-80a6-4f37-9e27-f455c284d887 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:20:21.821862 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0538b251-80a6-4f37-9e27-f455c284d887 service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:20:21.833135 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1286/2575] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:20:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:20:31.273116 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=59 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:20:31.828036 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=37 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:20:35.397779 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2f873-deab-4d09-988b-6ff20660c2cc None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:35.398277 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2f873-deab-4d09-988b-6ff20660c2cc None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:35.398377 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2f873-deab-4d09-988b-6ff20660c2cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:35.417062 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-d9a2f873-deab-4d09-988b-6ff20660c2cc None None] MFA Rules not processed for user `faee00b574e5446a8dbb85622ba27be5`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:20:35.418359 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-d9a2f873-deab-4d09-988b-6ff20660c2cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:20:35.425583 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1290/2576] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:20:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:20:35.951292 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0538b251-80a6-4f37-9e27-f455c284d887 service neutron] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:20:35.952701 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-0538b251-80a6-4f37-9e27-f455c284d887 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:20:36.025101 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0538b251-80a6-4f37-9e27-f455c284d887 service neutron] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:20:36.030359 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e189c7e-b6ae-4820-9103-b9cc64cbd170 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed4bb75e68a640fc92ddd47fad61a25a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:20:36.031077 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e189c7e-b6ae-4820-9103-b9cc64cbd170 service placement] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:36.031363 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e189c7e-b6ae-4820-9103-b9cc64cbd170 service placement] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:36.031662 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e189c7e-b6ae-4820-9103-b9cc64cbd170 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:36.033913 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-5e189c7e-b6ae-4820-9103-b9cc64cbd170 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:20:36.045150 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e189c7e-b6ae-4820-9103-b9cc64cbd170 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:20:36.046758 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e189c7e-b6ae-4820-9103-b9cc64cbd170 service placement] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:20:36.057613 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1287/2577] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:20:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:20:37.890362 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a2f873-deab-4d09-988b-6ff20660c2cc None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:20:37.900004 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a2f873-deab-4d09-988b-6ff20660c2cc None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:20:37.903423 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe796e5-80dc-43bc-b26b-50800be78d29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:20:37.904012 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe796e5-80dc-43bc-b26b-50800be78d29 service neutron] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:37.904286 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe796e5-80dc-43bc-b26b-50800be78d29 service neutron] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:37.904559 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe796e5-80dc-43bc-b26b-50800be78d29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:37.906252 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-6fe796e5-80dc-43bc-b26b-50800be78d29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:20:37.915607 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe796e5-80dc-43bc-b26b-50800be78d29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:20:37.917015 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe796e5-80dc-43bc-b26b-50800be78d29 service neutron] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:20:37.925493 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1291/2578] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:20:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:20:46.053215 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=32 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:20:47.921430 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=9 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:20:50.931395 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6221652f-212c-464d-be49-1f8a2427c821 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:50.932039 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6221652f-212c-464d-be49-1f8a2427c821 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:50.932039 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6221652f-212c-464d-be49-1f8a2427c821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:50.990516 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-6221652f-212c-464d-be49-1f8a2427c821 None None] MFA Rules not processed for user `6e803a9cc6114c4f93869e50bca313e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:20:50.991741 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-6221652f-212c-464d-be49-1f8a2427c821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:20:51.057218 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1288/2579] 10.222.0.25 () {58 vars in 1009 bytes} [Thu Oct 13 11:20:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 11:20:51.102734 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe796e5-80dc-43bc-b26b-50800be78d29 service neutron] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:20:51.104278 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-6fe796e5-80dc-43bc-b26b-50800be78d29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:20:51.195102 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe796e5-80dc-43bc-b26b-50800be78d29 service neutron] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:20:51.200107 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a98531-9dee-43de-9ae8-e1738c55f62b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e24c779d0a604ef28dfc1235ee76a711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:20:51.200709 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a98531-9dee-43de-9ae8-e1738c55f62b service swift] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:20:51.200992 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a98531-9dee-43de-9ae8-e1738c55f62b service swift] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:20:51.201261 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a98531-9dee-43de-9ae8-e1738c55f62b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:20:51.209290 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a98531-9dee-43de-9ae8-e1738c55f62b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:20:51.210899 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a98531-9dee-43de-9ae8-e1738c55f62b service swift] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:20:51.218731 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1292/2580] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Oct 13 11:20:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 13 11:21:01.054386 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=44 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:21:01.215686 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=41 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:21:05.548912 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316000c2-9758-48c3-958e-366e78d5586b None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:21:05.549384 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316000c2-9758-48c3-958e-366e78d5586b None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:21:05.549520 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316000c2-9758-48c3-958e-366e78d5586b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:21:05.569445 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-316000c2-9758-48c3-958e-366e78d5586b None None] MFA Rules not processed for user `6e803a9cc6114c4f93869e50bca313e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:21:05.570685 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-316000c2-9758-48c3-958e-366e78d5586b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:21:05.578238 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1289/2581] 10.222.0.25 () {58 vars in 967 bytes} [Thu Oct 13 11:21:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:21:05.590225 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a98531-9dee-43de-9ae8-e1738c55f62b service swift] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:21:05.600573 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a98531-9dee-43de-9ae8-e1738c55f62b service swift] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:21:05.605537 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558c0efc-44ac-4006-b8e5-317dd1529e7a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e24c779d0a604ef28dfc1235ee76a711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:21:05.606148 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c0efc-44ac-4006-b8e5-317dd1529e7a service swift] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:21:05.606425 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c0efc-44ac-4006-b8e5-317dd1529e7a service swift] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:21:05.606694 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c0efc-44ac-4006-b8e5-317dd1529e7a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:21:05.616287 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558c0efc-44ac-4006-b8e5-317dd1529e7a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:21:05.617848 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558c0efc-44ac-4006-b8e5-317dd1529e7a service swift] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:21:05.626897 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1293/2582] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Oct 13 11:21:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 13 11:21:07.536338 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316000c2-9758-48c3-958e-366e78d5586b None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:21:07.547770 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316000c2-9758-48c3-958e-366e78d5586b None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:21:07.552931 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d08205b-527b-41be-be42-346e24af9142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:21:07.553549 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08205b-527b-41be-be42-346e24af9142 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:21:07.553828 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08205b-527b-41be-be42-346e24af9142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:21:07.554184 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08205b-527b-41be-be42-346e24af9142 admin admin] PATH_INFO: `/v3/users/faee00b574e5446a8dbb85622ba27be5` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:21:07.555253 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d08205b-527b-41be-be42-346e24af9142 admin admin] RBAC: Authorizing `identity:delete_user(user_id=faee00b574e5446a8dbb85622ba27be5)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:21:07.557231 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d08205b-527b-41be-be42-346e24af9142 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:21:07.603769 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-0d08205b-527b-41be-be42-346e24af9142 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'faee00b574e5446a8dbb85622ba27be5'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:21:07.604405 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-0d08205b-527b-41be-be42-346e24af9142 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'faee00b574e5446a8dbb85622ba27be5'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:21:07.604997 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-0d08205b-527b-41be-be42-346e24af9142 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'faee00b574e5446a8dbb85622ba27be5'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:21:07.616471 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-0d08205b-527b-41be-be42-346e24af9142 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'faee00b574e5446a8dbb85622ba27be5'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:21:07.623572 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-0d08205b-527b-41be-be42-346e24af9142 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'faee00b574e5446a8dbb85622ba27be5'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:21:07.636065 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1290/2583] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:21:07 2022] DELETE /identity/v3/users/faee00b574e5446a8dbb85622ba27be5 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:21:07.805918 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558c0efc-44ac-4006-b8e5-317dd1529e7a service swift] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:21:07.816395 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558c0efc-44ac-4006-b8e5-317dd1529e7a service swift] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:21:07.876350 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a919f-68df-42ad-891a-139dcc37d673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:21:07.876988 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a919f-68df-42ad-891a-139dcc37d673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:21:07.877257 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a919f-68df-42ad-891a-139dcc37d673 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:21:07.877523 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a919f-68df-42ad-891a-139dcc37d673 admin admin] PATH_INFO: `/v3/projects/0ea04522374749c993e1017cdde4bd8c` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:21:07.878704 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4a919f-68df-42ad-891a-139dcc37d673 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ea04522374749c993e1017cdde4bd8c)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:21:07.880860 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4a919f-68df-42ad-891a-139dcc37d673 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:21:07.929694 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-9a4a919f-68df-42ad-891a-139dcc37d673 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ea04522374749c993e1017cdde4bd8c', 'request_id': 'req-9a4a919f-68df-42ad-891a-139dcc37d673'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:21:07.935755 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-9a4a919f-68df-42ad-891a-139dcc37d673 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ea04522374749c993e1017cdde4bd8c', 'request_id': 'req-9a4a919f-68df-42ad-891a-139dcc37d673'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:21:07.941591 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-9a4a919f-68df-42ad-891a-139dcc37d673 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ea04522374749c993e1017cdde4bd8c', 'request_id': 'req-9a4a919f-68df-42ad-891a-139dcc37d673'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:21:07.953309 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-9a4a919f-68df-42ad-891a-139dcc37d673 admin admin] The token cache is being invalidate because project 0ea04522374749c993e1017cdde4bd8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:21:07.953592 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-9a4a919f-68df-42ad-891a-139dcc37d673 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:21:07.954225 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-9a4a919f-68df-42ad-891a-139dcc37d673 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:21:07.955681 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1294/2584] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:21:07 2022] DELETE /identity/v3/projects/0ea04522374749c993e1017cdde4bd8c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:21:07.960978 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8027ef4-297f-4787-bff2-0f3b13c13182 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:21:07.961262 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8027ef4-297f-4787-bff2-0f3b13c13182 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:21:07.961535 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8027ef4-297f-4787-bff2-0f3b13c13182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:21:07.980598 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-d8027ef4-297f-4787-bff2-0f3b13c13182 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:21:07.981789 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-d8027ef4-297f-4787-bff2-0f3b13c13182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:21:08.041198 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1291/2585] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:21:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:21:08.049516 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a0b48-413c-472f-9846-faee46958644 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:21:08.049793 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a0b48-413c-472f-9846-faee46958644 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:21:08.050126 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a0b48-413c-472f-9846-faee46958644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:21:08.070048 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-7e2a0b48-413c-472f-9846-faee46958644 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:21:08.071458 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-7e2a0b48-413c-472f-9846-faee46958644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:21:08.079337 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1295/2586] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:21:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:21:08.084090 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8027ef4-297f-4787-bff2-0f3b13c13182 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:21:08.093719 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8027ef4-297f-4787-bff2-0f3b13c13182 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:21:08.098658 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ea97e-c797-4dc5-9cdc-71f70aead0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:21:08.099252 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ea97e-c797-4dc5-9cdc-71f70aead0c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:21:08.099527 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ea97e-c797-4dc5-9cdc-71f70aead0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:21:08.099797 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ea97e-c797-4dc5-9cdc-71f70aead0c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:21:08.100430 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066ea97e-c797-4dc5-9cdc-71f70aead0c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:21:08.100733 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066ea97e-c797-4dc5-9cdc-71f70aead0c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:21:08.102360 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066ea97e-c797-4dc5-9cdc-71f70aead0c0 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:21:08.113535 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1292/2587] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 11:21:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:21:08.117627 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2a0b48-413c-472f-9846-faee46958644 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:21:08.126758 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2a0b48-413c-472f-9846-faee46958644 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:21:08.132254 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0974030f-f87b-4a74-a9c1-58bab968200b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:21:08.132837 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974030f-f87b-4a74-a9c1-58bab968200b admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:21:08.133116 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974030f-f87b-4a74-a9c1-58bab968200b admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:21:08.133393 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974030f-f87b-4a74-a9c1-58bab968200b admin admin] PATH_INFO: `/v3/projects` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:21:08.134054 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0974030f-f87b-4a74-a9c1-58bab968200b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:21:08.135914 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0974030f-f87b-4a74-a9c1-58bab968200b admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:21:08.163969 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1296/2588] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:21:08 2022] POST /identity/v3/projects => generated 363 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:21:08.167000 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ea97e-c797-4dc5-9cdc-71f70aead0c0 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:21:08.177344 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ea97e-c797-4dc5-9cdc-71f70aead0c0 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:21:08.223484 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:21:08.233674 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba49301-dcf9-4744-8653-d8ea8b730002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:21:08.234315 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba49301-dcf9-4744-8653-d8ea8b730002 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:21:08.234594 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba49301-dcf9-4744-8653-d8ea8b730002 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:21:08.234866 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba49301-dcf9-4744-8653-d8ea8b730002 admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:21:08.235502 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba49301-dcf9-4744-8653-d8ea8b730002 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:21:08.237490 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba49301-dcf9-4744-8653-d8ea8b730002 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:21:08.259819 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1293/2589] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:21:08 2022] POST /identity/v3/users => generated 282 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:21:08.263937 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0974030f-f87b-4a74-a9c1-58bab968200b admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:21:08.274867 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0974030f-f87b-4a74-a9c1-58bab968200b admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:21:08.279478 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152c3819-ddd1-468a-b310-67ad9b067dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:21:08.280068 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152c3819-ddd1-468a-b310-67ad9b067dcb admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:21:08.280348 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152c3819-ddd1-468a-b310-67ad9b067dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:21:08.280622 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152c3819-ddd1-468a-b310-67ad9b067dcb admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:21:08.281262 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152c3819-ddd1-468a-b310-67ad9b067dcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:21:08.282938 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152c3819-ddd1-468a-b310-67ad9b067dcb admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:21:08.292923 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1297/2590] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:21:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:21:08.296721 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba49301-dcf9-4744-8653-d8ea8b730002 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:21:08.306526 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba49301-dcf9-4744-8653-d8ea8b730002 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:21:08.311049 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606954cd-2f9c-480e-9226-8fb09d830e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:21:08.311637 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606954cd-2f9c-480e-9226-8fb09d830e94 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:21:08.311916 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606954cd-2f9c-480e-9226-8fb09d830e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:21:08.312191 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606954cd-2f9c-480e-9226-8fb09d830e94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:21:08.312826 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606954cd-2f9c-480e-9226-8fb09d830e94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:21:08.314451 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606954cd-2f9c-480e-9226-8fb09d830e94 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:21:08.325435 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1294/2591] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:21:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:21:08.329044 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152c3819-ddd1-468a-b310-67ad9b067dcb admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:21:08.339573 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152c3819-ddd1-468a-b310-67ad9b067dcb admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:21:08.344160 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7164744-00a3-4e86-8e7f-fe5beb11fa54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:21:08.344796 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7164744-00a3-4e86-8e7f-fe5beb11fa54 admin admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:21:08.345077 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7164744-00a3-4e86-8e7f-fe5beb11fa54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:21:08.345354 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7164744-00a3-4e86-8e7f-fe5beb11fa54 admin admin] PATH_INFO: `/v3/projects/a18d7ea1640c490ab33ed1f76320d715/users/dd2060e736f6448e9831902c0186f13c/roles/7c3871c0ab68438b9014489d50b53a22` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:21:08.359557 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7164744-00a3-4e86-8e7f-fe5beb11fa54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a18d7ea1640c490ab33ed1f76320d715, user_id=dd2060e736f6448e9831902c0186f13c, role_id=7c3871c0ab68438b9014489d50b53a22)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:21:08.362730 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7164744-00a3-4e86-8e7f-fe5beb11fa54 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:21:08.375899 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1298/2592] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:21:08 2022] PUT /identity/v3/projects/a18d7ea1640c490ab33ed1f76320d715/users/dd2060e736f6448e9831902c0186f13c/roles/7c3871c0ab68438b9014489d50b53a22 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:21:08.386811 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ece7a90-74d0-4abb-bf77-cb126a88fd0f None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:21:08.387099 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ece7a90-74d0-4abb-bf77-cb126a88fd0f None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:21:08.387378 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ece7a90-74d0-4abb-bf77-cb126a88fd0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:21:08.415394 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-8ece7a90-74d0-4abb-bf77-cb126a88fd0f None None] MFA Rules not processed for user `dd2060e736f6448e9831902c0186f13c`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:21:08.416620 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-8ece7a90-74d0-4abb-bf77-cb126a88fd0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:21:08.482532 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1295/2593] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:21:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:21:08.493827 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7164744-00a3-4e86-8e7f-fe5beb11fa54 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:21:08.495541 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-a7164744-00a3-4e86-8e7f-fe5beb11fa54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:21:08.509541 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:21:08.552248 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7164744-00a3-4e86-8e7f-fe5beb11fa54 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:21:08.555847 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0289892d-7949-4069-a572-072f92a14bbe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f4c2fc51f54f0e977648b13efaed1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:21:08.556441 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289892d-7949-4069-a572-072f92a14bbe service cinder] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:21:08.556718 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289892d-7949-4069-a572-072f92a14bbe service cinder] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:21:08.556985 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289892d-7949-4069-a572-072f92a14bbe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:21:08.565005 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0289892d-7949-4069-a572-072f92a14bbe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:21:08.566464 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0289892d-7949-4069-a572-072f92a14bbe service cinder] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:21:08.575161 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1299/2594] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:21:08 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:21:18.478048 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=42,keystone:INSERT=3 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:21:18.571187 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=20 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:21:39.360603 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ece7a90-74d0-4abb-bf77-cb126a88fd0f None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:21:39.421928 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ece7a90-74d0-4abb-bf77-cb126a88fd0f None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:21:39.426386 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a67855-47d7-4114-a223-cfdcd579eced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:21:39.427004 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a67855-47d7-4114-a223-cfdcd579eced admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:21:39.427284 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a67855-47d7-4114-a223-cfdcd579eced admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:21:39.427557 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a67855-47d7-4114-a223-cfdcd579eced admin admin] PATH_INFO: `/v3/users/dd2060e736f6448e9831902c0186f13c` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:21:39.428743 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a67855-47d7-4114-a223-cfdcd579eced admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd2060e736f6448e9831902c0186f13c)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:21:39.431233 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a67855-47d7-4114-a223-cfdcd579eced admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:21:39.476237 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-58a67855-47d7-4114-a223-cfdcd579eced admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd2060e736f6448e9831902c0186f13c'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:21:39.476867 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-58a67855-47d7-4114-a223-cfdcd579eced admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd2060e736f6448e9831902c0186f13c'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:21:39.477464 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-58a67855-47d7-4114-a223-cfdcd579eced admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd2060e736f6448e9831902c0186f13c'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:21:39.488977 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-58a67855-47d7-4114-a223-cfdcd579eced admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd2060e736f6448e9831902c0186f13c'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:21:39.496595 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-58a67855-47d7-4114-a223-cfdcd579eced admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd2060e736f6448e9831902c0186f13c'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:21:39.509665 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1296/2595] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:21:39 2022] DELETE /identity/v3/users/dd2060e736f6448e9831902c0186f13c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:21:39.514358 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9d85a-2968-4d27-8ede-9a897d605f8d None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:21:39.514854 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9d85a-2968-4d27-8ede-9a897d605f8d None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:21:39.514854 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9d85a-2968-4d27-8ede-9a897d605f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:21:39.533594 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-7cf9d85a-2968-4d27-8ede-9a897d605f8d None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:21:39.534903 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-7cf9d85a-2968-4d27-8ede-9a897d605f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:21:39.592541 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1300/2596] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:21:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:21:39.602078 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a67855-47d7-4114-a223-cfdcd579eced admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:21:39.603492 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-58a67855-47d7-4114-a223-cfdcd579eced admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:21:39.659870 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a67855-47d7-4114-a223-cfdcd579eced admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:21:39.663467 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc8db01-3d32-4db7-a565-765738b3a1e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:21:39.664064 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc8db01-3d32-4db7-a565-765738b3a1e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:21:39.664340 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc8db01-3d32-4db7-a565-765738b3a1e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:21:39.664614 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc8db01-3d32-4db7-a565-765738b3a1e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:21:39.673299 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc8db01-3d32-4db7-a565-765738b3a1e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:21:39.674736 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc8db01-3d32-4db7-a565-765738b3a1e8 service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:21:39.684429 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1297/2597] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:21:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:21:39.949075 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf9d85a-2968-4d27-8ede-9a897d605f8d None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:21:39.950544 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-7cf9d85a-2968-4d27-8ede-9a897d605f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:21:39.962455 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf9d85a-2968-4d27-8ede-9a897d605f8d None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:21:39.967244 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54b6eac-dea0-40e0-843f-ef837f3f5a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:21:39.967884 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b6eac-dea0-40e0-843f-ef837f3f5a58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:21:39.968165 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b6eac-dea0-40e0-843f-ef837f3f5a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:21:39.968439 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b6eac-dea0-40e0-843f-ef837f3f5a58 admin admin] PATH_INFO: `/v3/projects/a18d7ea1640c490ab33ed1f76320d715` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:21:39.969646 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54b6eac-dea0-40e0-843f-ef837f3f5a58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a18d7ea1640c490ab33ed1f76320d715)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:21:39.971578 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54b6eac-dea0-40e0-843f-ef837f3f5a58 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:21:40.018760 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-b54b6eac-dea0-40e0-843f-ef837f3f5a58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a18d7ea1640c490ab33ed1f76320d715', 'request_id': 'req-b54b6eac-dea0-40e0-843f-ef837f3f5a58'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:21:40.025098 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-b54b6eac-dea0-40e0-843f-ef837f3f5a58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a18d7ea1640c490ab33ed1f76320d715', 'request_id': 'req-b54b6eac-dea0-40e0-843f-ef837f3f5a58'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:21:40.030549 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-b54b6eac-dea0-40e0-843f-ef837f3f5a58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a18d7ea1640c490ab33ed1f76320d715', 'request_id': 'req-b54b6eac-dea0-40e0-843f-ef837f3f5a58'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:21:40.043132 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-b54b6eac-dea0-40e0-843f-ef837f3f5a58 admin admin] The token cache is being invalidate because project a18d7ea1640c490ab33ed1f76320d715 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:21:40.043413 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-b54b6eac-dea0-40e0-843f-ef837f3f5a58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:21:40.044042 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-b54b6eac-dea0-40e0-843f-ef837f3f5a58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:21:40.045529 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1301/2598] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:21:39 2022] DELETE /identity/v3/projects/a18d7ea1640c490ab33ed1f76320d715 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:21:40.050377 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a87fa-5c7f-4e52-b1ca-8ecd4c98034d None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:21:40.050666 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a87fa-5c7f-4e52-b1ca-8ecd4c98034d None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:21:40.050942 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a87fa-5c7f-4e52-b1ca-8ecd4c98034d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:21:40.070832 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-6b9a87fa-5c7f-4e52-b1ca-8ecd4c98034d None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:21:40.072029 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-6b9a87fa-5c7f-4e52-b1ca-8ecd4c98034d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:21:40.088799 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:21:40.132104 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1298/2599] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:21:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:21:40.140939 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67863021-b08d-4b50-8894-c4887ee82df5 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:21:40.141209 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67863021-b08d-4b50-8894-c4887ee82df5 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:21:40.141480 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67863021-b08d-4b50-8894-c4887ee82df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:21:40.161290 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-67863021-b08d-4b50-8894-c4887ee82df5 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:21:40.162526 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-67863021-b08d-4b50-8894-c4887ee82df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:21:40.170818 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1302/2600] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:21:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:21:40.174924 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9a87fa-5c7f-4e52-b1ca-8ecd4c98034d None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:21:40.184933 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9a87fa-5c7f-4e52-b1ca-8ecd4c98034d None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:21:40.189393 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b1a114-93c3-4532-9bc5-e7bcbea752d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:21:40.190012 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b1a114-93c3-4532-9bc5-e7bcbea752d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:21:40.190291 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b1a114-93c3-4532-9bc5-e7bcbea752d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:21:40.190560 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b1a114-93c3-4532-9bc5-e7bcbea752d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:21:40.191199 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b1a114-93c3-4532-9bc5-e7bcbea752d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:21:40.191552 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b1a114-93c3-4532-9bc5-e7bcbea752d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:21:40.193121 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b1a114-93c3-4532-9bc5-e7bcbea752d9 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:21:40.204584 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1299/2601] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Oct 13 11:21:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:21:40.208665 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67863021-b08d-4b50-8894-c4887ee82df5 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:21:40.218072 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67863021-b08d-4b50-8894-c4887ee82df5 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:21:40.222570 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cfa030-b4da-4b81-aef4-e77188616ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:21:40.223148 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cfa030-b4da-4b81-aef4-e77188616ab1 admin admin] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:21:40.223474 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cfa030-b4da-4b81-aef4-e77188616ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:21:40.223747 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cfa030-b4da-4b81-aef4-e77188616ab1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:21:40.224375 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cfa030-b4da-4b81-aef4-e77188616ab1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:21:40.226299 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cfa030-b4da-4b81-aef4-e77188616ab1 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:21:40.253765 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1303/2602] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Oct 13 11:21:40 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:21:40.258137 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b1a114-93c3-4532-9bc5-e7bcbea752d9 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:21:40.267885 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b1a114-93c3-4532-9bc5-e7bcbea752d9 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:21:40.322465 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f99a6-4589-4e1f-9042-564f08f1ec85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:21:40.322993 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f99a6-4589-4e1f-9042-564f08f1ec85 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:21:40.323269 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f99a6-4589-4e1f-9042-564f08f1ec85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:21:40.323543 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f99a6-4589-4e1f-9042-564f08f1ec85 admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:21:40.324170 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139f99a6-4589-4e1f-9042-564f08f1ec85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:21:40.326090 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139f99a6-4589-4e1f-9042-564f08f1ec85 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:21:40.347181 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1300/2603] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Oct 13 11:21:40 2022] POST /identity/v3/users => generated 287 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:21:40.351281 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cfa030-b4da-4b81-aef4-e77188616ab1 admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:21:40.361836 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cfa030-b4da-4b81-aef4-e77188616ab1 admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:21:40.366380 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b16d8d-b171-4a6a-a858-792fd596c9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:21:40.366962 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b16d8d-b171-4a6a-a858-792fd596c9dd admin admin] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:21:40.367239 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b16d8d-b171-4a6a-a858-792fd596c9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:21:40.367510 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b16d8d-b171-4a6a-a858-792fd596c9dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:21:40.368144 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b16d8d-b171-4a6a-a858-792fd596c9dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:21:40.369700 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b16d8d-b171-4a6a-a858-792fd596c9dd admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:21:40.379225 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1304/2604] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 13 11:21:40.383048 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f99a6-4589-4e1f-9042-564f08f1ec85 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:21:40.392817 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f99a6-4589-4e1f-9042-564f08f1ec85 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:21:40.397408 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee68ab1-4b34-4603-b73d-b5f86aaac684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:21:40.398011 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee68ab1-4b34-4603-b73d-b5f86aaac684 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:21:40.398291 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee68ab1-4b34-4603-b73d-b5f86aaac684 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:21:40.398565 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee68ab1-4b34-4603-b73d-b5f86aaac684 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:21:40.399694 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee68ab1-4b34-4603-b73d-b5f86aaac684 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:21:40.401262 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee68ab1-4b34-4603-b73d-b5f86aaac684 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:21:40.412274 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1301/2605] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Oct 13 11:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:21:40.416977 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b16d8d-b171-4a6a-a858-792fd596c9dd admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:21:40.426729 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b16d8d-b171-4a6a-a858-792fd596c9dd admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:21:40.431242 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d93750-7cf1-48a8-b8a7-94c85da5899e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:21:40.431868 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d93750-7cf1-48a8-b8a7-94c85da5899e admin admin] REQUEST_METHOD: `PUT` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:21:40.432143 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d93750-7cf1-48a8-b8a7-94c85da5899e admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:21:40.432413 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d93750-7cf1-48a8-b8a7-94c85da5899e admin admin] PATH_INFO: `/v3/projects/23fcf8e395c049b098f291ed0d3c1ac9/users/0738098dad484757abe1268b4b6cf573/roles/7c3871c0ab68438b9014489d50b53a22` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:21:40.446777 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d93750-7cf1-48a8-b8a7-94c85da5899e admin admin] RBAC: Authorizing `identity:create_grant(project_id=23fcf8e395c049b098f291ed0d3c1ac9, user_id=0738098dad484757abe1268b4b6cf573, role_id=7c3871c0ab68438b9014489d50b53a22)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:21:40.449382 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d93750-7cf1-48a8-b8a7-94c85da5899e admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:21:40.463054 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1305/2606] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Oct 13 11:21:40 2022] PUT /identity/v3/projects/23fcf8e395c049b098f291ed0d3c1ac9/users/0738098dad484757abe1268b4b6cf573/roles/7c3871c0ab68438b9014489d50b53a22 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 11:21:40.473024 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc674ef6-073e-4605-9ba4-29783702dca1 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:21:40.473317 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc674ef6-073e-4605-9ba4-29783702dca1 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:21:40.473599 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc674ef6-073e-4605-9ba4-29783702dca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:21:40.503052 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-fc674ef6-073e-4605-9ba4-29783702dca1 None None] MFA Rules not processed for user `0738098dad484757abe1268b4b6cf573`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:21:40.504259 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-fc674ef6-073e-4605-9ba4-29783702dca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:21:40.566430 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1302/2607] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:21:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:21:40.579942 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d93750-7cf1-48a8-b8a7-94c85da5899e admin admin] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:21:40.581665 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-e1d93750-7cf1-48a8-b8a7-94c85da5899e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:21:40.603654 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:21:40.639504 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d93750-7cf1-48a8-b8a7-94c85da5899e admin admin] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:21:40.643107 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab25135a-9a34-41df-90f8-76f957f2e802 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f4c2fc51f54f0e977648b13efaed1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:21:40.643704 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25135a-9a34-41df-90f8-76f957f2e802 service cinder] REQUEST_METHOD: `GET` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:21:40.643982 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25135a-9a34-41df-90f8-76f957f2e802 service cinder] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:21:40.644254 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25135a-9a34-41df-90f8-76f957f2e802 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:21:40.653345 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab25135a-9a34-41df-90f8-76f957f2e802 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:21:40.654851 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab25135a-9a34-41df-90f8-76f957f2e802 service cinder] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:21:40.663684 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1306/2608] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:21:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:21:40.688748 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc674ef6-073e-4605-9ba4-29783702dca1 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:21:40.707735 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:21:40.749873 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc674ef6-073e-4605-9ba4-29783702dca1 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:21:40.754514 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b288c94-049f-4362-b936-085aac8a737c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:21:40.755386 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b288c94-049f-4362-b936-085aac8a737c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:21:40.755662 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b288c94-049f-4362-b936-085aac8a737c admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:21:40.755939 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b288c94-049f-4362-b936-085aac8a737c admin admin] PATH_INFO: `/v3/users/0738098dad484757abe1268b4b6cf573` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:21:40.757059 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b288c94-049f-4362-b936-085aac8a737c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0738098dad484757abe1268b4b6cf573)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:21:40.759479 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b288c94-049f-4362-b936-085aac8a737c admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:21:40.807016 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-7b288c94-049f-4362-b936-085aac8a737c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0738098dad484757abe1268b4b6cf573'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:21:40.807689 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-7b288c94-049f-4362-b936-085aac8a737c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0738098dad484757abe1268b4b6cf573'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:21:40.808330 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-7b288c94-049f-4362-b936-085aac8a737c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0738098dad484757abe1268b4b6cf573'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:21:40.820139 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-7b288c94-049f-4362-b936-085aac8a737c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0738098dad484757abe1268b4b6cf573'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:21:40.828290 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-7b288c94-049f-4362-b936-085aac8a737c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0738098dad484757abe1268b4b6cf573'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:21:40.841035 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1303/2609] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Oct 13 11:21:40 2022] DELETE /identity/v3/users/0738098dad484757abe1268b4b6cf573 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:21:40.845529 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be6c90-dff8-4292-9431-a0cb43c04227 None None] REQUEST_METHOD: `POST` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:21:40.845817 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be6c90-dff8-4292-9431-a0cb43c04227 None None] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:21:40.846118 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be6c90-dff8-4292-9431-a0cb43c04227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:21:40.865016 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.auth.core [None req-25be6c90-dff8-4292-9431-a0cb43c04227 None None] MFA Rules not processed for user `f4dbe08e33ae4779a5bb51d82d216642`. Rule list: `[]` (Enabled: `True`). {{(pid=81551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:21:40.866250 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-25be6c90-dff8-4292-9431-a0cb43c04227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:21:40.925311 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1307/2610] 10.222.0.25 () {58 vars in 958 bytes} [Thu Oct 13 11:21:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 11:21:40.935486 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b288c94-049f-4362-b936-085aac8a737c admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:21:40.936917 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-7b288c94-049f-4362-b936-085aac8a737c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:21:40.991987 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b288c94-049f-4362-b936-085aac8a737c admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:21:40.996063 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a6b623-88d4-45f2-85f8-c6183cb4ff1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '085e8bffed444287bc5f805461c3fb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:21:40.996663 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a6b623-88d4-45f2-85f8-c6183cb4ff1e service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:21:40.996940 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a6b623-88d4-45f2-85f8-c6183cb4ff1e service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:21:40.997212 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a6b623-88d4-45f2-85f8-c6183cb4ff1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:21:41.006328 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a6b623-88d4-45f2-85f8-c6183cb4ff1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:21:41.007750 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a6b623-88d4-45f2-85f8-c6183cb4ff1e service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:21:41.017799 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1304/2611] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:21:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:21:41.275988 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25be6c90-dff8-4292-9431-a0cb43c04227 None None] Authenticating user token {{(pid=81551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:21:41.277597 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.fernet_utils [None req-25be6c90-dff8-4292-9431-a0cb43c04227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:21:41.292148 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25be6c90-dff8-4292-9431-a0cb43c04227 None None] Validating token access rules against request {{(pid=81551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:21:41.297058 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e7f2eb-6051-452e-a8ec-6eda5850a4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dbe08e33ae4779a5bb51d82d216642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbde15a03afe4c128d89633ab934d9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:21:41.297723 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7f2eb-6051-452e-a8ec-6eda5850a4c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:21:41.298069 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7f2eb-6051-452e-a8ec-6eda5850a4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:21:41.298274 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7f2eb-6051-452e-a8ec-6eda5850a4c8 admin admin] PATH_INFO: `/v3/projects/23fcf8e395c049b098f291ed0d3c1ac9` {{(pid=81551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:21:41.299496 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e7f2eb-6051-452e-a8ec-6eda5850a4c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23fcf8e395c049b098f291ed0d3c1ac9)` {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:21:41.301404 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e7f2eb-6051-452e-a8ec-6eda5850a4c8 admin admin] RBAC: Authorization granted {{(pid=81551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:21:41.346865 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-b2e7f2eb-6051-452e-a8ec-6eda5850a4c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23fcf8e395c049b098f291ed0d3c1ac9', 'request_id': 'req-b2e7f2eb-6051-452e-a8ec-6eda5850a4c8'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:21:41.353424 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-b2e7f2eb-6051-452e-a8ec-6eda5850a4c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23fcf8e395c049b098f291ed0d3c1ac9', 'request_id': 'req-b2e7f2eb-6051-452e-a8ec-6eda5850a4c8'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:21:41.358953 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-b2e7f2eb-6051-452e-a8ec-6eda5850a4c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23fcf8e395c049b098f291ed0d3c1ac9', 'request_id': 'req-b2e7f2eb-6051-452e-a8ec-6eda5850a4c8'} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:21:41.371562 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-b2e7f2eb-6051-452e-a8ec-6eda5850a4c8 admin admin] The token cache is being invalidate because project 23fcf8e395c049b098f291ed0d3c1ac9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:21:41.371849 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-b2e7f2eb-6051-452e-a8ec-6eda5850a4c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:21:41.372462 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG keystone.notifications [None req-b2e7f2eb-6051-452e-a8ec-6eda5850a4c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:21:41.373928 dv-cinder-861001-1-smb devstack@keystone.service[81551]: [pid: 81551|app: 0|req: 1308/2612] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Oct 13 11:21:41 2022] DELETE /identity/v3/projects/23fcf8e395c049b098f291ed0d3c1ac9 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:21:51.016717 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:21:51.367886 dv-cinder-861001-1-smb devstack@keystone.service[81551]: DEBUG dbcounter [-] [81551] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:24:36.930825 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a6b623-88d4-45f2-85f8-c6183cb4ff1e service neutron] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:24:36.932209 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-d5a6b623-88d4-45f2-85f8-c6183cb4ff1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:24:37.000776 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a6b623-88d4-45f2-85f8-c6183cb4ff1e service neutron] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:24:37.057932 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663383d6-0d74-4884-8e1e-bcc7d2a9c62b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed4bb75e68a640fc92ddd47fad61a25a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85bfac5f03e24fb3870a59a6b52dba6e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:24:37.058553 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663383d6-0d74-4884-8e1e-bcc7d2a9c62b service placement] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:24:37.058829 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663383d6-0d74-4884-8e1e-bcc7d2a9c62b service placement] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:24:37.059099 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663383d6-0d74-4884-8e1e-bcc7d2a9c62b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:24:37.060813 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-663383d6-0d74-4884-8e1e-bcc7d2a9c62b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:24:37.072361 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663383d6-0d74-4884-8e1e-bcc7d2a9c62b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:24:37.073924 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663383d6-0d74-4884-8e1e-bcc7d2a9c62b service placement] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:24:37.083732 dv-cinder-861001-1-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1305/2613] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Oct 13 11:24:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:24:47.079432 dv-cinder-861001-1-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=58 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}